Heterogeneous Acceleration for Linear Algebra in Mulit-Coprocessor Environments

TitleHeterogeneous Acceleration for Linear Algebra in Mulit-Coprocessor Environments
Publication TypeConference Paper
Year of Publication2014
AuthorsHaidar, A., P. Luszczek, S. Tomov, and J. Dongarra
Conference NameVECPAR 2014
Date Published2014-06
Conference LocationEugene, OR
KeywordsComputer science, factorization, Heterogeneous systems, Intel Xeon Phi, linear algebra

We present an efficient and scalable programming model for the development of linear algebra in heterogeneous multi-coprocessor environments. The model incorporates some of the current best design and implementation practices for the heterogeneous acceleration of dense linear algebra (DLA). Examples are given as the basis for solving linear systems’ algorithms – the LU, QR, and Cholesky factorizations. To generate the extreme level of parallelism needed for the efficient use of coprocessors, algorithms of interest are redesigned and then split into well-chosen computational tasks. The tasks execution is scheduled over the computational components of a hybrid system of multi-core CPUs and coprocessors using a light-weight runtime system. The use of light-weight runtime systems keeps scheduling overhead low, while enabling the expression of parallelism through otherwise sequential code. This simplifies the development efforts and allows the exploration of the unique strengths of the various hardware components.

Project Tags: