On block-asynchronous execution on GPUs

TitleOn block-asynchronous execution on GPUs
Publication TypeTech Report
Year of Publication2016
AuthorsAnzt, H., E. Chow, and J. Dongarra
Technical Report Series TitleLAPACK Working Note
Date Published2016-11

This paper experimentally investigates how GPUs execute instructions when used for general purpose computing (GPGPU). We use a light-weight realizing a vector operation to analyze which vector entries are updated subsequently, and identify regions where parallel execution can be expected. The results help us to understand how GPUs operate, and map this operation mode to the mathematical concept of asynchronism. In particular it helps to understand the effects that can occur when implementing a fixed-point method using in-place updates on GPU hardware.