Parallel Performance Measurement of Heterogeneous Parallel Systems with GPUs

TitleParallel Performance Measurement of Heterogeneous Parallel Systems with GPUs
Publication TypeConference Paper
Year of Publication2011
AuthorsMalony, A. D., S. Biersdorff, S. Shende, H. Jagode, S. Tomov, G. Juckeland, R. Dietrich, D. Poole, and C. Lamb
Conference NameInternational Conference on Parallel Processing (ICPP'11)
Date Published2011-09
Conference LocationTaipei, Taiwan
ISBN Number978-0-7695-4510-3
Keywordsmagma, mumi, papi

The power of GPUs is giving rise to heterogeneous parallel computing, with new demands on programming environments, runtime systems, and tools to deliver high-performing applications. This paper studies the problems associated with performance measurement of heterogeneous machines with GPUs. A heterogeneous computation model and alternative host-GPU measurement approaches are discussed to set the stage for reporting new capabilities for heterogeneous parallel performance measurement in three leading HPC tools: PAPI, Vampir, and the TAU Performance System. Our work leverages the new CUPTI tool support in NVIDIA’s CUDA device library. Heterogeneous benchmarks from the SHOC suite are used to demonstrate the measurement methods and tool support.

Project Tags: 
External Publication Flag: