Search Space Generation and Pruning System for Autotuners

TitleSearch Space Generation and Pruning System for Autotuners
Publication TypeConference Paper
Year of Publication2016
AuthorsLuszczek, P., M. Gates, J. Kurzak, A. Danalis, and J. Dongarra
Conference Name30th IEEE International Parallel & Distributed Processing Symposium (IPDPS)
Date Published2016-05
Conference LocationChicago, IL
AbstractThis work tackles two simultaneous challenges faced by autotuners: the ease of describing a complex, multidimensional search space, and the speed of evaluating that space, while applying a multitude of pruning constraints. This article presents a declarative notation for describing a search space and a translation system for conversion to a standard C code for fast and multithreaded, as necessary, evaluation. The notation is Python-based and thus simple in syntax and easy to assimilate by the user interested in tuning rather than learning a new programming language. A large number of dimensions and a large number of pruning constraints may be expressed with little effort. The system is discussed in the context of autotuning the canonical matrix multiplication kernel for NVIDIA GPUs, where the search space has 15 dimensions and involves application of 10 complex pruning constrains. The speed of evaluation is compared against generators created using imperative programming style in various scripting and compiled languages.
Project Tags: