2022 Workshop: HPC on Heterogeneous Hardware (H3)
The HPC on Heterogeneous Hardware (H3) Workshop is intended as a hybrid event in Hamburg, Germany. It does so by providing a platform for pioneering work on algorithmic research, software library design, programming models, and workflow development for increasingly heterogeneous hardware. In the workshop context, such hardware spans from ARM processors featuring long-vector extensions through GPU-accelerated systems to architectures deploying special function units, FPGAs, or deep learning processors. The workshop will compose of a well-balanced mix of invited talks, peer-reviewed conference contributions, and a panel bringing together worldwide experts in heterogeneous computing.
The DOE Report on Productive Computational Science in the Era of Extreme Heterogeneity identified 8 areas that would affected by the inevitable arrival and eminence of heterogeneity: programming environments, O/S, SysOps, productivity metrics/tools, software methodology, I/O, workflows, and modeling. These themes rang particularly true at our own Heterogeneity Panel featured recently at SC21 with hybrid online/virtual attendance of about 180 participants.
Very few companies, now including only Intel, Samsung, and TSMC, manage to mass produce CMOS device at the single-nm scale: a somewhat whimsically called Angstrom era of lithography entering more convenient unit of measurement Angstrom for atomic-scale transistor features. With Dennard Scaling long gone and Moore's Law at cross-roads, heterogeneity became the prevailing paradigm to maximally exploit the efficiency of the on-chip transistors at the 10s of Angstroms scale in what now may be considered new era of chip design.
Perhaps the most challenging aspect is to limit the workshop's scope to the very few thematic areas that currently dominate the efforts of the community. This year, these include the following topics of interest:
- Heterogeneity in programming approaches including language solutions and DSL-friendly middleware libraries.
- Heterogeneous workloads that rely on convergence of scientific modeling, data analytics, and scientific AI/ML data models
- Heterogeneity in data representation including hierarchical, randomized, compressive, and mixed-precision methods
Topics of Interest
A more specific list of topics of interest to focus the submissions and draw specific speakers and invite broad participation of attendees will be the following:
- Heterogeneous algorithms that scale not just in terms of the system size but across diverse hardware kinds.
- Heterogeneity in data approaches that incorporate mixed-precision storage and compute include data compression as well as hierarchical and randomized projections.
- Software systems and libraries that support heterogeneous compute hardware and networking.
- Programming models and tools that incorporate heterogeneity of both on-node compute and cross-node networking.
- Abstract submission: April 7, 2022 (AOE)
- Paper submission: April 14, 2022 (AOE)
- Notification to authors: April 30, 2022 (AOE)
- Final workshop materials: May 6, 2022 (AOE)
- Workshop date: June 2, 2022 (AOE)
- Hartwig Anzt, Karlsruher Institute für Technologie (KIT), Germany
- Bilel Hadri, King Abdullah University of Science and Technology (KAUST), Saudi Arabia
- Hatem Ltaief, King Abdullah University of Science and Technology (KAUST), Saudi Arabia
- Piotr Luszczek, University of Tennessee, USA
- Qinglei Cao, University of Tennessee, USA
- Pedro Diniz, University of Porto, Portugal
- Jiali Li, University of Tennessee, USA
- Neil Lindquist, University of Tennessee, USA
- Max Melnichenko, University of Tennessee, USA
- Yu Pei, University of Tennessee, USA
Format of the Workshop
H3 Workshop is initially meant as a half-day workshop to enable a selection of a good set of contributed manuscripts and talks. We would also like to ensure a programmatically balanced program and maintain a reasonable burden on the reviewers in order to provide sufficient quality of the paper reviews and informative feedback for the authors. The workshop will be held as a hybrid event.
A sample schedule of the afternoon workshop to accommodate in-person attendees in Hamburg, Germany, and potential online attendees across multiple time zones will follow this general outline:
- June 2, 2022
- 14:00 - 14:10 | Introduction (Anzt, Luszczek)
- 14:10 - 14:50 | Keynote talk: Machine Learning Benchmarking for Science: Experience and Lessons from the MLCommons Science Working Group presented by Jeyan Thiyagalingam, STFC UKRI
- 14:50 - 15:00 | Q&A session
- 15:00 - 15:20 | A Multi-Level Platform-Independent GPU API for High-Level Programming Models, Akihiro Hayashi (presenter), Sri Raj Paul, and Vivek Sarkar
- 15:20 - 15:40 | Strategies for efficient execution of Pipelined Conjugate Gradient method on GPU systems, Manasi Tiwari (presenter) and Sathish Vadhiyar
- 15:40 - 16:00 | Performance Analysis of Matrix Multiplication for Deep Learning on the Edge by Cristian Ramírez, Adrián Castelló, Héctor Martínez, and Enrique S. Quintana-Orti (presenter)
- 16:00 - 16:30 | Coffee break
- 16:30 - 16:50 | Precise Energy Consumption Measurements of Heterogeneous Artifical Intelligence Workloads, René Caspart, Sebastian Ziegler, Arvid Weyrauch, Holger Obermaier, Simon Raffeiner, Leon Pascal Schuhmacher, Jan Scholtyssek, Darya Trofimova, Marco Nolden, Ines Reinartz, Fabian Isensee, Markus Götz and Charlotte Debus (presenter)
- H3 Workshop concludes
Paper Submission and Publication
Papers should be submitted to the workshop with EasyChair. They will be reviewed and should include abstract, keywords, the e-mail address of the corresponding author, and must not exceed 12 pages, including text, tables, figures, and references at a main font size no smaller than in LNCS style. Submission of a paper should be regarded as a commitment that, should the paper be accepted, at least one of the authors will register and attend the workshop to present the work.
Accepted papers will be published in a Springer LNCS volume (SCOPUS indexed). The format must be according to the Springer LNCS Style. Initial submissions are in PDF but the authors of accepted papers will be requested to provide source files.
Any inquires should be directed to organizers.