News and Announcements

2020 Retreat

As with everything 2020, the annual ICL retreat was a bit different this year. Rather than hoof it over to Gatlinburg or Townsend, we all “dialed in” to the retreat from our own home offices, living rooms, and wherever else.

Zoom was a capable platform for two days of talks that covered student projects and summer internships; the lab’s progress in the areas of linear algebra, distributed computing, benchmarking, and performance analysis; and recaps of administrative procedures.

Serving as a kickoff to the fall semester, the 2020 retreat was a success by any measure. As we move through the rest of the year, ICL will continue to move forward and adapt where necessary. Here’s to next year’s retreat, where we can hopefully be more concerned about bear encounters than human malware.

Employment Opportunities at ICL

ICL is seeking full-time Research Scientists (MS or PhD) to participate in the design, development, and maintenance of numerical software libraries for solving linear algebra problems on large, distributed-memory machines with multi-core processors, hardware accelerators, and performance monitoring capabilities for new and advanced hardware and software technologies.

The prospective researcher will coauthor papers to document research findings, present the team’s work at conferences and workshops, and help lead students and other team members in their research endeavors in ongoing and future projects. Given the nature of the work, there will be opportunities for publication, travel, and high-profile professional networking and collaboration across academia, labs, and industry.

An MS or PhD in computer science, computational sciences, or math is preferred. Background in at least one of the following areas is also preferred: numerical linear algebra, HPC, performance monitoring, machine learning, or data analytics.

For more information check out ICL’s jobs page: http://www.icl.utk.edu/jobs.

Conference Reports

Best Paper at IEEE Cluster 2020

This year’s IEEE Cluster Conference went virtual in lieu of an on-the-ground meeting in Kobe, Japan. As in years past, IEEE Cluster 2020 served as a major international forum for presenting and sharing recent accomplishments and technological developments in the field of cluster computing as well as the use of cluster systems for scientific and commercial applications.

For ICL’s part, alum Xi Luo presented the DisCo team’s work on HAN: A Hierarchical AutotuNed Collective Communication Framework, which works towards addressing the increased scale and heterogeneity of new and upcoming HPC platforms and the challenges these trends present to the design of MPI libraries. With a task-based and modular design, HAN can easily swap out abstracted submodules while keeping tasks intact to adapt to new hardware. This strategy provides strong and flexible support for future HPC systems that also—owing to its autotuning component—significantly improves the default Open MPI implementation and achieves decent speedups against state-of-the-art MPI implementations in a battery of application tests.

Luo, X., W. Wu, G. Bosilca, Y. Pei, Q. Cao, T. Patinyasakdikul, D. Zhong, and J. Dongarra, “HAN: A Hierarchical AutotuNed Collective Communication Framework,” IEEE Cluster Conference, Kobe, Japan, IEEE Computer Society Press, September 2020.

This paper, which describes work undertaken for Xi’s PhD dissertation, also won a Best Paper Award at IEEE Cluster 2020. Congratulations to Xi and his coauthors!

EuroMPI 2020

This year’s EuroMPI was actually held in Austin, TX, though it wasn’t really there either. The virtual conference kicked off on September 21st and was Chaired by Wesley Bland—ICL alum and former DisCo Graduate Research Assistant.

Dong Zhong, current DisCo Graduate Research Assistant, presented his team’s work on “Using Advanced Vector Extensions AVX-512 for MPI Reduction.” You can watch his entire presentation above or read the paper here.

Smoky Mountains Computational Sciences and Engineering Conference

This year’s Smoky Mountains Computational Sciences and Engineering Conference (SMC 2020) was hosted virtually by Oak Ridge National Laboratory. No bear (or tiger) encounters this year, but the conference had a fully packed agenda and good attendance with over 350 people registered for the event.

For ICL’s part, Graduate Research Assistant Neil Lindquist presented his paper “Improving Performance of the GMRES Method Using Mixed Precision Techniques” on Wednesday, August 26th.

The GMRES method is used to solve sparse, non-symmetric systems of linear equations arising from many scientific applications. To reduce the amount of data movement and improve performance, Neil and his coauthors found that GMRES only needs double precision when computing the residual and updating the approximate solution and would still achieve double-precision accuracy with a mixed-precision approach in other parts of the solver.

SMC is always a popular workshop among ICLers, and we hope to be physically present again at SMC 2021.

Recent Releases

PLASMA 20.9.20 Released

PLASMA 20.9.20 is now available. The Parallel Linear Algebra Software for Multi-core Architectures (PLASMA) implements a set of fundamental linear algebra routines using the latest updates to the Open Multi-Processing (OpenMP) standard. PLASMA includes, among others, routines for solving linear systems of equations, linear least square problems, parallel BLAS, and parallel matrix norms.

New changes for PLASMA 20.9.20 are listed below.

Features:

  • added support for detecting Apple’s Accelerate Framework as BLAS and LAPACK implementations;
  • added GPU offload option detection with the MAGMA library;
  • made PLASMA pure OpenMP by removing code that relies on POSIX threads; and
  • added version reporting in PLASMA tester.

Bug fixes:

  • fixed support for wider range of CMake versions and
  • fixed Fortran examples’ syntax.

Check out PLASMA’s BitBucket repository to download the tarball.

Interview

Maksim Melnichenko Then

Maksim Melnichenko

Where are you from, originally?
I am originally from Kaliningrad, Russia.

Can you summarize your educational background?
I graduated from Millersville University of Pennsylvania in May 2020 with two Bachelor of Science degrees: (1) Applied Mathematics and (1) Computer Science. Currently, I am pursuing an early stage PhD program in Mathematics at UTK.

Where did you work before joining ICL?
My past experience is rather modest—I worked on an undergraduate research project during my senior year and have been working for the Department of Mathematics as a tutor since fall 2018 and up until graduation.

How did you first hear about the lab, and what made you want to work here?
Throughout my undergraduate research, I have seen many references to the ICL’s papers.
Additionally, I heard many things about the lab from my undergraduate advisor. I visited the lab during Fall break in 2019, talked to Dr. Luszczek, and solidified my decision to apply to ICL.

What is your focus here at ICL? What are you working on?
I work as a Graduate Research Assistant in the Linear Algebra group. So far, my work is related to overviewing and testing the singular value decomposition (SVD)–related routines of PLASMA. As for potential future work, I am hoping to continue the research in optimizing and enhancing SVD algorithms.

What are your interests/hobbies outside of work?
My primary hobbies are graphical artwork and tattooing. I am also interested in historical and philosophical literature, the video game industry and design, and playing guitar.

Tell us something about yourself that might surprise people.
The location of my hometown tends to surprise people that are not especially interested in geography.

If you weren’t working at ICL, where would you like to be working and why?
Most realistically, I would take a TA position in the Department of Mathematics at UTK, as I would still be pursuing a PhD in Mathematics.

Recent Papers

  1. Hori, A., T. Ogura, B. Gerofi, J. Yin, Y. Ishikawa, E. Jeannot, and G. Bosilca, A Report of the MPI International Survey (Poster) , Austin, TX, EuroMPI/USA '20: 27th European MPI Users' Group Meeting, September 2020.
  2. Brown, C., A. Abdelfattah, S. Tomov, and J. Dongarra, Design, Optimization, and Benchmarking of Dense Linear Algebra Algorithms on AMD GPUs,” 2020 IEEE High Performance Extreme Computing Virtual Conference: IEEE, September 2020.  (476.36 KB)
  3. Barry, D., A. Danalis, and H. Jagode, Effortless Monitoring of Arithmetic Intensity with PAPI's Counter Analysis Toolkit,” 13th International Workshop on Parallel Tools for High Performance Computing, Dresden, Germany, Springer International Publishing, September 2020.  (738.47 KB)
  4. Cao, Q., G. Bosilca, W. Wu, D. Zhong, A. Bouteiller, and J. Dongarra, Flexible Data Redistribution in a Task-Based Runtime System,” IEEE International Conference on Cluster Computing (Cluster 2020), Kobe, Japan, IEEE, September 2020. DOI: 10.1109/CLUSTER49012.2020.00032  (354.8 KB)
  5. Luo, X., W. Wu, G. Bosilca, Y. Pei, Q. Cao, T. Patinyasakdikul, D. Zhong, and J. Dongarra, HAN: A Hierarchical AutotuNed Collective Communication Framework,” IEEE Cluster Conference, Kobe, Japan, Best Paper Award, IEEE Computer Society Press, September 2020.  (764.05 KB)
  6. Lopez, F., and T. Mary, Mixed Precision LU Factorization on GPU Tensor Cores: Reducing Data Movement and Memory Footprint,” Innovative Computing Laboratory Technical Report, no. ICL-UT-20-13: University of Tennessee, September 2020.  (409 KB)
  7. Hunold, S., A. Bhatele, G. Bosilca, and P. Knees, Predicting MPI Collective Communication Performance Using Machine Learning,” 2020 IEEE International Conference on Cluster Computing (CLUSTER), Kobe, Japan, IEEE, September 2020. DOI: 10.1109/CLUSTER49012.2020.00036  (619.68 KB)
  8. Luszczek, P., Y. Tsai, N. Lindquist, H. Anzt, and J. Dongarra, Scalable Data Generation for Evaluating Mixed-Precision Solvers,” 2020 IEEE High Performance Extreme Computing Conference (HPEC), Waltham, MA, USA, IEEE, September 2020. DOI: 10.1109/HPEC43674.2020.9286145  (1.3 MB)
  9. Dongarra, J., M. Gates, P. Luszczek, and S. Tomov, Translational Process: Mathematical Software Perspective,” Journal of Computational Science, September 2020. DOI: 10.1016/j.jocs.2020.101216  (752.59 KB)
  10. Zhong, D., G. Bosilca, Q. Cao, and J. Dongarra, Using Advanced Vector Extensions AVX-512 for MPI Reduction (Poster) , Austin, TX, EuroMPI/USA '20: 27th European MPI Users' Group Meeting, September 2020.  (708.68 KB)
  11. Zhong, D., Q. Cao, G. Bosilca, and J. Dongarra, Using Advanced Vector Extensions AVX-512 for MPI Reduction,” EuroMPI/USA '20: 27th European MPI Users' Group Meeting, Austin, TX, September 2020. DOI: 10.1145/3416315.3416316  (634.45 KB)
  12. Abdelfattah, A., T. Costa, J. Dongarra, M. Gates, A. Haidar, S. Hammarling, N. J. Higham, J. Kurzak, P. Luszczek, S. Tomov, et al., A Set of Batched Basic Linear Algebra Subprograms,” ACM Transactions on Mathematical Software, October 2020.
  13. Ayala, A., S. Tomov, A. Haidar, and J. Dongarra, heFFTe: Highly Efficient FFT for Exascale (Poster) : NVIDIA GPU Technology Conference (GTC2020), October 2020.  (866.88 KB)
  14. YarKhan, A., M. Al Farhan, D. Sukkari, M. Gates, and J. Dongarra, SLATE Performance Report: Updates to Cholesky and LU Factorizations,” Innovative Computing Laboratory Technical Report, no. ICL-UT-20-14: University of Tennessee, October 2020.  (1.64 MB)

Recent Conferences

  1. SEP
    -
    IEEE Cluster 2020 Kobe, Japan
    Dong Zhong
    Dong
    George Bosilca
    George
    Jack Dongarra
    Jack
    Qinglei Cao
    Qinglei
    Yu Pei
    Yu
    Dong Zhong, George Bosilca, Jack Dongarra, Qinglei Cao, Yu Pei
  2. SEP
    -
    EuroMPI 2020 Austin, Texas
    Dong Zhong
    Dong
    Dong Zhong
  3. SEP
    -
    IEEE HPEC Virtual
    Cade Brown
    Cade
    Cade Brown
  4. SEP
    -
    MPI Forum Virtual
    Aurelien Bouteiller
    Aurelien
    Joseph Schuchart
    Joseph
    Aurelien Bouteiller, Joseph Schuchart

Upcoming Conferences

  1. NOV
    -
    Supercomputing 2020 Knoxville, Tennessee
    Anthony Danalis
    Anthony
    Daniel Barry
    Daniel
    George Bosilca
    George
    Natalie Beams
    Natalie
    Neil Lindquist
    Neil
    Piotr Luszczek
    Piotr
    Terry Moore
    Terry
    Yu Pei
    Yu
    Anthony Danalis, Daniel Barry, George Bosilca, Natalie Beams, Neil Lindquist, Piotr Luszczek, Terry Moore, Yu Pei

Recent Lunch Talks

  1. SEP
    4
    Sudip Seal
    Sudip Seal
    Oak Ridge National Laboratory
    Revisiting Parallel Algorithms for Block Tridiagonal Systems PDF
  2. SEP
    11
    Richard Barrett
    Richard Barrett
    Sandia National Laboratories
    Chapel Performance for Some Graph Analytics PDF
  3. SEP
    25
    Anthony Skjellum
    Anthony Skjellum
    UT Chattanooga SimCenter
  4. OCT
    2
    Micah Beck
    Micah Beck
    EECS
    One Device To Rule Them All
  5. OCT
    9
    Thomas Herault
    Thomas Herault
  6. OCT
    16
    Florent Lopez
    Florent Lopez
    Running SLATE using the PaRSEC Runtime System PDF
  7. OCT
    23
    Sunita Chandrasekaran
    Sunita Chandrasekaran
    University of Delaware
    Developing Software for Today's and Tomorrow's platform - Fun or a Nightmare!
  8. OCT
    30
    Piotr Luszczek
    Piotr Luszczek
    Scalable Data Generation for Evaluating Mixed-Precision Solvers

Upcoming Lunch Talks

  1. NOV
    6
    Heike Jagode
    Heike Jagode
    Dataflow Execution for Computational Chemistry Methods
  2. NOV
    13
    Asim YarKhan
    Asim YarKhan
    Profiling and Performance Improvements in SLATE: Experience with the Cholesky Factorization

People

  1. Maksim Melnichenko
    Maksim Melnichenko joined ICL in September as a Graduate Research Assistant to work with the Linear Algebra group on the PLASMA project. Welcome, Maksim!
  2. Wissam Sid Lakhdar
    Wissam Sid Lakhdar joined ICL in September as a Research Scientist. Wissam will be working with the Linear Algebra group on the BALLISTIC project. Welcome, Wissam!

Dates to Remember

ICL @ SC20 Cocktail Hour

Mark your calendars for the ICL @ SC20 Cocktail Hour on Wednesday, November 18 @ 6:00 p.m. EST. Registration and coordinates to follow!

ICL Friday Talks

Don’t forget: ICL Friday Talks are up and running on Zoom!

Coffee Chats @ 1:30 p.m.

The daily ICL coffee chats have moved to 1:30 p.m. on Zoom!