News and Announcements

Systems Supporting ICL’s ECP Endeavors Point to the Future

In its work for the US Department of Energy’s Exascale Computing Project (ECP), ICL is benchmarking the OpenMP-based Parallel Linear Algebra Software for Multicore Architectures package (PLASMA) and will soon start prototyping solutions for the Software for Linear Algebra Targeting at Exascale project (SLATE) with backing from some of the latest and greatest high-performance computing systems.

Among those are the Titan supercomputer and the new Summit development (summit-dev) system, which resembles the upcoming Summit. Summit-dev has IBM POWER8 CPUs and Nvidia Pascal GPUs. The actual Summit, available to users in 2018, will have POWER9 and Nvidia Volta.

ICL also will have access to an ARMv8 system made by Cray and based on the Cavium ThunderX 48-core ARM CPUs. This opportunity is especially exciting because ARM appears to be a contender for exascale.

A report on PLASMA performance will be published soon, and the SLATE roadmap document will follow in a couple of months.

The Latest on the Exascale Computing Project

On April 18 at the HPC User Forum in Santa Fe, NM, Paul Messina, director of the US Department of Energy’s Exascale Computing Project (ECP), presented an update on the ECP.

Holistic and integrative in approach, the ECP was established to maximize the benefits of high-performance computing for the US and accelerate the development of a capable exascale computing ecosystem.

Exascale refers to computing systems that deliver fifty times the performance of today’s 20-petaflop systems, support applications that bring high-fidelity solutions in less time, and address problems of greater complexity.

Exascale systems will operate in a power envelope of 20 to 30 megawatts; provide sufficient resiliency, which means a perceived fault rate of 1 week or less; and include a software stack that supports a broad spectrum of applications and workloads.

Industry news outlets insideHPC and HPCwire covered Messina’s talk via a video, a podcast, and a synopsis article.

Conference Reports

Future Online Analysis Platform Workshop

ICL’s Piotr Luszczek and Terry Moore participated in a workshop on April 4th and 5th in Washington, DC, directed at confronting edge computing environments, which are characterized by the rapid proliferation and deployment of new and powerful data sources, ranging from huge instruments and experimental facilities to highly dispersed sensor networks.

Called the Future Online Analysis Platform, the workshop was sponsored by the US Department of Energy (DOE) and organized by Kate Keahey of Argonne National Laboratory and Jim Ahrens of Sandia National Laboratories. The workshop was designed to contribute to DOE’s effort to develop scalable cyberinfrastructure that can provide efficient and timely data analysis capabilities to researchers who want to channel and use this unprecedented flood of data.

Piotr participated as a representative of a nascent project focused on scalable distributed computing for data analysis in edge environments. Known as InLocus, the project is being developed by ICL with Martin Swany of Indiana University and Micah Beck of UT Knoxville.

Terry participated as a representative of the Big Data and Extreme-Scale Computing (BDEC) project. BDEC is premised on the need to systematically map out and account for the ways in which the major issues associated with Big Data intersect with, impinge upon, and potentially change the national (and international) plans that are now being laid out for achieving exascale computing. ICL has been leading the BDEC project the past several years.

Invited Talk at NASA Langley Research Center

During a visit April 11–12 to NASA Langley Research Center in Langley, VA, ICL’s Stephen Wood gave a talk on the numerical analysis and linear algebra subject of LU (“lower upper”) factorization to approximately twenty-five members of the center’s Computational Aerosciences Branch.

After his talk, Stephen spent the rest of his stay improving the performance and scalability of a finite element mini app by refactoring OpenMP commands; attending a talk on LAVA by Cetin Kiris, the NASA Computational Aerosciences Branch chief; attending a talk on transition modeling by James Coder of UT Knoxville’s Mechanical, Aerospace, and Biomedical Engineering Department; and participating in discussions concerning the HPC needs and challenges across NASA’s branches.

LAVA is a computational framework for launch, ascent, and vehicle aerodynamics.

Transition modeling pertains to predicting the changes between laminar (streamline) and turbulence flows in fluids and the effects on the overall solution. Transition modeling is very compute intensive.

“Detecting and quantifying the transition from laminar flow to turbulence and back again is one of the major frontiers of simulation and experimental science,” Stephen said. “In many respects the aerospace community is leading the charge to better understand turbulence, but the impacts of progress are felt in disciplines from meteorology to cardiology.”

Invited Talk for the DoD High Performance Computing Modernization Program

On April 25th in Aberdeen, MD, ICL’s Stephen Wood gave an invited talk at the US Department of Defense High Performance Computing Modernization Program PETTT Transition to Knight’s Landing (KNL): Approaches, Tools, and Architecture workshop to an interactive audience of approximately sixty people in person and thirty web participants. PETTT refers to user productivity enhancement, training, and technology transfer.

“The presentation sparked fruitful discussions about the influence of work-sharing patterns, the utility of OpenMP features, and the configuration of computational environment—KNL memory modes, numactl settings, numeric libraries, and so forth,” Stephen said.

Lessons learned during the development of what is called an asynchronous parallel LU factorization (PariLU) for dense and sparse matrices on Haswell, Knights Corner, and KNL processors were presented and discussed, along with other related subject matter.

Interview

Earl Carr ThenEarl Carr Now

Earl Carr

Where are you from originally?

I was born in Chicago, Illinois, but my family is originally from East Tennessee. My partner and I recently moved to the original homestead where my ancestors settled almost 200 years ago.

What is your educational background?

Bachelor’s in international studies from Long Island University, New York, with an additional propedeuse in international management from the College of Economic Studies (Hogeschool voor Economische Studies), Amsterdam, Netherlands. I’m also a certified project manager (PMP).

Where did you work before joining ICL?

Besides a six-month job at Roane State Community College in Harriman, TN, as the international education coordinator, I worked for fourteen years at IBM Netherlands.

What drew you to ICL?

To contribute to a government program that is attempting to make the fastest super computer in the world is pretty darn cool and impressive! Even though I don’t have a technical education, I enjoy working with technical people; I feel at home at ICL. Besides that, UT was the number one employer that I wanted to work for when I moved to the area.

What is your primary role here?

I am in charge of the administrative and project management (PM) elements for the ECP projects. The work involves implementing sound and cost/time-efficient PM improvements where needed, handling many of the project-related administrative duties so that the ECP project teams can focus on their work, and eventually becoming an expert on JIRA, confluence, and ECP.

What are your interests/hobbies outside of work?

Piddling around on our little homestead in the Tennessee mountains (I garden and plan to eventually raise some small livestock), singing, spending quality time with my family, enjoying wine and good food, and exercising. And I’m a news junkie.

Tell us something about yourself that might surprise us.

For ten years I was one of the lead singers for AGC (The Amstel Gospel Choir). AGC is a semiprofessional group that performs gospel and soul (nonreligious) music in the black American style all over the Netherlands and Belgium.

Recent Papers

  1. Abdelfattah, A., M. Baboulin, V. Dobrev, J. Dongarra, A. Haidar, I. Karlin, T. Kolev, I. Masliah, and S. Tomov, Small Tensor Operations on Advanced Architectures for High-Order Applications,” University of Tennessee Computer Science Technical Report, no. UT-EECS-17-749: Innovative Computing Laboratory, University of Tennessee, April 2017.  (1.09 MB)
  2. Faverge, M., J. Langou, Y. Robert, and J. Dongarra, Bidiagonalization and R-Bidiagonalization: Parallel Tiled Algorithms, Critical Paths and Distributed-Memory Implementation,” IEEE International Parallel and Distributed Processing Symposium (IPDPS), Orlando, FL, IEEE, May 2017. DOI: 10.1109/IPDPS.2017.46  (328.15 KB)
  3. Aupy, G., A. Benoit, L. Pottier, P. Raghavan, Y. Robert, and M. Shantharam, Co-Scheduling Algorithms for Cache-Partitioned Systems,” 19th Workshop on Advances in Parallel and Distributed Computational Models, Orlando, FL, IEEE Computer Society Press, May 2017. DOI: 10.1109/IPDPSW.2017.60  (584.76 KB)
  4. Jagode, H., Dataflow Programming Paradigms for Computational Chemistry Methods,” Innovative Computing Laboratory Technical Report, no. ICL-UT-17-01, Knoxville, TN, University of Tennessee, May 2017.
  5. Abdelfattah, A., A. Haidar, S. Tomov, and J. Dongarra, Fast Cholesky Factorization on GPUs for Batch and Native Modes in MAGMA,” Journal of Computational Science, vol. 20, pp. 85–93, May 2017. DOI: 10.1016/j.jocs.2016.12.009  (3.6 MB)
  6. Tomov, S., and A. Haidar, MAGMA Tensors and Batched Computing for Accelerating Applications on GPUs , San Jose, CA, GPU Technology Conference (GTC17), Presentation in Session S7728, May 2017.  (11.12 MB)
  7. Benoit, A., L. Pottier, and Y. Robert, Resilient Co-Scheduling of Malleable Applications,” International Journal of High Performance Computing Applications (IJHPCA), May 2017. DOI: 10.1177/1094342017704979  (1.62 MB)
  8. Yamazaki, I., S. Nooshabadi, S. Tomov, and J. Dongarra, Structure-aware Linear Solver for Realtime Convex Optimization for Embedded Systems,” IEEE Embedded Systems Letters, vol. 9, issue 3, pp. 61–64, May 2017. DOI: 10.1109/LES.2017.2700401  (339.11 KB)
  9. Dongarra, J., S. Tomov, P. Luszczek, J. Kurzak, M. Gates, I. Yamazaki, H. Anzt, A. Haidar, and A. Abdelfattah, With Extreme Computing, the Rules Have Changed,” Computing in Science & Engineering, vol. 19, issue 3, pp. 52-62, May 2017. DOI: 10.1109/MCSE.2017.48  (485.34 KB)

Recent Conferences

  1. APR
    -
    Future Online Analysis Platform Arlington, Virginia
    Piotr Luszczek
    Piotr
    Terry Moore
    Terry
    Piotr Luszczek, Terry Moore
  2. MAY
    -
    Azzam Haidar
    Azzam
    Piotr Luszczek
    Piotr
    Stanimire Tomov
    Stan
    Azzam Haidar, Piotr Luszczek, Stanimire Tomov
  3. MAY
    -
    David Bailey
    David
    Ichitaro Yamazaki
    Ichitaro
    Jack Dongarra
    Jack
    Piotr Luszczek
    Piotr
    David Bailey, Ichitaro Yamazaki, Jack Dongarra, Piotr Luszczek
  4. MAY
    -
    TESSE Workgroup Meeting Arlington, Virginia
    Damien Genet
    Damien
    George Bosilca
    George
    Thomas Herault
    Thomas
    Damien Genet, George Bosilca, Thomas Herault

Upcoming Conferences

  1. JUN
    -
    2017 GPU Hackathon Brookhaven Riverhead, New York
    Piotr Luszczek
    Piotr
    Piotr Luszczek
  2. JUN
    -
    ICCS17 / ISC17 Zurich, Switzerland
    Stanimire Tomov
    Stan
    Stanimire Tomov
  3. JUN
    -
    ISC17 Frankfurt, Germany
    George Bosilca
    George
    George Bosilca
  4. JUN
    Anthony Danalis
    Anthony
    Anthony Danalis

Recent Lunch Talks

  1. APR
    7
    Benjamin Hernandez
    Benjamin Hernandez
    ORNL
    GPU Refinement Learning for Crowd Simulations PDF
  2. APR
    21
    Sangamesh Ragate
    Sangamesh Ragate
    Sequence Labeling Using RNN PDF
  3. APR
    28
    Azzam Haidar
    Azzam Haidar
    Toward Distributed Eigenvalue and Singular Value Solver Using Data Flow System PDF
  4. MAY
    5
    Lynne Parker
    Lynne Parker
    EECS
    Some Lessons Learned from My 2-Year Stint at NSF: The Abbreviated Version PDF
  5. MAY
    19
    Chris DavisSophie Voisin
    Chris Davis and Sophie Voisin
    ORNL
    Combining NVIDIA Docker and Databases to Enhance Agile Development and Optimize Resource Allocation PDF
  6. MAY
    26
    Markus Eisenbach
    Markus Eisenbach
    ORNL
    A Linear Scaling Multiple Scattering Code for First Principles Calculations of the Ground State and Statistical Physics of Materials PDF

Upcoming Lunch Talks

  1. JUN
    30
    Saeid Nooshabadi
    Saeid Nooshabadi
    Michigan Technological University
    Algorithm and Architecture for Density Estimation for Data Intensive Application in High Dimension PDF

People

  1. Diana Fayad
    ICL welcomes student intern Diana Fayad, who is working with Jakub Kurzak and Piotr Luszczek in autotuning (automatic software tuning). Diana is getting up to speed on developments in the BONSAI project so she can provide general assistance and perhaps progress to experimenting with machine learning techniques.

congratulations

Spring 2017 Graduates

Five students from ICL are receiving degrees this semester, four with PhDs and one with an MS. Having this many graduates in a semester is unprecedented for the organization and quite an honor. Congratulations to Chongxiao (Sean) Cao (PhD), Heike Jagode (PhD), Khairul Kabir (PhD), Sangamesh Ragate (MS), and Wei Wu (PhD).