UD profs part of Indiana-led grant from NSF

Research Technologies at Indiana University jointly with the University of Delaware have been awarded $300,000 by the National Science Foundation (NSF) to prepare real-world parallel scientific applications for integration into a benchmark suite that is currently under development at the High-Performance Group (HPG) of the Standard Performance Evaluation Corporation (SPEC).

The two-year grant will support the preparation of real-world scientific applications to be included in a new application benchmark that is developed by SPEC/HPG. This includes refactoring the applications so that they can be compiled on different hardware and software platforms — including IU’s Jetstream cloud computing system, the first production cloud funded by the NSF. In addition, this project will define datasets that that allow the applications to scale from a small number of nodes to large scale HPC systems. The new application benchmark will lead to a more realistic evaluation of HPC system designs and also enables better rankings of next-generation computing systems.

The advantage of using real-world applications over kernels or mini-apps is that application benchmarks not only expose the computation and communication hotspots but require the compilation and execution of the full application. This stress-tests the full hardware and software ecosystems, which is of critical importance for application developers, and especially for codes that have more than a few well-defined hotspots.

“This new grant allows us to study important parallel scientific applications and transform them into candidates for inclusion into the new SPEC HPG benchmark,” said Robert Henschel, Director of Science Community Tools in Research Technologies and PI of the award. “This work is fundamental to developing a balanced benchmark that represents the breadth of the high performance computing ecosystem.”

“UD (University of Delaware) has been a member of SPEC HPG over the past 3 years. We’re excited to continue our collaboration!” said Co-PI  Prof. Sunita Chandrasekaran, University of Delaware. “This new award will help us prepare a robust and high-quality software-hardware ecosystem that will be instrumental to advance science and innovation.” Co-PI Prof. Rudolf Eigenmann, also University of Delaware said, “Having benchmarks that are representative of real-world problems is key for building the right supercomputers.”

As computing power grows and scientific computing requires better performance, an application benchmark suite with solid metrics will have great impact on high performance computing and accelerate progress in all fields that are enabled by HPC. The proposed work leverages the NSF’s investment in domain science applications by preparing such applications for inclusion into the suite. The benchmark development process is an opportunity to bring the benchmarking community together and to define performance metrics for real world scientific applications.

Adapted from a press release by Indiana University

News Measuring Real-World Application Performance on Next-Generation Computing Systems