SPEC High Performance Group Publications

Topics:

• General
• SPEC ACCEL
• SPEChpc 2021
• SPEC MPI 2007
• SPEC OMP 2012

If you have published a paper that has used the SPEC HPG benchmarks for research and/or development purposes, we would like to hear from you and add your publication(s) to this webpage. Please write to info@spec.org. Thank you for choosing to use SPEC HPG benchmarks for your work.

General

• Tutorial at ISC22, May 2022, Hamburg, Germany
  "Using the New SPEChpc 2021 Scientific Application Benchmark Suites for the Evaluation of HPC Ecosystems"
  Holger Brunst, Robert Henschel, Sandra Wienke
  Event link
  
  
• Tutorial at SC20, Nov 2020, Virtual
  "Using the new SPEC HPC2021 Scientific Application Benchmark Suite"
  Sunita Chandrasekaran, Robert Henschel, Junjie Li, Verónica Melesse Vergara, Jimmy Cheng
  Event link
  
  
• Tutorial at SC19, Nov 2019, Denver, CO, United States:
  "Using the SPEC HPG Benchmarks for Better Analysis and Evaluation of Current and Future HPC Systems
  Robert Henschel, Junjie Li, Verónica G. Melesse Vergara, Mayara Gimenes, Sandra Wienke
  Event link; download slides
  
  
• Presentation at ZKI AK Supercomputing, Sep 2018, Freiburg, Germany:
  "An Introduction to the SPEC High Performance Group and their HPC Benchmark Suites
  Guido Juckeland
  download slides
  
  
• Presentation at HPC Advisory Council Meeting 2018, Lugano, Switzerland:
  "An Introduction to the SPEC High Performance Group and their HPC Benchmark Suites"
  Robert Henschel
  Video; download slides
  
  
• Tutorial at ISC18, at Frankfurt, Germany:
  "Using the SPEC HPG Benchmarks for Better Analysis and Evaluation of Current and Future HPC Systems"
  Robert Henschel, Sandra Wienke, Bo Wang, Sunita Chandrasekaran, Guido Juckeland, Junjie Li, Verónica G. Vergara Larrea
  Event link; download slides
  
  
• Tutorials at SC15 at Austin, United States:
  "Towards Comprehensive System Comparison: Using the SPEC HPG Benchmarks for Better Analysis, Evaluation, and Procurement of Next-Generation HPC Systems"
  Guido Juckeland, Ke Wang, Sandra Wienke, Oscar Hernandez, Robert Henschel, Kalyan Kumar, Wen-Mei Hwu, Mat Colgrove, Sunita Chandrasekaran, Kevin Skadron
  Event link; download slides
  
  
• Presentation at ScicomP 2015, York, United Kingdom:
  "An Introduction to the SPEC High Performance Group and Their Benchmark Suites"
  Robert Henschel, Huian Li
  Event link; download material here
  
  

SPEC ACCEL

• SPEC ACCEL: A Standard Application Suite for Measuring Hardware Accelerator Performance.
  Guido Juckeland, William Brantley, Sunita Chandrasekaran, Barbara Chapman, Shuai Che, Mathew Colgrove, Huiyu Feng, Alexander Grund, Robert Henschel, Wen-Mei W. Hwu, Huian Li, Matthias S. Müller, Wolfgang E. Nagel, Maxim Perminov, Pavel Shelepugin, Kevin Skadron, John Stratton, Alexey Titov, Ke Wang, Matthijs van Waveren, Brian Whitney, Sandra Wienke, Rengan Xu, Kalyan Kumaran
  In: Jarvis S., Wright S., Hammond S. (eds) High Performance Computing Systems. Performance Modeling, Benchmarking, and Simulation. PMBS 2014. Lecture Notes in Computer Science, vol 8966. Springer, Cham
  
  
• Performance portable applications for hardware accelerators: lessons learned from SPEC ACCEL.
  Juckeland, G., Grund, A., & Nagel, W. E. (2015, May).
  In Parallel and Distributed Processing Symposium Workshop (IPDPSW), 2015 IEEE International (pp. 689-698). IEEE.
  
  
• OpenACC programs examined: a performance analysis approach.
  Dietrich, R., Juckeland, G., & Wolfe, M. (2015, September).
  In Parallel Processing (ICPP), 2015 44th International Conference on (pp. 310-319). IEEE.
  
  
• From describing to prescribing parallelism: Translating the SPEC ACCEL OpenACC suite to OpenMP target directives.
  Guido Juckeland, Oscar Hernandez, Arpith C. Jacob, Daniel Neilson, Verónica G. Vergara Larrea, Sandra Wienke, Alexander Bobyr, William C. Brantley, Sunita Chandrasekaran, Mathew Colgrove, Alexander Grund, Robert Henschel, Wayne Joubert, Matthias S. Müller, Dave Raddatz, Pavel Shelepugin, Brian Whitney, Bo Wang, Kalyan Kumaran (2016, June).
  In International Conference on High Performance Computing (pp. 470-488). Springer, Cham
  
  

SPEChpc 2021

• SPEChpc 2021 Benchmark Suites for Modern HPC Systems
  Junjie Li, Alexander Bobyr, Swen Boehm, William Brantley, Holger Brunst, Aurelien Cavelan, Sunita Chandrasekaran, Jimmy Cheng, Florina M. Ciorba, Mathew Colgrove, Tony Curtis, Christopher Daley, Mauricio Ferrato, Mayara Gimenes de Souza, Nick Hagerty, Robert Henschel, Guido Juckeland, Jeffrey Kelling, Kelvin Li, Ron Lieberman, Kevin McMahon, Egor Melnichenko, Mohamed Ayoub Neggaz, Hiroshi Ono, Carl Ponder, Dave Raddatz, Severin Schueller, Robert Searles, Fedor Vasilev, Verónica Melesse Vergara, Bo Wang, Bert Wesarg, Sandra Wienke, and Miguel Zavala.
  In Companion of the 2022 ACM/SPEC International Conference on Performance Engineering (ICPE '22). Association for Computing Machinery, New York, NY, USA, 15–16.
  
  
• First Experiences in Performance Benchmarking with the New SPEChpc 2021 Suites
  Holger Brunst, Sunita Chandrasekaran, Florina M Ciorba, Nick Hagerty, Robert Henschel, Guido Juckeland, Junjie Li, Verónica G Melesse Vergara, Sandra Wienke, Miguel Zavala
  22nd IEEE International Symposium on Cluster, Cloud and Internet Computing (CCGrid), 2022, pp. 675-684
  

SPEC MPI 2007

• SPEC MPI2007 - an application benchmark suite for parallel systems using MPI.
  Matthias S. Müller, Matthijs van Waveren, Ron Lieberman, Brian Whitney, Hideki Saito, Kalyan Kumaran, John Baron, William C. Brantley, Chris Parrott, Tom Elken, Huiyu Feng, Carl Ponder.
  Concurrency and Computation: Practice and Experience Vol. 22, Issue 2 (2010): 191-205.
  
  
• SCALASCA Parallel Performance Analyses of SPEC MPI2007 Applications.
  Zoltán Szebenyi, Brian J. N. Wylie, and Felix Wolf.
  In Proc. of the 1st SPEC Int'l Performance Evaluation Workshop (SIPEW, Darmstadt, Germany), volume 5119 of Lecture Notes in Computer Science, pages 99-123, Springer, June 2008
  
  

SPEC OMP 2012

• SPEC OMP2012 — An Application Benchmark Suite for Parallel Systems Using OpenMP
  Matthias S. Müller, John Baron, William C. Brantley, Huiyu Feng, Daniel Hackenberg, Robert Henschel, Gabriele Jost, Daniel Molka, Chris Parrott and Joe Robichaux, et al.
  Lecture Notes in Computer Science, 2012, Volume 7312, OpenMP in a Heterogeneous World, Pages 223-236