Skip navigation

Standard Performance Evaluation Corporation

 
 

SPEC HPG:

High Performance Group

The SPEC High-Performance Group (HPG) develops benchmarks that:

  • represent large, real applications, in scientific and technical computing,
  • use industry standard parallel application programming interfaces (APIs), OpenMP and MPI
  • support shared-memory and message passing programming paradigms,
  • can evaluate shared-memory computers, distributed-memory computers and workstation clusters as well as traditional massively parallel processor computers,
  • come in several data sets sizes (from a few minutes to days of execution time),
  • allow for certain hand optimizations of the codes (as opposed to compiler-only optimizations)

HPG Benchmark Suites

SPEC ACCEL Benchmark Suite

ACCEL focuses on the performance of highly parallel compute intensive applications using hardware acceleration using the OpenCL and OpenACC standards.


SPEC MPI Benchmark Suites
- MPIM2001 and MPIL2001

MPI2007 is SPEC's benchmark suite for measuring performance of compute intensive applications using the Message-Passing Interface (MPI) across a wide range of cluster and SMP hardware.

Beginning with SPEC MPI v2.0, both the MPIM2001 and MPIL2001 benchmark suites are contained on one DVD. The current version of the suite is v2.0.


SPEC OMP2012 Benchmark Suite

OMP2012 is the successor to the OMP2001 suite and is designed for measuring performance using applications based on the OpenMP 3.1 standard for shared-memory parallel processing. The benchmark also includes an optional metric for measuring energy consumption.


SPEC OMP2001 Benchmark Suites [Retired]
- OMPM2001 and OMPL2001

SPEC HPG benchmark suite for evaluating the performance of OpenMP applications and shared-memory systems. The suite has been retired and no further result submissions are being accepted. OMP2001 has been succeeded by the OMP2012 suite.


SPEC HPC2002 Benchmark Suite [Retired]
- SPEC CHEM2002, SPEC ENV2002, SPEC SEIS2002

SPEC HPG benchmark suite for measuring the performance of high-end computing systems running real applications from scientific and technical computing, especially suited for evaluating the performance of parallel computer architectures, including distributed memory computers. HPC2002 has been retired; no further result submissions are being accepted and sales of the suite have been discontinued. Information will remain available here for historical purposes.


SPEC HPC96 Benchmark Suite [Retired]
- SPECchem, SPECclimate, SPECseis

The HPC96 suite has been retired, and was replaced by the HPC2002 suite. Information will remain available here for historical purposes, but further result submissions are not being accepted and sales of the suite have been discontinued.

Use of HPG Benchmark Results

For any organization (or individual) who chooses to make public comparisons using SPEC benchmark results, please be sure to read and follow the Fair Use Policy. If you wish to make academic or research use of benchmark results, please review the recommendations in the document, "Guidelines for the Use of SPEC HPG Benchmarks in Research Publications."

 

Conference Presentations

Materials from HPG's Birds of a Feather (BOF) session at SC2003 are now available online:

  • SPEC High Performance Group (An Introduction) (Powerpoint)
    Kumaran Kalyanasundaram, SGI
  • Overview of SPEC HPG Benchmarks (Powerpoint)
    Matthias Mueller, High Performance Computing Center Stuttgart

Materials from other HPG conference presentations are also available; most are in Powerpoint and PDF format.

 

Joining SPEC/HPG

We welcome your interest in joining SPEC/HPG!

Future Benchmark Development, Call For Participation:

SPEC/HPG has continuing benchmark development efforts underway, and would welcome your participation. If you're a HPC application developer, system supplier, or user, this is your opportunity to help shape the standardized testing of your competitors! Contact SPEC