Skip navigation

Standard Performance Evaluation Corporation

 
 

The Standard Performance Evaluation Corporation (SPEC) is a non-profit corporation formed to establish, maintain and endorse standardized benchmarks and tools to evaluate performance and energy efficiency for the newest generation of computing systems. SPEC develops benchmark suites and also reviews and publishes submitted results from our member organizations and other benchmark licensees.

What's New:

04/18/2017: Version 2.0 of the Chauffeur Workload Development Kit (WDK) has been released. This major release is based on the SERT 2.0 infrastructure and includes significant enhancements to the hardware detection, customization options of generating HTML reports, and developer documentation. It has now reduced memory requirements for the Director when signing results files and reduced the size of the result output for large systems or clusters. There is also an updated list of supported operating systems including Ubuntu (14.04 LTS and 16.04 LTS) as well as current versions of Windows Server, RHEL, SLES, AIX, and Solaris.

04/04/2017: A patch has been released for SPECvirt_sc2013 V1.1 which addresses an issue encountered when running the webserver workload with TLS encryptions which would cause any result to be marked as invalid. Any result submissions using TLSv1, TLSv1.1, or TLSv1.2 encryptions for the webserver workload must use this patch.

04/04/2017: Scott Beamer III from the University of California, Berkeley is the winner of the 2016 SPEC Kaivalya Dixit Distinguished Dissertation Award with his dissertation on the characterization and treatment of fundamental performance bottlenecks in graph processing and the contribution of the Graph Algorithm Platform (GAP) benchmark suite.

03/28/2017: SPEC announces the release of the Server Efficiency Rating Tool (SERT) 2.0, which adds a single-value metric, reduces runtime, improves automation and testing, and broadens device and platform support. Designed to be simple to configure and use via a comprehensive graphical user interface, the SERT suite uses a set of synthetic worklets to test discrete system components such as processors, memory and storage, providing detailed power consumption data at different load levels.

03/22/2017: Walter Bays steps down as SPEC president after presiding over 12 years of growth; he is succeeded by David Reiner, a SPEC 12-year veteran.

01/03/2017: SPEC Cloud IaaS 2016 V1.1 is now available. This update includes bug fixes and usability improvements, libcloud support for easy adapter development, and OpenStack driver updates. Licensees of version 1.0 are entitled to a complimentary upgrade. Starting January 23, 2017, all result submissions must be made using version 1.1 and version 1.0 will be retired.

09/21/2016: SPECvirt_sc2013 has been updated to version 1.1. This update includes added support for TLSv1, TLSv1.1 and TLSv1.2 with several new ciphers, an updated PTDaemon version, and documentation updates.

08/24/2016: The SPEC Graphics Performance Characterization Group (SPECgpc) has released an updated version of its SPECviewperf benchmark that features a new Autodesk 3ds Max viewset, Microsoft Windows 10 support, and GUI and reporting improvements. The benchmark runs under the 64-bit versions of Microsoft Windows 7 and Windows 10. Results from V12.1 remain comparable to those from V12.0.1 and V12.0.2.

08/17/2016: The SPEC JMS 2007 benchmark will be retired on November 23, 2016. New result submissions will be accepted through November 9, 2016. After that time, no further submissions will be accepted and technical support will no longer be offered.

07/07/2016: Call for nominations: SPEC's Research Group is soliciting nominations for the SPEC Distinguished Dissertation Award. This award aims to recognize outstanding doctoral dissertations in the field of computer benchmarking, performance evaluation, and experimental system analysis in general. The award is open to dissertations that have been defended between October 1, 2015 and September 30, 2016, and the nomination submission deadline is September 30, 2016.

07/06/2016: The SPECapc project group has released new performance evaluation software for systems running Siemens NX 9.0 and NX 10.0 CAD/CAM applications. The new benchmark can be run with Siemens NX 9.0 or NX 10.0, although results from the two different application versions are not comparable. Users need an NX 9.0 or NX 10.0 license that includes the NX Shape Studio or equivalent bundle for Advanced Studio rendering. The benchmark is designed to run on Microsoft Windows 7 64-bit platforms.

05/27/2016: SPEC plans to bring a performance benchmarking symposium, a server efficiency symposium, and several of its technical meetings to Beijing, China, the week of October 24, 2016. This will be an opportunity to bring together computing researchers, policy makers, government agencies, industry practitioners and others interested in performance and energy-efficiency evaluation to learn about SPEC, share ideas, discuss challenges and present results. If you are interested in attending, please complete and submit this registration form.

05/03/2016: SPEC announces the release of SPEC Cloud_IaaS 2016, a new benchmark software that measures the performance of infrastructure-as-a-service (IaaS) cloud implementations. The SPEC Cloud IaaS 2016 benchmark measures scalability, elasticity and provisioning capabilities of IaaS cloud implementations, both public and private. Cloud providers, users of cloud services, and hardware, software and management platform vendors can use the benchmark to evaluate how different implementations affect cloud performance.

03/14/2016: The SPEC Workstation Performance Characterization (SPECwpc) group has added support for Windows 10 to SPECwpc V2.0, its benchmark that measures all key aspects of workstation performance based on diverse professional applications. The benchmark does not require the full application and associated licensing to be installed on the system under test, simplifying set-up, running and results reporting.

 

[Older items can be found in the archive.]