Standard Performance Evaluation Corporation

SPEC Frequently Asked Questions

Contents:

1. What services does SPEC provide?
2. Where can I find a benchmark result for a specific configuration?
3. Which system/configuration/instance/component should I purchase?
4. What does it mean for a SPEC benchmark to be "retired"?
5. Are there any trial or evaluation versions of the SPEC benchmarks available?
6. What kind of license is included with the software?
7. Who qualifies for the educational and non-profit pricing?
8. What is SPEC's position regarding computer security vulnerabilities, their mitigations, and the impacts of those mitigations?

What services does SPEC provide?

SPEC's main products are its benchmark suites developed by the various groups which comprise the organization. A full list is located on this page. SPEC services include results review and publication as well as technical support of licensed benchmarks.

Where can I find a benchmark result for a specific configuration?

Benchmark results, measurements and other data are provided by SPEC on our website. SPEC does not perform these measurements itself, rather it allows members and in some cases other licensees to submit results and measurements for review and publication on SPEC's website. If you are unable to find a particular configuration on the site, it is most likely that results for the configuration have not yet been submitted to SPEC for publication.

In extremely rare cases, a result that was previously published may no longer be available on SPEC's website. For example, when an compliance issue with a specific published result is discovered after publication, SPEC may determine that the affected result must be withdrawn in accordance with the run rules of that particular benchmark.

Which system/configuration/instance/component should I purchase?

SPEC does not make purchase recommendations for computer systems, services, instances or components. This includes but is not limited to PC/workstation systems, servers, configurations thereof, instances, components, and computer purchases. SPEC provides performance, power, and energy efficiency data to help users make informed purchasing decisions (all available from the results index) but SPEC does not offer opinions regarding suitability for purpose or any kind of qualitative assessment.

What does it mean for a SPEC benchmark to be "retired"?

Retired in the context of SPEC benchmarks means that SPEC no longer provides technical support or accepts result submissions for posting on the SPEC website. Often SPEC will decide to retire a benchmark when there is a more recent replacement. Sometimes a benchmark is retired when it has become too outdated to be adequately supported by SPEC's volunteers. Benchmark retirement notices are posted on the SPEC website and typically reported at least two months in advance of the retirement date.

Are there any trial or evaluation versions of the SPEC benchmarks available?

SPEC does not offer trial versions of the SPEC benchmarks. If you purchase software and are dissatisfied, you may return the software and license for a full refund of the software purchase price within thirty days after you complete the Letter of Destruction. Contact the SPEC office.

What kind of license is included with the software?

The licenses for SPEC benchmark suites are typically a site license, allowing the licensee to install and run the software on as many systems within their organization as they wish. SPEC's General License Agreement covers most of the SPEC suites, however the SERT suite which has its own Site License Agreement. Per Clause 1 "Grant" of the SPEC General License Agreement between SPEC and the user, "SPEC agrees to grant and user agrees to accept a nontransferable and nonexclusive license to use and modify the Materials, subject to the restrictions and conditions set forth below and in any accompanying product-specific license." Additionally, per Clause 2 "Copies and Location", the user may make only exact and complete copies. The original and copies thereof may be used only:

• By the user, if purchased by a non-corporate entity. This user must also abide by the Export Assurance (Clause 12) of this license.
• By anyone within the same corporate structure, if purchased by a corporation.

Who qualifies for the educational and non-profit pricing?

Educational discounts are available to an accredited educational institution and the end-user must be a faculty member or a full-time employee of the institution, not a student. Non-profit pricing is available to recognized tax-exempt organizations and government agencies; proof may be requested by SPEC Staff. Individuals do not qualify for the discounted pricing.

What is SPEC's position regarding computer security vulnerabilities, their mitigations, and the impacts of those mitigations?

SPEC's current approach with regard to security mitigations can be found on this page.