SPECjvm® 2008

The SPECjvm® 2008 benchmark is a suite for measuring the performance of a Java Runtime Environment (JRE). It contains several real-life applications and benchmarks focusing on core java functionality. It is SPEC's first Java Virtual Machine benchmark which focuses on the performance of the JRE executing a single application; it reflects the performance of the hardware processor and memory subsystem but has low dependence on file I/O and includes no network I/O across machines.

This is the first freely available SPEC/OSG Java benchmark. By downloading it, you acknowledge that you have read, understand, and agree to abide by the terms of the SPEC General License Agreement.

The SPECjvm 2008 benchmark workload mimics a variety of common general purpose application computations. These characteristics reflect the intent that this benchmark will be applicable to measuring basic Java performance on a wide variety of both client and server systems.

SPEC also finds user experience of Java important, and the suite therefore includes startup benchmarks and has a required run category called base, which must be run without any tuning of the JVM to improve the out of the box performance.

Benchmark Highlights

• Leverages real life applications (like derby, sunflow, and javac) and area-focused benchmarks (like xml, serialization, crypto, and scimark).
• Also measures the performance of the operating system and hardware in the context of executing the JRE.

Results

Submitted Results – Text and HTML outputs for the SPECjvm2008 benchmark metrics; includes all of the results submitted to SPEC from licensees of the benchmark.

Flag Descriptions – Further documentation about tunings used for a published result which are not included in the result's notes section may be found here.

Documentation

The software documentation is available both here and in the SPECjvm2008 benchmark download package:

• FAQ (Last updated: April 14, 2008)
• User's Guide (Last updated: April 16, 2008)
• Run and Reporting Rules (Last updated: July 30, 2014)

Issues Building/Running the SPECjvm2008 Benchmark – Installation, build, and runtime issues raised by users.

Press Material

• SPEC releases free SPECjvm2008 benchmark (May 07, 2008)

Contributors

Thanks to the contributors who offered code and/or assistance with workload development during the development of the SPECjvm2008 benchmark.

Future Benchmark Workload Development
Call For Participation:

If you are a developer of a JRE or a Virtual Machine, this is your opportunity to help shape the standardized testing of your competitors! Contact SPEC at info@spec.org for information about membership in SPEC and participation in benchmark development.