SPEC SFS® 2014 (Retired: Dec. 2021)
The SPEC SFS® 2014 benchmark suite measures file server throughput and response time, providing a standardized method for comparing performance across different vendor platforms. The suite is the successor to the SFS® 2008 benchmark, but has been completely rewritten to shift focus from measuring performance at the component level to measuring an end-to-end storage solution for specific applications.
The SPECstorage™ Solution 2020 benchmark is the newest version of the suite measuring file server throughput and response time.
SPEC SFS 2014 Retirement Plans
With the release of the SPECstorage™ Solution 2020 benchmark suite, the SPEC SFS 2014 benchmark suite will be retired. The retirement plan is as follows:
- Through Dec 31, 2021, 3 AM US Eastern Time, SPEC SFS 2014 results can be submitted to SPEC independently.
- Submissions of the SPECstorage Solution 2020 results are accepted now, though not mandatory during the overlapping period of SPEC SFS 2014 benchmark retirement. After the retirement of the SPEC SFS 2014 benchmark, all new submissions will only be accepted using the SPECstorage Solution 2020 benchmark suite.
New Features:
- The migration from a component-level benchmark to a complete solution benchmark that measures performance of the entire storage configuration as it interacts with application-based workloads.
- An upgrade from one general-purpose workload to four different workloads representing specific application areas. Workloads now measure the number of simultaneous builds that can be done, the number of video streams that can be captured, the number of simultaneous databases that can be sustained, and the number of virtual desktops that can be maintained.
- Protocol independence, enabling the benchmark to run over any version of NFS or SMB/CIFS and on any clustered, object-oriented, local or other POSIX-compatible file system.
- A new methodology that permits vendors to demonstrate their unique storage accelerators.
- A new facility that allows users to create their own customized workloads for measuring storage system performance.
Dec. 20, 2017: The SPEC SFS® 2014 SP2 benchmark available: This update includes a new workload for the electronic design automation (EDA) market, along with an increase in load-generation scaling, reduced startup time, and enhancements to custom workload generation capabilities. For further details on what's changed, see ""What's new in SPEC SFS 2014 SP2?" Existing licensees of earlier versions of the benchmark are eligible for a free upgrade. Starting January 18, 2018, all result submissions must be made using SP2.
Nov. 19, 2015: The SPEC SFS® 2014 SP1 benchmark available: This update fixes a possible sensitivity to systems that have inline compression enabled and incorporates all errata fixes since the initial release. As of October 20, 2015, all result submissions must be made with the SP1 version of the benchmark.
Results
- Submitted Results
- Includes all of the results submitted for publication to SPEC from licensees of the benchmark. Note: these results are not comparable to results from earlier versions of the SPEC SFS® benchmarks (SFS® 2008, SFS® 97_R1, SFS® 97, LADDIS), and the SFS2014_database, SFS2014_eda, SFS2014_swbuild, SFS2014_vda, and SFS2014_vdi metrics are not comparable to each other due to differences in the workloads.
Benchmark Documentation
- User's Guide: PDF, DOCX
- Run and Reporting Rules: PDF, DOCX
- Known Issues/Technical Support (Updated December 19, 2017)
