SPEC SFS(R)2014_vda Result SPEC SFS(R) : SPEC SFS(R) 2014 ITM-33 Reference Solution Subcommittee SPEC SFS2014_vda = 15 Streams (Overall Response Time = 48.79 msec) =============================================================================== Performance =========== Business Average Metric Latency Streams Streams (Streams) (msec) Ops/Sec MB/Sec ------------ ------------ ------------ ------------ 1 25.4 10 4 2 24.0 20 9 3 30.5 30 13 4 36.8 39 18 5 40.2 49 23 6 49.0 59 27 7 48.1 69 32 8 51.1 79 36 9 53.5 89 41 10 56.5 99 46 11 55.8 109 50 12 58.1 119 55 13 68.3 129 59 14 64.5 139 64 15 67.3 149 69 =============================================================================== Product and Test Information ============================ +---------------------------------------------------------------+ | SPEC SFS(R) 2014 ITM-33 Reference Solution | +---------------------------------------------------------------+ Tested by SPEC SFS(R) Subcommittee Hardware Available September 2014 Software Available September 2014 Date Tested September 2014 License Number 0 Licensee Locations Gainesville, VA USA The SPEC SFS(R) 2014 Reference Solution consists of a TDV 2.0 micro-cluster appliance, based on Intel Avoton SoC nodes, connected to an ITM-33 storage cluster using the NFSv3 protocol over an Ethernet network. The ITM-33 cluster, built on proven scale-out storage platform, provides IO/s from a single file system, single volume. The ITM-33 accelerates business and increases speed-to-market by providing scalable, high performance storage for mission critical and highly transactional applications. In addition, the single filesystem, single volume, and linear scalability of the BSD based operating system enables enterprises to scale storage seamlessly with their environment and application while maintaining flat operational expenses. The ITM-33 is based on enterprise-class 2.5" 10,000 RPM Serial Attached SCSI drive technology, 1GbE Ethernet networking, and a high performance Infiniband back-end. The ITM-33 is configured with 4 nodes in a single file system, single volume. Solution Under Test Bill of Materials ===================================== Item No Qty Type Vendor Model/Name Description ---- ---- ---------- ---------- ---------- ----------------------------------- 1 4 Storage Generic ITM-33 4 ITM-33-2U-Dual-24GB-4x1GE-7373GB Cluster nodes configured into a cluster. Node 2 1 Micro- Generic TDV 2.0 An appliance with 32 nodes and an cluster internal network switch. Appliance 3 1 Infiniband Generic 12200-18 An 18 port QDR Infiniband switch. switch 4 1 Ethernet Generic DCS-7150S- A 10 GbE capable network switch. switch 64-CL Configuration Diagrams ====================== 1) sfs2014-20141029-00003.config1.jpg (see SPEC SFS2014 results webpage) Component Software ================== Item Name and No Component Type Version Description ---- ------------ ------------ ------------ ----------------------------------- 1 ITM-33 Operating cluster FS The ITM-33 nodes were running Storage System Version cluster FS 7.0.2.1 Nodes 7.0.2.1 2 Filesystem cluster FS cluster FS cluster FS 7.0.2.1 License Software Version License 7.0.2.1 3 Load Operating CentOS 6.4 The load generator nodes in the TDV Generators System 64-bit 2.0 appliance with 32 nodes running CentOS 6.4 64-bit. Linux kernel 2.6.32-358.el6.x86_64 Hardware Configuration and Tuning - Physical ============================================ +----------------------------------------------------------------------+ | Load generator internal cluster switch | +----------------------------------------------------------------------+ Parameter Name Value Description --------------- --------------- ---------------------------------------- Port speed 2.5 Gb internal switch port speed Hardware Configuration and Tuning Notes --------------------------------------- The port speed on the internal switch for the load generators was set to 2.5Gb. Software Configuration and Tuning - Physical ============================================ +----------------------------------------------------------------------+ | None | +----------------------------------------------------------------------+ Parameter Name Value Description --------------- --------------- ---------------------------------------- n/a n/a n/a Software Configuration and Tuning Notes --------------------------------------- No software tunings were used - default NFS mount options were used. Service SLA Notes ----------------- No opaque services were in use. Storage and Filesystems ======================= Item Stable No Description Data Protection Storage Qty ---- ------------------------------------- ------------------ -------- ----- 1 ITM-33 Storage Nodes: 600GB SAS 10k 16+2/2 Parity Yes 96 RPM Disk Drives protected (default) 2 Load Generator: 80GB SATA SSD None No 32 Number of Filesystems 1(IFS->NFSv3) Total Capacity 26 TiB Filesystem Type IFS->NFSv3 Filesystem Creation Notes ------------------------- The file system was created on the ITM-33 cluster by using all default parameters. The file system on the load generating clients was created at OS install time using default parameters with an ext4 file system. Storage and Filesystem Notes ---------------------------- The storage in the load generating clients did not contribute to the performance of the solution under test, all benchmark data was stored on the IFS file system and accessed via NFSv3. Transport Configuration - Physical ================================== Item Number of No Transport Type Ports Used Notes ---- --------------- ---------- ----------------------------------------------- 1 1 GbE ITM-33 4 ITM-33 front end Ethernet ports, configured Storage Nodes with MTU=1500 2 QDR Infiniband 4 ITM-33 back end Infiniband ports, running at ITM-33 Storage QDR Nodes 3 10 GbE Load 1 Load generator benchmark network Ethernet generator ports, configured with MTU=1500 benchmark network Transport Configuration Notes ----------------------------- All NFSv3 benchmark traffic flowed through the DCS-7150S-64-CL Ethernet switch. All load generator clients were connected to an internal switch in the micro-cluster appliance via 2.5GbE. This internal switch was connected to the 10 GbE switch. The Infiniband network is part of the ITM-33 storage node architecture, and is not configured directly by the user. It carries inter-node cluster traffic. Since it is not configurable by the user it is not included in the switch list. Switches - Physical =================== Total Used Item Port Port No Switch Name Switch Type Count Count Notes ---- -------------------- --------------- ------ ----- ------------------------ 1 DCS-7150S-64-CL 10 GbE Ethernet 52 47 No uplinks used Ethernet Switch load generator to storage interconnect Processing Elements - Physical ============================== Item No Qty Type Location Description Processing Function ---- ---- -------- -------------- ------------------------- ------------------- 1 32 CPU load Intel Atom C2550 2.4GHz load generator generators Quad-core CPU network, nfs client 2 8 CPU ITM-33 storage Intel(R) Xeon(R) CPU ITM-33 Storage node nodes E5-2620 v2 @ 2.4GHz Quad- networking, NFS, core CPU file system, device drivers Processing Element Notes ------------------------ Each ITM-33 storage node has 2 physical processors with 4 cores and SMT enabled. Each load generator had a single physical processor. Memory - Physical ================= Size in Number of Description GiB Instances Nonvolatile Total GiB ------------------------- ---------- ---------- ------------ ------------ ITM-33 Storage Node 24 4 V 96 System Memory ITM-33 Storage Node 0.5 4 NV 2 Integrated NVRAM module with Vault-to-Flash Load generator memory 8 32 V 256 Grand Total Memory Gibibytes 354 Memory Notes ------------ Each storage controller has main memory that is used for the operating system and for caching filesystem data. A separate, integrated battery-backed RAM module is used to provide stable storage for writes that have not yet been written to disk. Stable Storage ============== Each ITM-33 storage cluster node is equipped with an nvram journal that stores writes to the local disks. The nvram has backup power to save data to dedicated on-card flash in the event of power-loss. The load generating clients and all components between them and the storage cluster are not stable storage and are not configured as such, and thus will comply with protocol requirements for stable storage. Solution Under Test Configuration Notes ======================================= The system under test consisted of 4 ITM-33 storage nodes, 2U each, connected by QDR Infiniband. Each storage node was configured with a single 10GbE network interface connected to a 10GbE switch. There were 32 load generating clients, each connected to the same Ethernet switch as the ITM-33 storage nodes. Other Solution Notes ==================== None Dataflow ======== Each load generating client mounted the single file system using NFSv3. Because there were four ITM-33 nodes, the first eight clients mounted the file system from the first ITM-33 node, the next eight clients mounted the file system from the second ITM-33 node, and so on. The order of the clients as used by the benchmark was round-robin distributed such that as the load scaled up, each additional process used the next node in the ITM-33 cluster. This ensured an even distribution of load over the network and among the ITM-33 nodes. Other Notes =========== None Other Report Notes ================== None =============================================================================== Generated on Wed Mar 13 16:54:23 2019 by SpecReport Copyright (C) 2016-2019 Standard Performance Evaluation Corporation