SPEC SFS®2014_vda Result: DDN - DDN ES400NVX 2014 VDA

DDN	SPEC SFS2014_vda = 7000 Streams
DDN ES400NVX 2014 VDA	Overall Response Time = 1.17 msec

DDN ES400NVX 2014 VDA
Tested by	DDN
Hardware Available	02 21
Software Available	02 21
Date Tested	03 21
License Number	4722
Licensee Locations	Colorado Springs, CO

Simple appliances for the largest data challenges. Whether you are speeding up financial service analytics, running challenging autonomous vehicle workloads, or looking to boost drug development pipelines, the ES400NVX all flash appliance is a powerful building block for application acceleration. Unlike traditional enterprise storage, DDN EXAScaler solutions offer efficient performance from a parallel filesystem to deliver an optimized data path designed to scale. Building on over a decade of experience deploying storage solutions in the most demanding environments around the world, DDN delivers unparalleled performance, capability and flexibility for users looking to manage and gain insights from massive amounts of data.

Solution Under Test Bill of Materials

Item No	Qty	Type	Vendor	Model/Name	Description
1	3	Scalable 2U NVMe Appliance	DDN	DDN ES400NVX	Dual Intel(R) Xeon(R) Gold 6230 CPU @ 2.10GHz
2	24	Network Adapter	NVIDIA(Mellanox)	MCX653106A-ECAT,ConnectX-6 VPI	For HDR100 connection from the EXAScaler Servers/OSS/MDS to the QM8700 Switch.
3	2	Network Switch	NVIDIA (Mellanox)	QM8700	40 Port HDR200 NETWORK Switch
4	16	EXAScaler Clients	SuperMicro	SYS-1028TP-DC0R	Dual Intel Xeon(R) CPU E5-2650 v2 @ 2.60GHz, 128GB memory
5	16	Network Adapter	NVIDIA (Mellanox)	MCX653106A-ECAT,ConnectX-6 VPI	For HDR100 connection from the EXSCaler Clients
6	72	NVMe Drives	Samsung	MZWLL3T2HAJQ-00005	3.2TB Samsung NVMe Drives for Storage and Lustre Filesystem
7	16	10000rpm Sas-12gbps	Toshiba	AL14SEB030N	300GB Toshiba Drives for Client Nodes OS Boot

Configuration Diagrams

Component Software

Item No	Component	Type	Name and Version	Description
1	Storage Appliance Software	DDN SFAOS	11.8.3	Storage Operating System designed for scalable performance
2	EXAScaler Parallel Filesystem Software	Parallel Filesystem Software	5.2.1	Distributed/Parallel File system software that runs on Embedded/Physical Servers
3	CentOS	Linux OS	CentOS 8.1	64-bit Operating system for the Client Nodes
4	EXAScaler Client Software	Parallel Filesystem Client Node Software	lustre-client-2.12.6_ddn3-1.el8.x86_64	Distributed/Parallel File system software that runs on Client/Compute Nodes

Hardware Configuration and Tuning - Physical

Software Configuration and Tuning - Physical

EXAScaler Component Tunings
Parameter Name	Value	Description
osd-ldiskfs..writethrough_cache_enable,osd-ldiskfs..read_cache_enable	0	Disables writethrough cache and read cache on the OSSs/OSTs
osc.*.max_pages_per_rpc	1m	maximum number of pages per RPC
osc.*.max_rpcs_in_flight	8	maximum number of rpcs in flight
osc.*.max_dirty_mb	1024	maximum amount of outstanding dirty data
llite.*.max_read_ahead_mb	2048	maximum amount of cache reserved for readahead cache
osc.*.checksums	0	Disables network/wire checksums

Software Configuration and Tuning Notes

All of the tunings applied have been mentioned in the previous section

Service SLA Notes

None

Storage and Filesystems

Item No	Description	Data Protection	Stable Storage	Qty
1	24 NVME drives in a single DCR pool per ES400NVX appliance.54.33 TiB per ES400NVX set aside for data for a total of 163TiB for data with 3xES400NVX appliance. Data and Metadata in the same pool.	DCR Raid6 [8+2p]	Yes	72
2	24 NVME drives in a single DCR pool per ES400NVX appliance.1TiB per ES400NVX set aside for metadata for a total of 3TiB for metadata with 3xES400NVX appliance.Data and Metadata in the same pool	DCR Raid6 [8+2p]	Yes	72
3	16 in total for the client OS Boot	None	No	16

Number of Filesystems	1
Total Capacity	163TiB
Filesystem Type	EXAScaler File System

Filesystem Creation Notes

8 Virtual Disks/Raid Objects for OST usage and 4 Virtual Disks/Raid Objects for MDT usage were created from a single DCR pool consisting of 24 NVMEs drives per ES400NVX appliances. Complete solution consisted of 24 OSTs and 12 MDTs.

Storage and Filesystem Notes

Declustered RAID (DCR) is a RAID system in which physical disks (PD) are logically broken into smaller pieces known as physical disk extents (PDE). A RAIDset is allocated from the PDEs across a large number of drvies in a random fashion so as to distribute the RAIDset across as many physical drives as possible. Configurable RAID Group Sizes feature allows users to configure the system with the desired RAID[in our case 10disks/raid6 group] and redundancy levels based on data requirements. Each RAID group is configured independently and users can select any valid combination of the number of disks for the respective RAID group.

Transport Configuration - Physical

Switches - Physical

Processing Elements - Physical

Processing Elements - Virtual

Memory - Physical

Item No	Transport Type	Number of Ports Used	Notes
1	100Gb/S HDR100	24	LNETs[Lustre Network Communication Protocol] for EXAScaler MDS/OSS
2	100Gb/S HDR100	16	LNETs for EXAScaler Clients
3	100Gb/S HDR100	8	ISL between Switches

Item No	Switch Name	Switch Type	Total Port Count	Used Port Count	Notes
1	QM8700	HDR200/HDR100	40	16	EXAScaler Clients
2	QM8700	HDR200/HDR100	40	24	EXAScaler MDS/OSS

Item No	Qty	Type	Location	Description	Processing Function
1	6	CPU	ES400NVX	Dual Intel(R) Xeon(R) Gold 6230 CPU @ 2.10GHz	Storage Platform
2	16	CPU	Clients	Dual Intel(R) Xeon(R) CPU E5-2660 v4 @ 2.00GHz	EXAScaler Client Nodes

Item No	Qty	Type	Location	Description	Processing Function
1	120	Virtual Cores	EXASCaler VMs/OSS	Virtual Cores from ES400NVX assigned to EXASCaler MDS/OSS	EXAScaler MDS/OSS

Description	Size in GiB	Number of Instances	Nonvolatile	Total GiB
Memory for ES400NVX SFAOS and cache	90	6	NV
Memory set aside for each ES400NVX VMs which act as EXAScaler Filesystem OSS/MDS	150	12	V
Memory per EXAScaler Client Nodes	128	16	V
Grand Total Memory Gibibytes				4388

Memory Notes

150GiB of memory are assigned to each of the VMs in the ES400NVX platform. These VMs function as OSS/MDS within the exascaler filesystem.

Stable Storage

SFAOS DCR[declustered raid] utilizes large number of drives within a single configuration for fast rebuild time, spreading the load across multiple drives. SFAOS also has the capability of utilizing DCR for setting aside drives for extra redundancy on top of the raid architecture. Other features includes redundant power supply, battery backups,partial rebuilds, dual active-active controller and online upgrades of drives, SFAOS and BIOS, etc. SFAOS features also provide transfer of ownership including raid devices between the controllers as well as the VMs within the SFA Platform and the EXAScaler Filesystem.

Solution Under Test Configuration Notes

The SUT Configuration utilized DDNs fastest NVME storage offering, the ES400NVX, combined with EXAScaler Parallel filesystem. 4 VMS residing in each ES400NVX[12 in total] acted as both Metadata Servers and Object Storage servers, and utilized 24 NVME drives[72 in total] for the creation of Medatata Targets[MDTs] and Object Storage Targets[OSTs] and the EXAScaler Filesystem. 16 physical servers acted as client Nodes, participating in the SPEC SFS benchmark.

CPU Performance Setting
Parameter Name	Value	Description
Scaling Governor	Performance	Runs the CPU at the Maximum Frequency

SPEC SFS®2014_vda Result

Performance

Product and Test Information