SPECsfs2008_nfs.v3 Result

Throughput (ops/sec) Response (msec) 11795 1.4 23625 1.3 35436 1.5 47284 1.6 59136 1.8 71013 1.8 82871 2.2 94584 2.5 106374 3.6 117077 5.0 119243 6.0 119550 6.4

Tested By	Exanet Inc.
Product Name	ExaStore Eight Nodes Clustered NAS System
Hardware Available	April 2008
Software Available	Sep 2008
Date Tested	Aug 2008
SFS License Number	1909
Licensee Locations	Ra'anana, Israel

The ExaStore Eight Node Clustered NAS System is a highly scalable cluster of 8 EX1500 Clustered NAS Servers and associated fibre channel storage. The EX1500 is the basic building block of an ExaStore Clustered NAS system. These systems can contain 2, 4, 6, 8, or more EX1500 File Servers along with over a petabyte of storage, all presented to users and administrators as a single file system. An Exanet Clustered NAS System is the ideal choice for environments requiring scalable capacity or performance in an easy to administer system.

Item No	Qty	Type	Vendor	Model/Name	Description
1	8	Server	Exanet	EX1500	Exanet EX1500 Clustered NAS Server
2	8	NIC	Exanet	NC020	Chelsio 10Gb dual port (CX4)
3	8	NIC	Exanet	NC017	Intel PRO/1000 PT Quad Port PCIe Low Profile Server Adaptor
4	16	HBA	Exanet	SA030	Emulex LPe1102 4Gb Fibre Channel Dual Host Bus Adaptor PCI-e
5	2	Ethernet Switch	Exanet	MG007	Linksys 24 port 10/100 Ethernet switch (Managment Network)
6	2	10Gb Ethernet Switch	Exanet	IC035	Fujitsu XG700 10Gbe CX4 Copper Switch 12 Port
7	8	UPS	Exanet	PW009	APC Smart-UPS 1500VA USB & Serial RM 2U
8	16	Storage Controller	Exanet	DX12	Exanet DX12 12-Bay 4G FC to SAS/SATA (3G) High-Performance Dual RAID Controller 3.5" (2U) Rackmount
9	32	Storage Expansion	Exanet	DX12 EXP	Expansion Bay for Exanet DX12 12 Bay SAS to SAS/SATA 2U Rackmount RAID Expansion system with Dual disk IO module
10	576	Disk	Exanet	DX12 146GB-15K	146G Seagate X15-5 SAS disk drive in carrier

OS Name and Version	ExaStore v3.5.500
Other Software	N/A
Filesystem Software	ExaFS

Name	Value	Description
Default parameters	None	The system was tested using the default parameters

Server Tuning Notes

ExaStore system default configuration was used

Description	Number of Disks	Usable Size
Mirrored boot disks 2 73GB HDDs per node for system use only	16	584.0 GB
36 Disks per DX12 RAID unit, bound into 6 5+1 RAID5 LUNs, all 96 LUNs assembled into a single file system	576	63.0 TB
Total	592	63.5 TB

Number of Filesystems	1
Total Exported Capacity	64483 GB
Filesystem Type	ExaFS
Filesystem Creation Options	default
Filesystem Config	ExaFS default single clustered file system utilizing all 96 LUNs, served on all 8 nodes
Fileset Size	14530.4 GB

Item No	Network Type	Number of Ports Used	Notes
1	Gigabit Ethernet (Client Network)	32	Each node uses 4 Gigabit Ethernet ports towards the Client network
2	10 Gigabit Ethernet	16	Each node uses two 10 Gigabit Ethernet ports for the dual 10 Gigabit interconnect network

Network Configuration Notes

Client network connected to two 48 port stacked Gigabit switches. Two 10 Gigabit switches were used for the inteconnect network

All clients and system nodes are connected to a flat network using the same subnet

Item No	Qty	Type	Description	Processing Function
1	16	CPU	Intel Quad-Core Xeon Processor E5405 80W 2.0GHz/1333MHz/12MB L2	ExaStore, ExaFS, NFS, TCP/IP

Processing Element Notes

None

Description	Size in GB	Number of Instances	Total GB	Nonvolatile
Server memory protected indefinitely using mirroring to pair node each node protected by UPS allowing dump to local disk in case of power failure	24	8	192	NV
Storage controller memory protected by battery for 72 hours	2	16	32	NV
Grand Total Memory Gigabytes			224

Memory Notes

The RAID unit mirrored write cache is backed up with a battery unit able to retain the write cache for 72 hours in the event of a power failure. Server memory is protected using UPS and mirroring to pair node.

All memory in the ExaStore was used by the system for general-purpose memory and dynamically sized data cache.There is an integral UPS for each ExaStore node, which guarantees sufficient power in the event of power failure to dump the write cache to its local on-server RAID. In case of unsafe situations (e.g. low battery condition), the system uses a journal mechanism to synchronously log all write-type operations to the DX12 Storage System which are connected to all nodes. When power is restored, the ExaStore system is able to recover all committed data and metadata operations from journal files or dump files accordingly

Default configuration

Item No	Qty	Vendor	Model/Name	Description
1	16	IBM	X3650 Server	IBM X3650 Server (2*E5405 QuadCore, 8GB RAM - 2*73GB HDD)
2	16	Intel	Quad NIC	Intel PRO/1000 PT Quad Port PCIe Low Profile Server Adapter
3	2	Nortel	5510	Nortel 5510 48 ports Gigabit Ethernet switch

LG Type Name	LG
BOM Item #	1
Processor Name	Intel Quad-Core Xeon Processor E5405 80W 2.0GHz/1333MHz/12MB L2
Processor Speed	2.0GHz
Number of Processors (chips)	2
Number of Cores/Chip	4
Memory Size	8 GB
Operating System	CentOS 4.4
Network Type	1 NIC Gigabit Ethernet

Benchmark Parameters

Network Attached Storage Type	NFS V3
Number of Load Generators	16
Number of Processes per LG	64
Biod Max Read Setting	2
Biod Max Write Setting	2
Block Size	AUTO

Testbed Configuration

LG No	LG Type	Network	Target Filesystems	Notes
1..16	LG	Client Network	ExaFS	16 LGs accessing ExaFS (single file system) via the 10.64.0.0/12 network

Load Generator Configuration Notes

None

Every client mounts the same file system from the ExaStore cluster

None

None

• Config Diagram