SPECsfs97_R1.v3 Result

EMC Corp. :	Celerra NS500 Failover Cluster (one secondary)
SPECsfs97_R1.v3 =	25891 Ops/Sec (Overall Response Time = 2.14 msec)

Performance

Throughput (ops/sec)	Response (msec)
2299	0.8
4657	0.9
6912	1.2
9299	1.5
11644	1.8
13962	2.0
16323	2.3
18739	2.7
21063	3.0
23384	3.7
25891	6.8

Configuration

Server Configuration and Availability
Vendor	EMC Corp.
Hardware Available	September 2004
Software Available	September 2004
Date Tested	July 2004
SFS License Number	47
Licensee Locations	Hopkinton, MA

CPU, Memory and Power

Model Name Celerra NS500 Failover Cluster (one secondary)

Processor 1.6 GHz Intel Xeon P4

# of Processors 2 cores, 2 chips, 1 core/chip with HT Technology enabled

Primary Cache Execution Trace Cache 12K uOPs + Data Cache 8KB

Secondary Cache 512KB (unified)

Other Cache N/A

UPS N/A

Other Hardware N/A

Memory Size 4 GB

NVRAM Size N/A

NVRAM Type N/A

NVRAM Description N/A

Server Software

OS Name and Version DART 5.3

Other Software Linux 2.4.9-34.5306.EMC on Control Station

File System UxFS

NFS version 3

Server Tuning

Buffer Cache Size Dynamic

# NFS Processes 4

Fileset Size 244.6 GB

Network Subsystem
Network Type	Jumbo Gigabit Ethernet
Network Controller Desc.	Gigabit Ethernet Controller
Number Networks	1
Number Network Controllers	2
Protocol Type	TCP

Switch Type Cisco 6513 Gbit Switch (Jumbo)

Bridge Type N/A

Hub Type N/A

Other Network Hardware N/A

Disk Subsystem and Filesystems

Number Disk Controllers 2 on the active Data Mover

Number of Disks 120

Number of Filesystems 1

File System Creation Ops N/A

File System Config striped (8KB element size), across 114 disk (38 LUNs)

Disk Controller Integrated 2Gb Fibre Channel

# of Controller Type 2

Number of Disks 120 (dual ported)

Disk Type Seagate Fibre Channel 146GB 10k-rpm

File Systems on Disks OS and UxFS Log (5), Filesystem fs1 (114), unused (1)

Special Config Notes 2GB cache per SP on storage array. 1475 MB mirrored write cache per SP. See notes below.

Load Generator (LG) Configuration
Number of Load Generators	7
Number of Processes per LG	24
Biod Max Read Setting	5
Biod Max Write Setting	5

LG Type LG1

LG Model Dell 2550

Number and Type Processors 2 x 1.26 GHz Pentium III

Memory Size 2 GB

Operating System Linux 2.4.7-10 smp

Compiler GCC 2.96

Compiler Options -O

Network Type Broadcom Gbit NIC MTU=9000

Testbed Configuration

LG # LG Type Network Target File Systems Notes

1..7 LG1 1 /fs1../fs1 N/A

Testbed Configuration
LG #	LG Type	Network	Target File Systems	Notes
1..7	LG1	1	/fs1../fs1	N/A

Other Notes

Failover is supported by an additional Celerra NS500 Data Mover that operates in
standby mode. In the event of a Data Mover failure, this unit takes over the
function of the failed unit. The standby Data Mover does not contribute to
the performance of the system and is not included in the processor, memory,
or other components listed above.
Server tuning:
param ufs inoBlkHashSize=170669 (inode block hash size)
param ufs inoHashTableSize=1218761 (inode hash table size)
param ufs updateAccTime=0 (disable access-time updates)
param nfs withoutCollector=1 (enable NFS-to-CPU thread affinity)
param file prefetch=0 (disable DART read prefetch)
param mkfsArgs dirType=DIR_COMPAT (Compatability mode directory style)
param kernel maxStrToBeProc=16 (no. of network streams to process at once)
param kernel outerLoop=8 (8 consecutive iterations of network packets processing)
file initialize nodes=980000 dnlc=1056000 (no. of inodes, no. of dirctory name lookup cache entries)
nfs start openfiles=722462 nfsd=4 (no. of open files and 4 NFS daemons)
param ufs nFlushCyl=16 (no. of UxFS cylinder group blocks flush threads)
param ufs nFlushDir=16 (no. of UxFS directory and indirect blocks flush threads)
param ufs nFlushIno=16 (no. of UxFS inode blocks flush threads)
ap msr write=0x880281 (P4 prefetch disable)
Storage array notes:
The storage array was configured into 38 RAID-0 groups of 3 spindles each (114 total disk spindles)
The stripe size for all 38 RAID-0 LUNs was 8KB and each LUN was 30GB.
The filesystem is built on a volume made by striping across all 38 LUNs
on the CX500 storage array with an 8KB stripe size.
The default UFS log of 64MB was used. The UFS log and OS shared the same 4+1 RAID-5 group.
The storage array has dual storage processor units that work as
an active-active failover pair. The mirrored write cache is backed up
with a battery unit capable of saving the write cache to disk in the event of
a power failure. In the event of a storage array failure, the second
storage processor unit is capable of saving all state that was managed
by the first (and vise-versa), even with a simultaneous power failure.
When one of the storage processors or battery units are off-line, the
system turns off the write cache and writes directly to disk before
acknowledging any write operations.
The length of time the battery can support the retention of data is 2
minutes - that is sufficient to write all necessary data twice.
Storage processor A could have written 99% of its memory to disk and
then fail. In that case storage processor B has enough battery to
store its copy of A's data as well as its own.

First published at SPEC.org on 31-Aug-2004

LG Type	LG1
LG Model	Dell 2550
Number and Type Processors	2 x 1.26 GHz Pentium III
Memory Size	2 GB
Operating System	Linux 2.4.7-10 smp
Compiler	GCC 2.96
Compiler Options	-O
Network Type	Broadcom Gbit NIC MTU=9000