SPECstorage(TM) Solution 2020_swbuild Result Nettrix : R620 G40 with 24 NVMe Storage Server SPECstorage Solution = 180 Builds (Overall Response Time = 0.15 msec) 2020_swbuild =============================================================================== Performance =========== Business Average Metric Latency Builds Builds (Builds) (msec) Ops/Sec MB/Sec ------------ ------------ ------------ ------------ 12 0.1 6000 42 24 0.1 12000 85 36 0.1 18000 128 48 0.1 24001 171 60 0.1 30001 214 72 0.1 36001 257 84 0.1 42001 299 96 0.2 48002 342 108 0.2 54002 385 120 0.2 60002 428 132 0.2 66002 471 144 0.2 72003 514 156 0.2 78003 557 168 0.2 84003 599 180 0.3 90004 642 =============================================================================== Product and Test Information ============================ +---------------------------------------------------------------+ | R620 G40 with 24 NVMe Storage Server | +---------------------------------------------------------------+ Tested by Nettrix Hardware Available May 2022 Software Available May 2022 Date Tested Jun 2022 License Number 6138 Licensee Locations Beijing,China The R620 G40 makes full use of computing, storage, and network resources in a limited space. It can flexibly allocate resources according to business needs to achieve excellent cost performance and energy consumption ratio. It is widely applicable to various industries such as the internet, finance, communication, and transportation to meet the needs of different business models. Solution Under Test Bill of Materials ===================================== Item No Qty Type Vendor Model/Name Description ---- ---- ---------- ---------- ---------- ----------------------------------- 1 1 Storage Nettrix R620 G40 The R620 G40 with 24 NVMe Storage Server Server contains 2 x Intel(R) Xeon(R) Platinum 8380 CPU @ 2.30GHz, 32 x 32GB memory, and dual-socket MB, using NFSv4 protocol over a 100GbE network card. The R620 G40 server provides IO/s from 24 filesystems. The R620 G40 server uses a dual- socket processor, 1 x 1.6TB SAS 4.0 SSD, 24 x 7.68TB PCIe Gen4 NVMe SSD. R620 G40 is running RHEL8.3 on SAS 4.0 SSD using NFSv4 and 1 x 100GbE Ethernet network. 2 1 Client Nettrix R620 G40 The R620 G40 with 24 NVMe Storage Server Server contains 2 x Intel(R) Xeon(R) Platinum 8380 CPU @ 2.30GHz, 32 x 32GB memory, and dual-socket MB, using NFSv4 protocol over a 100GbE network card. The R620 G40 server uses a dual-socket processor, 1 x 1.92TB SATA SSD for OS, and 6 x 1.6TB SAS 4.0 SSD for storage. The R620 G40 is running ESXi 7.0.2 OS on SATA SSD using NFSv4 and 1 x 100GbE Ethernet network. The R620 G40 server contains 12 virtual machines, each VM client has 12 vCPUs, 80GB memory, 300GB storage, and a 100GbE network port provided by the SR-IOV function. 3 1 Disk PHISON ESM1720-19 The operation system of client 20G server installs in a SATA SSD (ESM1720-1920G). The capacity of SATA SSD disk is 1.92TB. 4 7 Disk KIOXIA KPM61VUG1T There are a total of 7 SAS 4.0 SSD 60 disks (KPM61VUG1T60), each with a capacity of 1.6TB. 1 x 1.6TB SAS 4.0 SSD disk is installed in storage server for OS. 6 x 1.6TB SAS 4.0 SSD disk are installed in the client server for storage. 5 24 Disk Intel SSDPF2KX07 There are a total of 24 PCIe Gen4 6TZ NVMe SSD disks (SSDPF2KX076TZ) installed in storage server. The capacity of a PCIe Gen4 NVMe SSD disk is 7.68TB. 6 2 Ethernet NVIDIA(Mel ConnectX-6 ConnectX-6 Dx EN adapter card, Card lanox) Dx 100GbE 100GbE, OCP3.0, With Host Dual-port management, Dual-port QSFP56, No QSFP56 Crypto, Thumbscrew (Pull Tab) Bracket (Part Number MCX623436AN- CDAB). 1 of 2 is installed in the storage server, 2 of 2 is installed in the client server. 7 2 Ethernet BITLAND I350 1G The four 10/100/1000 copper ports Card RJ45 with RJ45 connectors (Part Number 4-Ports EGI4-I350-US) are installed for PCIe NIC management. 1 of 2 is installed in the storage server, 2 of 2 is installed in the client server. Configuration Diagrams ====================== 1) storage2020-20220623-00035.config1.pdf (see SPECstorage Solution 2020 results webpage) Component Software ================== Item Name and No Component Type Version Description ---- ------------ ------------ ------------ ----------------------------------- 1 Storage Linux RHEL 8.3 Storage Server Operating System. Server 2 Client ESXi Server ESXi 7.0.2 The client OS version is VMware Server ESXi 7.0.2 build-17630552. 3 VM Clients Linux RHEL 8.3 The client server is configured with about 12 VM clients that are running RHEL 8.3 OS. Hardware Configuration and Tuning - Physical ============================================ +----------------------------------------------------------------------+ | Storage Server | +----------------------------------------------------------------------+ Parameter Name Value Description --------------- --------------- ---------------------------------------- MTU 9000 Network Jumbo Frames. +----------------------------------------------------------------------+ | Client Server | +----------------------------------------------------------------------+ Parameter Name Value Description --------------- --------------- ---------------------------------------- Hyper-Threading Enabled The value of Hyper-Threading [ALL] is [ALL] set to enabled. The client server has double core numbers (160 cores). SR-IOV Enabled Network card's SR-IOV function is set to enabled. +----------------------------------------------------------------------+ | VM Clients | +----------------------------------------------------------------------+ Parameter Name Value Description --------------- --------------- ---------------------------------------- MTU 9000 Network Jumbo Frames. Hardware Configuration and Tuning Notes --------------------------------------- The System Under Test has 100GbE Ethernet port set to MTU 9000. Software Configuration and Tuning - Physical ============================================ +----------------------------------------------------------------------+ | Client Server | +----------------------------------------------------------------------+ Parameter Name Value Description --------------- --------------- ---------------------------------------- vers 4 NFS mount option set to version 4. rsize, wsize 1048576 NFS mount option for the read and write buffer size. The read and write buffer size is changed in 12 VM clients. Software Configuration and Tuning Notes --------------------------------------- Setting the NFS mount option for the read and write buffer size to 1048576 bytes. 12 VM clients have a 100GbE Ethernet port provided by the SR-IOV function. Service SLA Notes ----------------- None. Storage and Filesystems ======================= Item Stable No Description Data Protection Storage Qty ---- ------------------------------------- ------------------ -------- ----- 1 1 x 1.6T SAS 4.0 SSD disk is None Yes 7 installed in storage server for OS. 6 x 1.6T SAS 4.0 SSD disk are installed in the client server for VM storage. 2 1 x 1.92T SATA SSD disk is installed None Yes 1 in the client server for VM OS. 3 24 x 7.68TB PCIe Gen4 NVMe SSD disk None Yes 24 for storage server IOs. Number of Filesystems 24 Total Capacity 184.32 TiB Filesystem Type xfs Filesystem Creation Notes ------------------------- The filesystems are created with default options. Each filesystem is created by a 7.68TB PCIe Gen4 NVMe SSD disk. The 24 PCIe Gen4 NVMe SSD disks in storage server are directly connected to PCI with no controller. Storage and Filesystem Notes ---------------------------- The 184.32TiB capacity is equally allocated across all 24 filesystems. Transport Configuration - Physical ================================== Item Number of No Transport Type Ports Used Notes ---- --------------- ---------- ----------------------------------------------- 1 100GbE network 2 One port of dual-port 100GbE network card in the storage server is directly connected with one port of dual-port 100GbE network card in the client server Transport Configuration Notes ----------------------------- None. Switches - Physical =================== Total Used Item Port Port No Switch Name Switch Type Count Count Notes ---- -------------------- --------------- ------ ----- ------------------------ 1 N/A N/A N/A N/A N/A Processing Elements - Physical ============================== Item No Qty Type Location Description Processing Function ---- ---- -------- -------------- ------------------------- ------------------- 1 2 CPU Storage Server Intel(R) Xeon(R) Platinum Storage Server 8380 CPU @ 2.30GHz 40C, Hyper-Threading [ALL] enabled (total 160 cores) 2 2 CPU Client Server Intel(R) Xeon(R) Platinum Client Server 8380 CPU @ 2.30GHz 40C, Hyper-Threading [ALL] enabled (total 160 cores) Processing Element Notes ------------------------ The CPU model of the client server is the same as the storage server. The Hyper-Threading [ALL] is enabled. There are 12 VM clients under the client server, every VM client has 12 vCPU. Memory - Physical ================= Size in Number of Description GiB Instances Nonvolatile Total GiB ------------------------- ---------- ---------- ------------ ------------ System memory in the 1024 1 V 1024 storage server System memory in the 1024 1 V 1024 client server Grand Total Memory Gibibytes 2048 Memory Notes ------------ None. Stable Storage ============== The storage server does not use a write cache to store data so that writes are committed to the disk immediately. The entire SUT is protected by redundant power supplies, both storage server and client server. Solution Under Test Configuration Notes ======================================= In client server, there are 12 VM clients. Each VM client contains 12 vCPUs, 80GB memory, 300GB disk, a 100GbE network port provided by the SR-IOV function, a management port provided by I350 1G RJ45 4-Ports PCIe NIC. In storage server, the 24 PCIe Gen4 NVMe SSD disks are directly connected to PCI with no controller. There are 24 filesystems, each NVMe disk creates a filesystem. There are using a 100GbE network port provided by ConnectX-6 Dx 100GbE Dual-port QSFP56 and a management port provided by I350 1G RJ45 4-Ports PCIe NIC. Other Solution Notes ==================== None. Dataflow ======== One 100GbE network port in the storage server is directly connected with one 100GbE network port in the client server. The 24 filesystems are created and shared from the storage server to 12 VM clients in the client server. The 24 filesystems (nvme0n1 nvme1n1 ... nvme23n1) are mounted to 12 VM clients (test1 test2 ... test12). Other Notes =========== None. Other Report Notes ================== None of the components used to perform the test were patched with Spectre or Meltdown patches (CVE-2017-5754, CVE-2017-5753, CVE-2017-5715). =============================================================================== Generated on Thu Jun 30 22:36:53 2022 by SpecReport Copyright (C) 2016-2022 Standard Performance Evaluation Corporation