Supermicro SuperServer SYS-741GE-TNRT 289531 SPECjbb2015-MultiJVM max-jOPS
228255 SPECjbb2015-MultiJVM critical-jOPS
Tested by: Supermicro Test Sponsor: Supermicro Test location: San Jose, California Test date: Jan 12, 2024
SPEC license #: 001176 Hardware Availability: Dec-2023 Software Availability: Dec-2023 Publication: Fri Feb 16 13:52:30 EST 2024
Benchmark Results Summary
 
Overall Throughput RT curve
Overall SUT (System Under Test) Description
VendorSupermicro
Vendor URLhttps://www.supermicro.com
System SourceSingle Supplier
System DesignationServer Rack
Total Systems1
All SUT Systems IdenticalYES
Total Nodes1
All Nodes IdenticalYES
Nodes Per System1
Total Chips2
Total Cores64
Total Threads128
Total Memory Amount (GB)1024
Total OS Images1
SW EnvironmentNon-virtual
 
Hardware hw_1
NameSuperServer SYS-741GE-TNRT
VendorSupermicro
Vendor URLhttps://www.supermicro.com
AvailableDec-2023
ModelX13DEG-QT
Form Factor2U
CPU NameIntel Xeon Gold 6548Y+
CPU Characteristics32 Core, 2.50 GHz, 60 MB L3 Cache (Turbo Boost Technology up to 4.10 GHz)
Number of Systems1
Nodes Per System1
Chips Per System2
Cores Per System64
Cores Per Chip32
Threads Per System128
Threads Per Core2
Version2.1 12/12/2023
CPU Frequency (MHz)2500
Primary Cache32 KB(I) + 48 KB(D) per core
Secondary Cache2 MB (I+D) per core
Tertiary Cache60 MB (I+D) on chip per chip
Other CacheNone
Disk1 x 480 GB M.2 NVMe SSD
File Systemxfs
Memory Amount (GB)1024
# and size of DIMM(s)16 x 64 GB
Memory Details64 GB 2Rx4 PC5-5600B-R
# and type of Network Interface Cards (NICs)2 x 10 Gbit NICs
Power Supply Quantity and Rating (W)2 x 2000W
Other HardwareNone
Cabinet/Housing/EnclosureNone
Shared DescriptionNone
Shared CommentNone
Notes
  • NA: The test sponsor attests, as of date of publication, that CVE-2017-5754 (Meltdown) is mitigated in the system as tested and documented.
  • Yes: The test sponsor attests, as of date of publication, that CVE-2017-5753 (Spectre variant 1) is mitigated in the system as tested and documented.
  • Yes: The test sponsor attests, as of date of publication, that CVE-2017-5715 (Spectre variant 2) is mitigated in the system as tested and documented.
Other Hardware network_1
NameNone
VendorNone
Vendor URLNone
VersionNone
AvailableNone
BitnessNone
NotesNone
Operating System os_1
NameUbuntu 22.04.3 LTS server-amd64
VendorUbuntu
Vendor URLhttps://ubuntu.com/
Version5.15.0-89-generic
AvailableAug-2023
Bitness64
NotesNone
Java Virtual Machine jvm_1
NameOracle Java SE 17.0.9
VendorOracle
Vendor URLhttp://www.oracle.com/
VersionJava HotSpot 64-bit Server VM, version 17.0.9
AvailableOct-2023
Bitness64
Notesnote
Other Software other_1
NameNone
VendorNone
Vendor URLNone
VersionNone
AvailableNone
BitnessNone
NotesNone
Hardware
OS Images os_Image_1(1)
Hardware Description hw_1
Number of Systems 1
SW Environment non-virtual
Tuning

BIOS Settings:

  • Intel HT Technology=Enable
  • Turbo Mode=Enable
  • SNC=SNC2 Enable
  • DCU Streamer Prefetche=Enable
  • Power Technology=Custom
  • Power Performance Tuning=BIOS Controls EPB
  • ENERGY_PERF_BIAS_CFG mode=Extreme Performance

Notes None
OS Image os_Image_1
JVM Instances jvm_Ctr_1(1), jvm_Backend_1(4), jvm_TxInjector_1(4)
OS Image Description os_1
Tuning

  • tuned-adm profile throughput-performance

  • ulimit -n 1024000
  • echo 18000000 > /sys/kernel/debug/sched/latency_ns
  • systemctl stop systemd-update-utmp.service
  • echo always > /sys/kernel/mm/transparent_hugepage/defrag
  • echo always > /sys/kernel/mm/transparent_hugepage/enabled
  • echo 18000000 > /sys/kernel/debug/sched/latency_ns
  • echo 180000 > /sys/kernel/debug/sched/min_granularity_ns
  • echo 750 > /sys/kernel/debug/sched/migration_cost_ns
  • echo 1000000 > /sys/kernel/debug/sched/wakeup_granularity_ns
  • echo 12 > /sys/kernel/debug/sched/nr_migrate
  • ulimit -n 1024000
  • ulimit -v 800000000
  • ulimit -m 800000000
  • ulimit -l 800000000

Notes None
JVM Instance jvm_Ctr_1
Parts of Benchmark Controller
JVM Instance Description jvm_1
Command Line

-server -Xms2g -Xmx2g -Xmn1536m -XX:+UseLargePages -XX:LargePageSizeInBytes=2m -XX:+UseParallelGC -XX:ParallelGCThreads=2

Tuning

Used numactl to interleave memory on all CPUs

  • numactl --interleave=all

Notes None
JVM Instance jvm_Backend_1
Parts of Benchmark Backend
JVM Instance Description jvm_1
Command Line

-server -Xms225G -Xmx225G -Xmn220G -XX:+UseLargePages -XX:LargePageSizeInBytes=2m -XX:+UseParallelGC -XX:ParallelGCThreads=32 -XX:+AlwaysPreTouch -XX:-UseAdaptiveSizePolicy -XX:MaxTenuringThreshold=15 -XX:TargetSurvivorRatio=90 -XX:-UsePerfData -Xnoclassgc -XX:SurvivorRatio=34 -XX:InlineSmallCode=25m -XX:InitialCodeCacheSize=11k

Tuning

Used numactl to affinitize one Backend JVM to one NUMA node

    • Group1: numactl --cpunodebind=0 --localalloc
    • Group2:numactl --cpunodebind=1 --localalloc
    • Group3:numactl --cpunodebind=2 --localalloc
    • Group4:numactl --cpunodebind=3 --localalloc

Notes None
JVM Instance jvm_TxInjector_1
Parts of Benchmark TxInjector
JVM Instance Description jvm_1
Command Line

-server -Xms2g -Xmx2g -Xmn1536m -XX:+UseLargePages -XX:LargePageSizeInBytes=2m -XX:+UseParallelGC -XX:ParallelGCThreads=2

Tuning

Used numactl to affinitize one Injector JVM to one NUMA node

    • Group1: numactl --cpunodebind=0 --localalloc
    • Group2:numactl --cpunodebind=1 --localalloc
    • Group3:numactl --cpunodebind=2 --localalloc
    • Group4:numactl --cpunodebind=3 --localalloc

Notes None
max-jOPS = jOPS passed before the First Failure
Pass/Fail Pass Pass Fail Fail Fail
jOPS 286125 289531 292937 296344 299750
critical-jOPS = Geomean ( jOPS @ 10000; 25000; 50000; 75000; 100000; SLAs )
Response time percentile is 99-th
SLA (us) 10000 25000 50000 75000 100000 Geomean
jOPS 151578 243547 253765 257172 257172 228255
  Percentile
  10-th 50-th 90-th 95-th 99-th 100-th
500us 6812 / 10219 3406 / 6812 - / 3406 - / 3406 - / 3406 - / 3406
1000us 218000 / 221406 13625 / 17031 10219 / 13625 6812 / 10219 6812 / 10219 - / 3406
5000us 275906 / 279312 265687 / 269094 122625 / 126031 95375 / 98781 68125 / 71531 34062 / 13625
10000us 275906 / 279312 269094 / 272500 248656 / 252062 204375 / 207781 149875 / 153281 57906 / 13625
25000us 275906 / 279312 269094 / 272500 258875 / 262281 255469 / 258875 245250 / 241844 57906 / 13625
50000us 279312 / 282719 269094 / 272500 262281 / 265687 258875 / 262281 252062 / 255469 57906 / 13625
75000us 282719 / 286125 269094 / 272500 262281 / 265687 258875 / 262281 255469 / 258875 126031 / 23844
100000us 282719 / 286125 269094 / 272500 262281 / 265687 258875 / 262281 255469 / 258875 190750 / 166906
200000us 282719 / 286125 272500 / 275906 269094 / 272500 262281 / 265687 258875 / 262281 252062 / 255469
500000us 286125 / 289531 279312 / 282719 269094 / 272500 269094 / 272500 269094 / 265687 255469 / 258875
1000000us 289531 / - 286125 / 289531 275906 / 279312 275906 / 279312 275906 / 279312 269094 / 272500
Probes jOPS / Total jOPS
Request Mix Accuracy
Note
(Actual % in the Mix - Expected % in the Mix) must be within:
'Main Tx' limit of +/-5.0% for the requests whose expected % in the mix is >= 10.0%
'Minor Tx' limit of +/-1.0% for the requests whose expected % in the mix is < 10.0%
There were no non-critical failures in Response Time curve building
Delay between status pings
IR/PR Accuracy
This section lists properties only set by user
Property Name Default Controller
specjbb.comm.connect.client.pool.size 256 232
specjbb.comm.connect.selector.runner.count 0 1
specjbb.comm.connect.timeouts.connect 60000 600000
specjbb.comm.connect.timeouts.read 60000 600000
specjbb.comm.connect.timeouts.write 60000 600000
specjbb.comm.connect.worker.pool.max 256 81
specjbb.comm.connect.worker.pool.min 1 24
specjbb.controller.host localhost localhost
specjbb.controller.port 24000 24000
specjbb.controller.type HBIR_RT HBIR_RT
specjbb.customerDriver.threads 64 {=75, probe=69, saturate=85}
specjbb.forkjoin.workers 128 {Tier1=110, Tier2=28, Tier3=12}
specjbb.group.count 1 4
specjbb.mapreducer.pool.size 128 223
specjbb.txi.pergroup.count 1 1
View table in csv format
 
Level: COMPLIANCE
Check Agent Result
Check properties on compliance All PASSED
 
Level: CORRECTNESS
Check Agent Result
Compare SM and HQ Inventory All PASSED
High-bound (max attempted) is 340625 IR
High-bound (settled) is 304800 IR