Supermicro SuperServer SYS-521C-NR 203534 SPECjbb2015-MultiJVM max-jOPS
112446 SPECjbb2015-MultiJVM critical-jOPS
Tested by: Supermicro Test Sponsor: Supermicro Test location: San Jose, California Test date: Jan 15, 2024
SPEC license #: 001176 Hardware Availability: Dec-2023 Software Availability: Dec-2023 Publication: Fri Feb 16 13:52:30 EST 2024
Benchmark Results Summary
 
Overall Throughput RT curve
Overall SUT (System Under Test) Description
VendorSupermicro
Vendor URLhttps://www.supermicro.com
System SourceSingle Supplier
System DesignationServer Rack
Total Systems1
All SUT Systems IdenticalYES
Total Nodes1
All Nodes IdenticalYES
Nodes Per System1
Total Chips1
Total Cores48
Total Threads96
Total Memory Amount (GB)512
Total OS Images1
SW EnvironmentNon-virtual
 
Hardware hw_1
NameSuperServer SYS-521C-NR
VendorSupermicro
Vendor URLhttps://www.supermicro.com
AvailableDec-2023
ModelX13SEDW-F
Form Factor1U
CPU NameIntel Xeon Platinum 8558U
CPU Characteristics48 Core, 2.0GHz, 260 MB L3 Cache (Turbo Boost Technology up to 4.00 GHz)
Number of Systems1
Nodes Per System1
Chips Per System1
Cores Per System48
Cores Per Chip48
Threads Per System96
Threads Per Core2
Version2.1 12/06/2023
CPU Frequency (MHz)2000
Primary Cache32 KB(I) + 48 KB(D) per core
Secondary Cache2 MB (I+D) per core
Tertiary Cache260 MB (I+D) on chip per chip
Other CacheNone
Disk1 x 480 GB M.2 NVMe SSD
File Systemxfs
Memory Amount (GB)512
# and size of DIMM(s)8 x 64 GB
Memory Details64 GB 2Rx4 PC5-4800B-R
# and type of Network Interface Cards (NICs)2 x 10 Gbit NICs
Power Supply Quantity and Rating (W)1 x 1200W
Other HardwareNone
Cabinet/Housing/EnclosureNone
Shared DescriptionNone
Shared CommentNone
Notes
  • NA: The test sponsor attests, as of date of publication, that CVE-2017-5754 (Meltdown) is mitigated in the system as tested and documented.
  • Yes: The test sponsor attests, as of date of publication, that CVE-2017-5753 (Spectre variant 1) is mitigated in the system as tested and documented.
  • Yes: The test sponsor attests, as of date of publication, that CVE-2017-5715 (Spectre variant 2) is mitigated in the system as tested and documented.
Other Hardware network_1
NameNone
VendorNone
Vendor URLNone
VersionNone
AvailableNone
BitnessNone
NotesNone
Operating System os_1
NameSUSE Linux Enterprise Server 15 SP4
VendorSUSE
Vendor URLhttps://www.suse.com/
Version5.14.21-150400.22-default
AvailableJun-2022
Bitness64
NotesNone
Java Virtual Machine jvm_1
NameOracle Java SE 17.0.9
VendorOracle
Vendor URLhttp://www.oracle.com/
VersionJava HotSpot 64-bit Server VM, version 17.0.9
AvailableOct-2023
Bitness64
Notesnote
Other Software other_1
NameNone
VendorNone
Vendor URLNone
VersionNone
AvailableNone
BitnessNone
NotesNone
Hardware
OS Images os_Image_1(1)
Hardware Description hw_1
Number of Systems 1
SW Environment non-virtual
Tuning

BIOS Settings:

  • Intel HT Technology=Enable
  • Turbo Mode=Enable
  • SNC=SNC2 Enable
  • Power Technology=Custom
  • Power Performance Tuning=BIOS Controls EPB
  • ENERGY_PERF_BIAS_CFG mode=Maximum Performance

Notes None
OS Image os_Image_1
JVM Instances jvm_Ctr_1(1), jvm_Backend_1(4), jvm_TxInjector_1(4)
OS Image Description os_1
Tuning

  • tuned-adm profile throughput-performance

  • ulimit -n 1024000
  • echo 10000 > /proc/sys/kernel/sched_cfs_bandwidth_slice_us
  • echo 0 > /proc/sys/kernel/sched_child_runs_first
  • echo 56000000 > /sys/kernel/debug/sched/latency_ns
  • echo 1000 > /sys/kernel/debug/sched/migration_cost_ns
  • echo 16000000 > /sys/kernel/debug/sched/min_granularity_ns
  • echo 9 > /sys/kernel/debug/sched/nr_migrate
  • echo 100 > /proc/sys/kernel/sched_rr_timeslice_ms
  • echo 1000000 > /proc/sys/kernel/sched_rt_period_us
  • echo 990000 > /proc/sys/kernel/sched_rt_runtime_us
  • echo 0 > /proc/sys/kernel/sched_schedstats
  • echo 1 > /sys/kernel/debug/sched/tunable_scaling
  • echo 50000000 > /sys/kernel/debug/sched/wakeup_granularity_ns
  • echo 3000 > /proc/sys/vm/dirty_expire_centisecs
  • echo 500 > /proc/sys/vm/dirty_writeback_centisecs
  • echo 40 > /proc/sys/vm/dirty_ratio
  • echo 10 > /proc/sys/vm/dirty_background_ratio
  • echo 10 > /proc/sys/vm/swappiness
  • echo 0 > /proc/sys/kernel/numa_balancing
  • echo always > /sys/kernel/mm/transparent_hugepage/defrag
  • echo always > /sys/kernel/mm/transparent_hugepage/enabled
  • ulimit -v 800000000
  • ulimit -m 800000000
  • ulimit -l 800000000
  • echo 300 > /sys/kernel/mm/hugepages/hugepages-1048576kB/nr_hugepages
  • echo 8000 > /sys/kernel/mm/hugepages/hugepages-2048kb/nr_hugepages
  • systemctl stop systemed-update-utmp-runlevel.service
  • echo 274877906944 > /proc/sys/kernel/shmmax
  • echo 274877906944 > /proc/sys/kernel/shmall

Notes None
JVM Instance jvm_Ctr_1
Parts of Benchmark Controller
JVM Instance Description jvm_1
Command Line

-server -Xms2g -Xmx2g -Xmn1536m -XX:+UseLargePages -XX:LargePageSizeInBytes=1G -XX:+UseParallelGC -XX:ParallelGCThreads=2

Tuning

Used numactl to interleave memory on all CPUs

  • numactl --interleave=all

Notes None
JVM Instance jvm_Backend_1
Parts of Benchmark Backend
JVM Instance Description jvm_1
Command Line

-XX:+UseParallelGC -XX:+UseLargePages -XX:+AlwaysPreTouch -XX:-UseAdaptiveSizePolicy -XX:MaxTenuringThreshold=15 -XX:InlineSmallCode=10k -verbose:gc -XX:-UseCountedLoopSafepoints -XX:LoopUnrollLimit=20 -server -XX:TargetSurvivorRatio=95 -XX:SurvivorRatio=28 -XX:LargePageSizeInBytes=1G -XX:MaxGCPauseMillis=500 -XX:AdaptiveSizeMajorGCDecayTimeScale=12 -XX:AdaptiveSizeDecrementScaleFactor=2 -XX:AllocatePrefetchLines=3 -XX:AllocateInstancePrefetchLines=2 -XX:AllocatePrefetchStepSize=128 -XX:AllocatePrefetchDistance=384 -Xms29g -Xmx29g -Xmn27g -XX:UseAVX=0 -XX:ParallelGCThreads=24 -XX:+UseHugeTLBFS

Tuning

Used numactl to affinitize each Backend JVM to physical cores in a NUMA node.

    • Group1: numactl --physcpubind=0-11,48-59 --localalloc
    • Group2:numactl --physcpubind=12-23,60-71 --localalloc
    • Group3:numactl --physcpubind=24-35,72-83 --localalloc
    • Group4:numactl --physcpubind=36-47,84-95 --localalloc

Notes None
JVM Instance jvm_TxInjector_1
Parts of Benchmark TxInjector
JVM Instance Description jvm_1
Command Line

-server -Xms2g -Xmx2g -Xmn1536m -XX:+UseLargePages -XX:LargePageSizeInBytes=1G -XX:+UseParallelGC -XX:ParallelGCThreads=2

Tuning

Used numactl to affinitize each Injector JVM to physical cores in a NUMA node.

    • Group1: numactl --physcpubind=0-11,48-59 --localalloc
    • Group2:numactl --physcpubind=12-23,60-71 --localalloc
    • Group3:numactl --physcpubind=24-35,72-83 --localalloc
    • Group4:numactl --physcpubind=36-47,84-95 --localalloc

Notes None
max-jOPS = jOPS passed before the First Failure
Pass/Fail Pass Pass Fail Fail Fail
jOPS 201168 203534 205901 208268 210635
critical-jOPS = Geomean ( jOPS @ 10000; 25000; 50000; 75000; 100000; SLAs )
Response time percentile is 99-th
SLA (us) 10000 25000 50000 75000 100000 Geomean
jOPS 76917 91117 119517 138450 155017 112446
  Percentile
  10-th 50-th 90-th 95-th 99-th 100-th
500us 4733 / 7100 2367 / 4733 2367 / 4733 - / 2367 - / 2367 - / 2367
1000us 87567 / 89934 9467 / 11833 7100 / 9467 4733 / 7100 4733 / 7100 - / 2367
5000us 186968 / 189334 170401 / 172768 130167 / 127801 89934 / 92301 44967 / 47334 2367 / 4733
10000us 186968 / 189334 177501 / 179868 144367 / 146734 118334 / 120701 75734 / 78100 7100 / 4733
25000us 189334 / 191701 182234 / 184601 163301 / 165668 153834 / 156201 89934 / 92301 7100 / 4733
50000us 194068 / 196434 184601 / 186968 170401 / 172768 158568 / 160934 118334 / 120701 7100 / 4733
75000us 194068 / 196434 186968 / 189334 175134 / 177501 163301 / 165668 137267 / 139634 59167 / 16567
100000us 194068 / 196434 186968 / 189334 177501 / 179868 170401 / 172768 153834 / 156201 89934 / 16567
200000us 196434 / 198801 194068 / 191701 184601 / 186968 182234 / 184601 177501 / 179868 139634 / 137267
500000us 201168 / 203534 196434 / 198801 194068 / 196434 191701 / 194068 186968 / 189334 182234 / 172768
1000000us 203534 / - 201168 / 203534 198801 / 201168 198801 / 201168 196434 / 198801 191701 / 194068
Probes jOPS / Total jOPS
Request Mix Accuracy
Note
(Actual % in the Mix - Expected % in the Mix) must be within:
'Main Tx' limit of +/-5.0% for the requests whose expected % in the mix is >= 10.0%
'Minor Tx' limit of +/-1.0% for the requests whose expected % in the mix is < 10.0%
There were no non-critical failures in Response Time curve building
Delay between status pings
IR/PR Accuracy
This section lists properties only set by user
Property Name Default Controller
specjbb.comm.connect.client.pool.size 256 256
specjbb.comm.connect.selector.runner.count 0 0
specjbb.comm.connect.timeouts.connect 60000 60000
specjbb.comm.connect.timeouts.read 60000 60000
specjbb.comm.connect.timeouts.write 60000 60000
specjbb.comm.connect.worker.pool.max 256 256
specjbb.comm.connect.worker.pool.min 1 1
specjbb.controller.host localhost localhost
specjbb.controller.port 24000 24000
specjbb.controller.type HBIR_RT HBIR_RT
specjbb.customerDriver.threads 64 {=75, probe=69, saturate=85}
specjbb.forkjoin.workers 96 {Tier1=110, Tier2=5, Tier3=24}
specjbb.group.count 1 4
specjbb.mapreducer.pool.size 96 223
specjbb.txi.pergroup.count 1 1
View table in csv format
 
Level: COMPLIANCE
Check Agent Result
Check properties on compliance All PASSED
 
Level: CORRECTNESS
Check Agent Result
Compare SM and HQ Inventory All PASSED
High-bound (max attempted) is 236668 IR
High-bound (settled) is 213819 IR