Supermicro SuperServer SYS-222H-TN 505379 SPECjbb2015-MultiJVM max-jOPS
327486 SPECjbb2015-MultiJVM critical-jOPS
Tested by: Supermicro Test Sponsor: Supermicro Test location: San Jose, California Test date: Jul 22, 2024
SPEC license #: 001176 Hardware Availability: Jun-2024 Software Availability: Jun-2024 Publication: Thu Aug 8 11:38:46 EDT 2024
Benchmark Results Summary
 
Overall Throughput RT curve
Overall SUT (System Under Test) Description
VendorSupermicro
Vendor URLhttps://www.supermicro.com
System SourceSingle Supplier
System DesignationServer Rack
Total Systems1
All SUT Systems IdenticalYES
Total Nodes1
All Nodes IdenticalYES
Nodes Per System1
Total Chips2
Total Cores288
Total Threads288
Total Memory Amount (GB)1024
Total OS Images1
SW EnvironmentNon-virtual
 
Hardware hw_1
NameSuperServer SYS-222H-TN
VendorSupermicro
Vendor URLhttps://www.supermicro.com
AvailableJun-2024
ModelX14DBM-SP
Form Factor2U
CPU NameIntel Xeon 6780E
CPU Characteristics144 Core, 2.2GHz, 108 MB L3 Cache (Turbo Boost Technology up to 3.00 GHz)
Number of Systems1
Nodes Per System1
Chips Per System2
Cores Per System288
Cores Per Chip144
Threads Per System288
Threads Per Core1
Version1.0a (06/14/2024)
CPU Frequency (MHz)2200
Primary Cache64 KB(I) + 32 KB(D) per core
Secondary Cache4 MB (I+D) per core
Tertiary Cache108 MB (I+D) on chip per chip
Other CacheNone
Disk1 x 960 GB NVMe SSD
File Systemxfs
Memory Amount (GB)1024
# and size of DIMM(s)16 x 64 GB
Memory Details64 GB 2Rx4 PC5-6400B-R
# and type of Network Interface Cards (NICs)2 x 10 Gbit NICs
Power Supply Quantity and Rating (W)2 x 2000W
Other HardwareNone
Cabinet/Housing/EnclosureNone
Shared DescriptionNone
Shared CommentNone
Notes
  • NA: The test sponsor attests, as of date of publication, that CVE-2017-5754 (Meltdown) is mitigated in the system as tested and documented.
  • Yes: The test sponsor attests, as of date of publication, that CVE-2017-5753 (Spectre variant 1) is mitigated in the system as tested and documented.
  • Yes: The test sponsor attests, as of date of publication, that CVE-2017-5715 (Spectre variant 2) is mitigated in the system as tested and documented.
Other Hardware network_1
NameNone
VendorNone
Vendor URLNone
VersionNone
AvailableNone
BitnessNone
NotesNone
Operating System os_1
NameRed Hat Enterprise Linux 9.2
VendorRed Hat
Vendor URLhttp://www.redhat.com/
Version5.14.0-284.11.1.e19_2.x86_64
AvailableMay-2023
Bitness64
NotesNone
Java Virtual Machine jvm_1
NameOracle Java SE 21.0.3
VendorOracle
Vendor URLhttp://www.oracle.com
VersionJava HotSpot 64-bit Server VM, version 21.0.3
AvailableApr-2024
Bitness64
NotesNone
Other Software other_1
NameNone
VendorNone
Vendor URLNone
VersionNone
AvailableNone
BitnessNone
NotesNone
Hardware
OS Images os_Image_1(1)
Hardware Description hw_1
Number of Systems 1
SW Environment non-virtual
Tuning

BIOS Settings:

  • Power Technology=Custom
  • Power Performance Tuning=BIOS Controls EPB
  • ENERGY_PERF_BIAS_CFG mode=Maximum Performance
  • DCU Streamer Prefetcher=Enabled

Notes None
OS Image os_Image_1
JVM Instances jvm_Ctr_1(1), jvm_Backend_1(8), jvm_TxInjector_1(8)
OS Image Description os_1
Tuning

  • sysctl net.core.somaxconn=32768
  • sysctl net.ipv4.tcp_no_metrics_save=1
  • systemctl stop systemd-update-utmp-runlevel.service
  • echo 10000 > /proc/sys/kernel/sched_cfs_bandwidth_slice_us
  • echo 0 > /proc/sys/kernel/sched_child_runs_first
  • echo 100 > /proc/sys/kernel/sched_rr_timeslice_ms
  • echo 1000000 > /proc/sys/kernel/sched_rt_period_us
  • echo 990000 > /proc/sys/kernel/sched_rt_runtime_us
  • echo 0 > /proc/sys/kernel/sched_schedstats
  • echo 3000 > /proc/sys/vm/dirty_expire_centisecs
  • echo 500 > /proc/sys/vm/dirty_writeback_centisecs
  • echo 40 > /proc/sys/vm/dirty_ratio
  • echo 10 > /proc/sys/vm/dirty_background_ratio
  • echo 10 > /proc/sys/vm/swappiness
  • echo 0 > /proc/sys/kernel/numa_balancing
  • echo always > /sys/kernel/mm/transparent_hugepage/defrag
  • echo always > /sys/kernel/mm/transparent_hugepage/enabled
  • echo 300 > /sys/kernel/mm/hugepages/hugepages-1048576kB/nr_hugepages
  • echo 30000 > /sys/kernel/mm/hugepages/hugepages-2048kB/nr_hugepages
  • echo 0 > /proc/sys/kernel/sched_autogroup_enabled
  • ulimit -v 800000000
  • ulimit -m 800000000
  • ulimit -l 800000000
  • ulimit -n 819200
  • UserTasksMax=970000
  • DefaultTasksMax=970000
  • echo 50000000 > /sys/kernel/debug/sched/wakeup_granularity_ns
  • echo 1 > /sys/kernel/debug/sched/tunable_scaling
  • echo 9 > /sys/kernel/debug/sched/nr_migrate
  • echo 16000000 > /sys/kernel/debug/sched/latency_ns
  • echo 28000000 > /sys/kernel/debug/sched/min_granularity_ns
  • echo 1000 > /sys/kernel/debug/sched/migration_cost_ns

Notes None
JVM Instance jvm_Ctr_1
Parts of Benchmark Controller
JVM Instance Description jvm_1
Command Line

-server -Xms2g -Xmx2g -Xmn1536m -XX:+UseLargePages -XX:LargePageSizeInBytes=1G -XX:+UseParallelGC -XX:ParallelGCThreads=2

Tuning None
Notes None
JVM Instance jvm_Backend_1
Parts of Benchmark Backend
JVM Instance Description jvm_1
Command Line

-showversion -XX:+UseParallelGC -XX:+UseLargePages -XX:+AlwaysPreTouch -XX:-UseAdaptiveSizePolicy -XX:SurvivorRatio=28 -XX:MaxTenuringThreshold=15 -XX:InlineSmallCode=10k -verbose:gc -XX:-UseCountedLoopSafepoints -XX:LoopUnrollLimit=20 -XX:MaxGCPauseMillis=500 -XX:TargetSurvivorRatio=95 -XX:LargePageSizeInBytes=1G -XX:AdaptiveSizeMajorGCDecayTimeScale=12 -XX:AdaptiveSizeDecrementScaleFactor=2 -server -XX:AllocatePrefetchLines=3 -XX:AllocateInstancePrefetchLines=2 -XX:AllocatePrefetchStepSize=128 -XX:AllocatePrefetchDistance=384 -Xms31744m -Xmx31744m -Xmn29696m -XX:ParallelGCThreads=36 -Xlog:pagesize=trace

Tuning

Used numactl to affinitize four Backend JVM to each NUMA node

    • Group1: numactl --cpunodebind=0 --localalloc
    • Group2:numactl --cpunodebind=0 --localalloc
    • Group3: numactl --cpunodebind=0 --localalloc
    • Group4:numactl --cpunodebind=0 --localalloc
    • Group5: numactl --cpunodebind=1 --localalloc
    • Group6:numactl --cpunodebind=1 --localalloc
    • Group7: numactl --cpunodebind=1 --localalloc
    • Group8:numactl --cpunodebind=1 --localalloc

Notes None
JVM Instance jvm_TxInjector_1
Parts of Benchmark TxInjector
JVM Instance Description jvm_1
Command Line

-server -Xms2g -Xmx2g -Xmn1536m -XX:+UseLargePages -XX:LargePageSizeInBytes=1G -XX:+UseParallelGC -XX:ParallelGCThreads=2

Tuning

Used numactl to affinitize four Injector JVM to each NUMA node

    • Group1: numactl --cpunodebind=0 --localalloc
    • Group2:numactl --cpunodebind=0 --localalloc
    • Group3: numactl --cpunodebind=0 --localalloc
    • Group4:numactl --cpunodebind=0 --localalloc
    • Group5: numactl --cpunodebind=1 --localalloc
    • Group6:numactl --cpunodebind=1 --localalloc
    • Group7: numactl --cpunodebind=1 --localalloc
    • Group8:numactl --cpunodebind=1 --localalloc

Notes None
max-jOPS = jOPS passed before the First Failure
Pass/Fail Pass Pass Fail Fail Fail
jOPS 499701 505379 511058 516736 522415
critical-jOPS = Geomean ( jOPS @ 10000; 25000; 50000; 75000; 100000; SLAs )
Response time percentile is 99-th
SLA (us) 10000 25000 50000 75000 100000 Geomean
jOPS 235654 281082 354901 394650 406007 327486
  Percentile
  10-th 50-th 90-th 95-th 99-th 100-th
500us - / 5678 - / 5678 - / 5678 - / 5678 - / 5678 - / 5678
1000us 335027 / 45427 11357 / 17035 5678 / 11357 - / 5678 - / 5678 - / 5678
5000us 425881 / 431560 391811 / 397489 323670 / 329348 300956 / 306635 187388 / 164674 5678 / 11357
10000us 431560 / 437238 408846 / 414525 369097 / 374776 346384 / 352062 232815 / 238494 11357 / 17035
25000us 442917 / 448595 425881 / 431560 397489 / 403168 380454 / 386133 278243 / 283921 11357 / 17035
50000us 448595 / 454274 431560 / 437238 414525 / 420203 403168 / 408846 352062 / 357740 28392 / 17035
75000us 454274 / 459952 437238 / 442917 420203 / 425881 414525 / 420203 391811 / 397489 187388 / 34071
100000us 459952 / 465630 442917 / 448595 425881 / 431560 420203 / 425881 403168 / 408846 266886 / 39749
200000us 482666 / 476987 454274 / 459952 437238 / 442917 437238 / 442917 425881 / 431560 380454 / 164674
500000us 505379 / - 488344 / 494023 465630 / 471309 465630 / 471309 459952 / 465630 437238 / 442917
1000000us 505379 / - 505379 / - 499701 / 505379 494023 / 499701 488344 / 494023 465630 / 471309
Probes jOPS / Total jOPS
Request Mix Accuracy
Note
(Actual % in the Mix - Expected % in the Mix) must be within:
'Main Tx' limit of +/-5.0% for the requests whose expected % in the mix is >= 10.0%
'Minor Tx' limit of +/-1.0% for the requests whose expected % in the mix is < 10.0%
There were no non-critical failures in Response Time curve building
Delay between status pings
IR/PR Accuracy
This section lists properties only set by user
Property Name Default Controller
specjbb.comm.connect.client.pool.size 256 232
specjbb.comm.connect.selector.runner.count 0 1
specjbb.comm.connect.timeouts.connect 60000 600000
specjbb.comm.connect.timeouts.read 60000 600000
specjbb.comm.connect.timeouts.write 60000 600000
specjbb.comm.connect.worker.pool.max 256 81
specjbb.comm.connect.worker.pool.min 1 24
specjbb.controller.host localhost localhost
specjbb.controller.port 24000 24000
specjbb.controller.type HBIR_RT HBIR_RT
specjbb.customerDriver.threads 64 {=75, probe=69, saturate=85}
specjbb.forkjoin.workers 288 {Tier1=324, Tier2=6, Tier3=36}
specjbb.group.count 1 8
specjbb.mapreducer.pool.size 288 223
specjbb.txi.pergroup.count 1 1
View table in csv format
 
Level: COMPLIANCE
Check Agent Result
Check properties on compliance All PASSED
 
Level: CORRECTNESS
Check Agent Result
Compare SM and HQ Inventory All PASSED
High-bound (max attempted) is 567842 IR
High-bound (settled) is 529200 IR