Supermicro SuperServer SYS-521E-WR 189238 SPECjbb2015-MultiJVM max-jOPS
110444 SPECjbb2015-MultiJVM critical-jOPS
Tested by: Supermicro Test Sponsor: Supermicro Test location: San Jose, California Test date: Jan 09, 2023
SPEC license #: 001176 Hardware Availability: Jan-2023 Software Availability: Nov-2022 Publication: Fri Feb 10 10:54:47 EST 2023
Benchmark Results Summary
 
Overall Throughput RT curve
Overall SUT (System Under Test) Description
VendorSupermicro
Vendor URLhttps://www.supermicro.com
System SourceSingle Supplier
System DesignationServer Rack
Total Systems1
All SUT Systems IdenticalYES
Total Nodes1
All Nodes IdenticalYES
Nodes Per System1
Total Chips1
Total Cores60
Total Threads120
Total Memory Amount (GB)512
Total OS Images1
SW EnvironmentNon-virtual
 
Hardware hw_1
NameSuperServer SYS-521E-WR
VendorSupermicro
Vendor URLhttps://www.supermicro.com
AvailableJan-2023
ModelX13SEW-TF
Form Factor2U
CPU NameIntel Xeon Platinum 8490H
CPU Characteristics60 Core, 1.90 GHz, 112.5 MB L3 Cache (Turbo Boost Technology up to 3.50 GHz)
Number of Systems1
Nodes Per System1
Chips Per System1
Cores Per System60
Cores Per Chip60
Threads Per System120
Threads Per Core2
Version1.0a (11/29/2022)
CPU Frequency (MHz)1900
Primary Cache32 KB(I) + 48 KB(D) per core
Secondary Cache2 MB (I+D) per core
Tertiary Cache112.5 MB (I+D) on chip per chip
Other CacheNone
Disk1 x 480 GB M.2 NVMe SSD
File Systemxfs
Memory Amount (GB)512
# and size of DIMM(s)8 x 64 GB
Memory Details64 GB 2Rx4 PC5-4800B-R
# and type of Network Interface Cards (NICs)1 x 10 Gbit + 1 x 1 Gbit NICs
Power Supply Quantity and Rating (W)1 x 600W
Other HardwareNone
Cabinet/Housing/EnclosureNone
Shared DescriptionNone
Shared CommentNone
Notes
  • NA: The test sponsor attests, as of date of publication, that CVE-2017-5754 (Meltdown) is mitigated in the system as tested and documented.
  • Yes: The test sponsor attests, as of date of publication, that CVE-2017-5753 (Spectre variant 1) is mitigated in the system as tested and documented.
  • Yes: The test sponsor attests, as of date of publication, that CVE-2017-5715 (Spectre variant 2) is mitigated in the system as tested and documented.
Other Hardware network_1
NameNone
VendorNone
Vendor URLNone
VersionNone
AvailableNone
BitnessNone
NotesNone
Operating System os_1
NameRed Hat Enterprise Linux 9.0. x86_64
VendorRedHat
Vendor URLhttps://www.redhat.com/
Version5.14.0-70.13.1.el9.0.x86_64
AvailableMay-2022
Bitness64
NotesNone
Java Virtual Machine jvm_1
NameOracle Java SE 19.0.1
VendorOracle
Vendor URLhttp://www.oracle.com/
VersionJava HotSpot 64-bit Server VM, version 19.0.1
AvailableOct-2022
Bitness64
NotesNone
Other Software other_1
NameNone
VendorNone
Vendor URLNone
VersionNone
AvailableNone
BitnessNone
NotesNone
Hardware
OS Images os_Image_1(1)
Hardware Description hw_1
Number of Systems 1
SW Environment non-virtual
Tuning

BIOS Settings:

  • Intel HT Technology=Enable
  • Hardware Prefetcher=Enabled
  • Turbo Mode=Enable
  • SNC=SNC4 Enable
  • LLC Prefetch=Disable
  • LLC Dead Line Alloc=Disable
  • DCU Streamer Prefetcher=Disable
  • Stale AtoS=Disable
  • Patrol Scrub=Disable
  • Power Technology=Custom
  • Power Performance Tuning=BIOS Controls EPB
  • ENERGY_PERF_BIAS_CFG mode=Performance

Notes None
OS Image os_Image_1
JVM Instances jvm_Ctr_1(1), jvm_Backend_1(4), jvm_TxInjector_1(4)
OS Image Description os_1
Tuning

  • cpupower -c all frequency-set -g performance
  • tuned-adm profile throughput-performance

  • ulimit -n 131072
  • echo 10000 > /proc/sys/kernel/sched_cfs_bandwidth_slice_us
  • echo 0 > /proc/sys/kernel/sched_child_runs_first
  • echo 16000000 > /sys/kernel/debug/sched/latency_ns
  • echo 1000 > /sys/kernel/debug/sched/migration_cost_ns
  • echo 28000000 > /sys/kernel/debug/sched/min_granularity_ns
  • echo 9 > /sys/kernel/debug/sched/nr_migrate
  • echo 100 > /proc/sys/kernel/sched_rr_timeslice_ms
  • echo 1000000 > /proc/sys/kernel/sched_rt_period_us
  • echo 990000 > /proc/sys/kernel/sched_rt_runtime_us
  • echo 0 > /proc/sys/kernel/sched_schedstats
  • echo 1 > /sys/kernel/debug/sched/tunable_scaling
  • echo 50000000 > /sys/kernel/debug/sched/wakeup_granularity_ns
  • echo 0 > /proc/sys/kernel/numa_balancing
  • echo always > /sys/kernel/mm/transparent_hugepage/defrag
  • echo always > /sys/kernel/mm/transparent_hugepage/enabled
  • ulimit -v 800000000
  • ulimit -m 800000000
  • ulimit -l 800000000
  • echo 300 > /sys/kernel/mm/hugepages/hugepages-1048576kB/nr_hugepages
  • echo 300 > /sys/kernel/mm/hugepages/hugepages-2048kb/nr_hugepages

Notes None
JVM Instance jvm_Ctr_1
Parts of Benchmark Controller
JVM Instance Description jvm_1
Command Line

-server -Xms2g -Xmx2g -Xmn1536m -XX:+UseLargePages -XX:LargePageSizeInBytes=1G -XX:+UseParallelGC -XX:ParallelGCThreads=2

Tuning None
Notes

Used numactl to interleave memory on all CPUs

  • numactl --interleave=all

JVM Instance jvm_Backend_1
Parts of Benchmark Backend
JVM Instance Description jvm_1
Command Line

-showversion -XX:+UseParallelGC -XX:+UseLargePages -XX:+AlwaysPreTouch -XX:-UseAdaptiveSizePolicy -XX:MaxTenuringThreshold=15 -XX:InlineSmallCode=10k -XX:-UseCountedLoopSafepoints -XX:LoopUnrollLimit=20 -server -XX:TargetSurvivorRatio=99 -XX:SurvivorRatio=28 -XX:LargePageSizeInBytes=1g -XX:UseAVX=0 -Xms31744m -Xmx31744m -Xmn29696m -XX:ParallelGCThreads=30

Tuning None
Notes None
JVM Instance jvm_TxInjector_1
Parts of Benchmark TxInjector
JVM Instance Description jvm_1
Command Line

-server -Xms2g -Xmx2g -Xmn1536m -XX:+UseLargePages -XX:LargePageSizeInBytes=1G -XX:+UseParallelGC -XX:ParallelGCThreads=2

Tuning None
Notes None
max-jOPS = jOPS passed before the First Failure
Pass/Fail Pass Pass Fail Fail Fail
jOPS 187136 189238 191341 193444 195546
critical-jOPS = Geomean ( jOPS @ 10000; 25000; 50000; 75000; 100000; SLAs )
Response time percentile is 99-th
SLA (us) 10000 25000 50000 75000 100000 Geomean
jOPS 74644 91815 112491 139826 152442 110444
  Percentile
  10-th 50-th 90-th 95-th 99-th 100-th
500us 4205 / 6308 - / 2103 - / 2103 - / 2103 - / 2103 - / 2103
1000us 79901 / 82003 8411 / 10513 6308 / 8411 4205 / 2103 - / 2103 - / 2103
5000us 187136 / 189238 170315 / 172417 126159 / 128262 90414 / 92517 46258 / 48361 4205 / 6308
10000us 189238 / - 174520 / 176623 142980 / 145083 124056 / 126159 73593 / 75695 4205 / 6308
25000us 189238 / - 180828 / 182931 159801 / 161904 151391 / 153493 94619 / 90414 4205 / 6308
50000us 189238 / - 185033 / 187136 168212 / 170315 157699 / 159801 111440 / 113543 4205 / 6308
75000us 189238 / - 185033 / 187136 172417 / 174520 161904 / 164007 138775 / 140878 33642 / 6308
100000us 189238 / - 189238 / - 174520 / 176623 168212 / 170315 151391 / 153493 75695 / 6308
200000us 189238 / - 189238 / - 185033 / 187136 180828 / 182931 174520 / 176623 140878 / 119851
500000us 189238 / - 189238 / - 189238 / - 189238 / - 189238 / - 170315 / 166109
1000000us 189238 / - 189238 / - 189238 / - 189238 / - 189238 / - 185033 / 187136
Probes jOPS / Total jOPS
Request Mix Accuracy
Note
(Actual % in the Mix - Expected % in the Mix) must be within:
'Main Tx' limit of +/-5.0% for the requests whose expected % in the mix is >= 10.0%
'Minor Tx' limit of +/-1.0% for the requests whose expected % in the mix is < 10.0%
There were no non-critical failures in Response Time curve building
Delay between status pings
IR/PR Accuracy
This section lists properties only set by user
Property Name Default Controller
specjbb.comm.connect.client.pool.size 256 256
specjbb.comm.connect.selector.runner.count 0 0
specjbb.comm.connect.timeouts.connect 60000 60000
specjbb.comm.connect.timeouts.read 60000 60000
specjbb.comm.connect.timeouts.write 60000 60000
specjbb.comm.connect.worker.pool.max 256 256
specjbb.comm.connect.worker.pool.min 1 1
specjbb.controller.host localhost localhost
specjbb.controller.port 24000 24000
specjbb.controller.type HBIR_RT HBIR_RT
specjbb.customerDriver.threads 64 {=75, probe=69, saturate=85}
specjbb.forkjoin.workers 120 {Tier1=220, Tier2=5, Tier3=20}
specjbb.group.count 1 4
specjbb.mapreducer.pool.size 120 223
specjbb.txi.pergroup.count 1 1
View table in csv format
 
Level: COMPLIANCE
Check Agent Result
Check properties on compliance All PASSED
 
Level: CORRECTNESS
Check Agent Result
Compare SM and HQ Inventory All PASSED
High-bound (max attempted) is 210265 IR
High-bound (settled) is 202634 IR