MPI2007 license: | 13 | Test date: | Jul-2017 |
---|---|---|---|
Test sponsor: | Intel Corporation | Hardware Availability: | Jul-2017 |
Tested by: | Intel Corporation | Software Availability: | Sep-2017 |
Benchmark | Base | Peak | ||||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
Ranks | Seconds | Ratio | Seconds | Ratio | Seconds | Ratio | Ranks | Seconds | Ratio | Seconds | Ratio | Seconds | Ratio | |
Results appear in the order in which they were run. Bold underlined text indicates a median measurement. | ||||||||||||||
121.pop2 | 80 | 842 | 4.62 | 845 | 4.61 | 841 | 4.63 | |||||||
122.tachyon | 80 | 742 | 2.62 | 745 | 2.61 | 754 | 2.58 | |||||||
125.RAxML | 80 | 707 | 4.13 | 707 | 4.13 | 708 | 4.12 | |||||||
126.lammps | 80 | 757 | 3.25 | 753 | 3.26 | 755 | 3.26 | |||||||
128.GAPgeofem | 80 | 869 | 6.83 | 871 | 6.81 | 863 | 6.87 | |||||||
129.tera_tf | 80 | 361 | 3.04 | 362 | 3.03 | 363 | 3.02 | |||||||
132.zeusmp2 | 80 | 462 | 4.59 | 463 | 4.58 | 464 | 4.57 | |||||||
137.lu | 80 | 794 | 5.29 | 800 | 5.25 | 786 | 5.34 | |||||||
142.dmilc | 80 | 533 | 6.91 | 532 | 6.93 | 533 | 6.91 | |||||||
143.dleslie | 80 | 495 | 6.26 | 495 | 6.26 | 497 | 6.24 | |||||||
145.lGemsFDTD | 80 | 860 | 5.13 | 859 | 5.14 | 859 | 5.14 | |||||||
147.l2wrf2 | 80 | 1451 | 5.65 | 1461 | 5.62 | 1461 | 5.62 |
Hardware Summary | |
---|---|
Type of System: | Homogeneous |
Compute Node: | Endeavor Node |
Interconnects: | Intel Omni-Path Intel Omni-Path |
File Server Node: | Lustre FS |
Total Compute Nodes: | 2 |
Total Chips: | 4 |
Total Cores: | 80 |
Total Threads: | 160 |
Total Memory: | 384 GB |
Base Ranks Run: | 80 |
Minimum Peak Ranks: | -- |
Maximum Peak Ranks: | -- |
Software Summary | |
---|---|
C Compiler: | Intel C++ Composer XE 2017 for Linux Version 17.0.4.196 Build 20170411 |
C++ Compiler: | Intel C++ Composer XE 2017 for Linux Version 17.0.4.196 Build 20170411 |
Fortran Compiler: | Intel Fortran Composer XE 2017 for Linux Version 17.0.4.196 Build 20170411 |
Base Pointers: | 64-bit |
Peak Pointers: | Not Applicable |
MPI Library: | Intel MPI Library 17u4 for Linux |
Other MPI Info: | None |
Pre-processors: | No |
Other Software: | None |
Hardware | |
---|---|
Number of nodes: | 2 |
Uses of the node: | compute |
Vendor: | Intel |
Model: | Intel Server System R2208WFTZS (Intel Xeon Gold 6148, 2.4 GHz) |
CPU Name: | Intel Xeon Gold 6148 |
CPU(s) orderable: | 1-2 chips |
Chips enabled: | 2 |
Cores enabled: | 40 |
Cores per chip: | 20 |
Threads per core: | 2 |
CPU Characteristics: | Intel Turbo Boost Technology up to 3.7 GHz |
CPU MHz: | 2400 |
Primary Cache: | 32 KB I + 32 KB D on chip per core |
Secondary Cache: | 1 MB I+D on chip per core |
L3 Cache: | 27.5 MB I+D on chip per chip |
Other Cache: | None |
Memory: | 192 GB (12 x 16 GB 2Rx4 DDR4-2666 ECC Registered) |
Disk Subsystem: | 1 x 800 GB SSD (INTEL SSDSC2BA80) |
Other Hardware: | None |
Adapter: | Intel Omni-Path Fabric Adapter 100 series |
Number of Adapters: | 1 |
Slot Type: | PCI-Express x16 |
Data Rate: | 12.5 GB/s |
Ports Used: | 1 |
Interconnect Type: | Intel Omni-Path Fabric Adapter 100 series |
Adapter: | Intel Omni-Path Edge Switch 100 series |
Number of Adapters: | 1 |
Slot Type: | PCI-Express x16 |
Data Rate: | 12.5 GB/s |
Ports Used: | 1 |
Interconnect Type: | Intel Omni-Path Fabric Adapter 100 series |
Software | |
---|---|
Adapter: | Intel Omni-Path Fabric Adapter 100 series |
Adapter Driver: | IFS 10.4 |
Adapter Firmware: | 0.9-46 |
Adapter: | Intel Omni-Path Edge Switch 100 series |
Adapter Driver: | IFS 10.4 |
Adapter Firmware: | 0.9-46 |
Operating System: | Oracle Linux Server release 7.3, Kernel 3.10.0-514.6.2.0.1.el7.x86_64.knl1 |
Local File System: | Linux/xfs |
Shared File System: | LFS |
System State: | Multi-User |
Other Software: | IBM Platform LSF Standard 9.1.1.1 |
Hardware | |
---|---|
Number of nodes: | 11 |
Uses of the node: | fileserver |
Vendor: | Intel |
Model: | Intel Server System R2224GZ4GC4 |
CPU Name: | Intel Xeon E5-2680 |
CPU(s) orderable: | 1-2 chips |
Chips enabled: | 2 |
Cores enabled: | 16 |
Cores per chip: | 8 |
Threads per core: | 2 |
CPU Characteristics: | Intel Turbo Boost Technology disabled |
CPU MHz: | 2700 |
Primary Cache: | 32 KB I + 32 KB D on chip per core |
Secondary Cache: | 2 MB I+D on chip per chip |
L3 Cache: | 20 MB I+D on chip per chip |
Other Cache: | None |
Memory: | 64 GB (8 x 8GB 1600MHz Reg ECC DDR3) |
Disk Subsystem: | 2.1 TB |
Other Hardware: | None |
Adapter: | Intel Omni-Path Fabric Adapter 100 series |
Number of Adapters: | 1 |
Slot Type: | PCI-Express x16 |
Data Rate: | 12.5 GB/s |
Ports Used: | 1 |
Interconnect Type: | Intel Omni-Path Fabric Adapter 100 series |
Software | |
---|---|
Adapter: | Intel Omni-Path Fabric Adapter 100 series |
Adapter Driver: | IFS 10.4 |
Adapter Firmware: | 0.9-46 |
Operating System: | Redhat* Enterprise Linux* Server Release 7.2, Kernel 3.10.0-514.6.2.0.1.el7.x86_64.knl1 |
Local File System: | None |
Shared File System: | Lustre FS |
System State: | Multi-User |
Other Software: | None |
Hardware | |
---|---|
Vendor: | Intel |
Model: | Intel Omni-Path 100 series |
Switch Model: | Intel Omni-Path Edge Switch 100 series |
Number of Switches: | 24 |
Number of Ports: | 48 |
Data Rate: | 12.5 GB/s |
Firmware: | 0.9-46 |
Topology: | Fat tree |
Primary Use: | MPI traffic |
Hardware | |
---|---|
Vendor: | Intel Corporation |
Model: | Intel Omni-Path 100 series |
Switch Model: | Intel Omni-Path Edge Switch 100 series |
Number of Switches: | 1 |
Number of Ports: | 48 |
Data Rate: | 12.5 GB/s |
Firmware: | 0.9-46 |
Topology: | Fat tree |
Primary Use: | Cluster File System |
The config file option 'submit' was used.
MPI startup command: mpiexec.hydra command was used to start MPI jobs. Software environment: export I_MPI_COMPATIBILITY=3 export I_MPI_FABRICS=shm:tmi export I_MPI_HYDRA_PMI_CONNECT=alltoall Network: Endeavour Omni-Path fabric consists of 48-port switches = 24 core switches connected to each leaf of the rack switch. Job placement: Each MPI job was assigned to a topologically compact set of nodes, i.e. the minimal needed number of leaf switches was used for each job = 1 switch for 40/80/160/320/640 ranks, 2 switches for 1280 and 1980 ranks. IBM Platform LSF was used for job submission. It has no impact on performance. Information can be found at: http://www.ibm.com
mpiicc |
126.lammps: | mpiicpc |
mpiifort |
mpiicc mpiifort |
121.pop2: | -DSPEC_MPI_CASE_FLAG |
126.lammps: | -DMPICH_IGNORE_CXX_SEEK |