SPEC Seal of Reviewal SPECjEnterprise®2010 Result
Copyright © 2009-2011 Standard Performance Evaluation Corporation
Oracle Weblogic Server Standard Edition Release 10.3.4 on Dell PowerEdge R910
11,946.60 SPECjEnterprise2010 EjOPS
Submitter:
Oracle Corporation		 SPEC license # 73 Test date:
Mar-2011
Software Products
Oracle WebLogic Server Standard Edition Release 10.3.4
Oracle JRockit(R) 6.0 JDK (R28.1.1) (Linux x86 64bit)
Java HotSpot(TM) 64-Bit Server VM on Linux, version 1.6.0_24
Oracle JDBC Driver 11.2.0.2(Thin)
Oracle Database 11g Enterprise Edition Release 11.2.0.2
EclipseLink JPA 2.1.2 Persistence Library 		Software Configurations
JEE Application Server
Emulator SW Config
Database SW Config
Driver SW Config Primary and Satellites 		Hardware Systems
JEE AppServer HW
Database Server HW
Primary and Satellite Drivers HW
Emulator HW

System Configuration Diagram

Benchmark
Modifications
Configuration
Bill of Materials
Other Info
General Notes
Full Disclosure Archive

SUT Configuration
JEE Server Nodes: 1   DB Server Nodes: 1
JEE Server CPUs: 40 cores, 4 chips   DB Server CPUs: 40 cores, 4 chips
JEE Instances: 8   DB Instances: 1
Other SUT Components:
    PowerConnect 8024F, 24 10 GbE SFP+ Ports, Four Combo Ports

Benchmark Settings
Dealer Injection Rate: 7,500   Ramp Up Time: 600 seconds
DB Load Injection Rate: 8,000   Steady State Time: 3,600 seconds
# of Dealer Agents: 75,000   Ramp Down Time: 300 seconds
# of Manufacturing Agents: 22,500  

Detailed Results
Dealer Transaction Mix Count Tx. Mix Failure Count
Purchase 6,756,325 25.01% 0
Manage 6,749,641 24.99% 1
Browse 13,507,179 50.00% 0
Total # Dealer Transactions 27,013,145
Manufacturing Transaction Mix Count Tx. Mix Failure Count
CreateVehicleEJB 7,996,604 50.00% 884
CreateVehicleWS 7,998,003 50.00% 881
Total # Manufacturing Transactions 15,994,607
Response Times Average Standard Deviation Maximum 90th% Reqd
Purchase 0.220 1.36 38.261 0.060 2.000
Manage 0.098 0.52 28.268 0.060 2.000
Browse 0.280 1.59 27.247 0.070 2.000
CreateVehicleEJB 0.035 0.07 1.790 0.050 5.000
CreateVehicleWS 0.032 0.03 1.259 0.050 5.000
Reproducibility Run (SPECjEnterprise2010 EjOPS) 11,958.54

Oracle WebLogic Server Standard Edition Release 10.3.4
Vendor: Oracle Corporation Availability: May-2011
CTS Version: 5.0 Date Passed CTS: Feb-2007
OS Name: Oracle Linux 5 Update 5 x86_64
EJB Protocol: RMI/T3

Oracle JRockit(R) 6.0 JDK (R28.1.1) (Linux x86 64bit)
Vendor: Oracle Corporation Availability: Dec-2010
OS Name: Oracle Linux 5 Update 5 x86_64

Java HotSpot(TM) 64-Bit Server VM on Linux, version 1.6.0_24
Vendor: Oracle Corporation Availability: Feb-2011
OS Name: Oracle Linux 5 Update 6 x86_64

Oracle JDBC Driver 11.2.0.2(Thin)
Vendor: Oracle Corporation Availability: Sep-2010
OS Name: Oracle Linux 5 Update 5 x86_64

Oracle Database 11g Enterprise Edition Release 11.2.0.2
Vendor: Oracle Corporation Availability: Sep-2010
OS Name: Oracle Linux 5 Update 6 x86_64

EclipseLink JPA 2.1.2 Persistence Library
Vendor: Eclipse Foundation Availability: Dec-2010
Description: Java persistence library

JEE Application Server
JEE Product: Oracle WebLogic Server Standard Edition Release 10.3.4
JVM Product: Oracle JRockit(R) 6.0 JDK (R28.1.1) (Linux x86 64bit)
JDBC Product: Oracle JDBC Driver 11.2.0.2(Thin)
Hardware: JEE AppServer HW
# of Instances: 8
Interfaces:
Web Interface for the Order Domain
Web Services Interface for the Supplier Domain
EJB Interface for the Manufacturing Domain
Web Services Interface for the Manufacturing Domain
Notes / Tuning Information 
JVM Options
-showversion -Xlargepages:exitOnFailure=true -Xms6500m -Xmx6500m -Xns3360m -XXaggressive -Xgc:genpar
-XXgcthreads=10 -Xlargepages -Xverbose:opt,gcpause,compaction -Dweblogic.MuxerClass=weblogic.socket.NIOSocketMuxer
-Dweblogic.SocketReaders=3 -Dweblogic.management.discover=false -Dweblogic.diagnostics.debug.DebugLogger.DISABLED=true
-Djaxws.transport.streaming=true -Doracle.jdbc.defaultRowPrefetch=200
-Djavax.xml.parsers.DocumentBuilderFactory=weblogic.xml.jaxp.RegistryDocumentBuilderFactory
-Dsun.net.inetaddr.ttl=0 -Dnetworkaddress.cache.ttl=0

Oracle patches for WebLogic Server Standard Edition 10.3.4 11785246, 10382753, 9956275
Added Eclipselink 2.1.2 Runtime Library to classpath

Emulator SW Config
JEE Product: Oracle WebLogic Server Standard Edition Release 10.3.4
JVM Product: Java HotSpot(TM) 64-Bit Server VM on Linux, version 1.6.0_24
Hardware: Emulator HW
# of Instances: 2
Notes / Tuning Information 
-Xmx21g -Xms21g -Xmn7g -Xss272k -XX:PermSize=95m -XX:MaxPermSize=512M -XX:+UseLargePages -XX:+AggressiveOpts
-XX:+DisableExplicitGC -verbosegc -Xloggc:emugc.log -XX:+PrintGCDetails -XX:+PrintGCTimeStamps -XX:+PrintCommandLineFlags
-showversion -Dsun.net.inetaddr.ttl=0 -Dnetworkaddress.cache.ttl=0 -Dweblogic.SocketReaders=1
-Dweblogic.management.discover=false -Dweblogic.diagnostics.debug.DebugLogger.DISABLED=true
-Djavax.xml.parsers.DocumentBuilderFactory=com.sun.org.apache.xerces.internal.jaxp.DocumentBuilderFactoryImpl -Dhttp.keepAlive=false

Database SW Config
DB Product: Oracle Database 11g Enterprise Edition Release 11.2.0.2
Hardware: Database Server HW
# of Instances: 1
Character Set: US7ASCII
Notes / Tuning Information 
db_name                       = specdb
compatible                    = 11.2.0.1.0
control_files                 = ?/dbs/cntrlspecdb
aq_tm_processes               = 0
db_4k_cache_size              = 45000M
db_8k_cache_size              = 60000M
db_block_checking             = FALSE
db_block_checksum             = FALSE
db_block_size                 = 2048
db_cache_advice               = OFF
db_cache_size                 = 125000M
db_file_multiblock_read_count = 128
db_files                      = 256
db_keep_cache_size            = 20000M
dml_locks                     = 2200
filesystemio_options          = DirectIO
log_buffer                    = 67108864
log_checkpoint_interval       = 0
log_checkpoints_to_alert      = TRUE
open_cursors                  = 4000
parallel_max_servers          = 100
pga_aggregate_target          = 0
processes                     = 4000
query_rewrite_enabled         = FALSE
replication_dependency_tracking = FALSE
session_cached_cursors        = 4000
sessions                      = 4000
shared_pool_size              = 24000M
statistics_level              = BASIC
timed_statistics              = FALSE
trace_enabled                 = FALSE
transactions                  = 15000
transactions_per_rollback_seg = 1
undo_management               = AUTO
undo_retention                = 10
undo_tablespace               = undo_ts

Driver SW Config Primary and Satellites
JVM Product: Java HotSpot(TM) 64-Bit Server VM on Linux, version 1.6.0_24
Hardware: Primary and Satellite Drivers HW
# of Instances: 4
Notes / Tuning Information 
-server -Xms6400M -Xmx6400M -Djava.net.preferIPv4Stack=true -verbosegc
-Dhttp.keepAliveCache.lifeTime=600000 -Dsun.net.inetaddr.ttl=0 -Dnetworkaddress.cache.ttl=0

JEE AppServer HW (SUT hardware)
Hardware Vendor: Dell OS Vendor: Oracle Corporation
Model Name: Dell PowerEdge R910 OS Name: Oracle Linux 5 Update 5 x86_64
Processor: Ten Core Intel(R) Xeon(R) CPU E7- 4870 Filesystem: ext3
MHz: 2394 Disks: H700 card with 2x 146GB and 2x 72GB 15k disks
# of CPUs: 40 cores, 4 chips, 10 cores/chip, 2 threads/core (Hyper-Threading) Network Interface: 4 x Intel 10Gb NICs
Memory (MB): 64429 Other Hardware: See notes
DIMM[0] Count: 64 DIMM[0] Size: 1024
L1 Cache: 32KB(I)+32KB(D) on chip per core # of Systems: 1
L2 Cache: 256 KB on chip per core H/W Available: Apr-2011
Other Cache: 30MB(I+D) L3 on chip per chip OS Available: Apr-2010
Notes / Tuning Information 
Added to /etc/sysctl.conf:
fs.file-max = 524288
kernel.sem = 250 32000 100 128
kernel.shmall = 10737418240
kernel.shmmax = 4398046511104
net.core.netdev_max_backlog = 400000
net.core.optmem_max = 30000000
net.core.rmem_default = 30000000
net.core.rmem_max = 30000000
net.core.somaxconn = 40000
net.core.wmem_default = 30000000
net.core.wmem_max = 30000000
net.ipv4.ip_local_port_range = 1024 65000
net.ipv4.tcp_fin_timeout = 10
net.ipv4.tcp_max_syn_backlog = 30000
net.ipv4.tcp_max_tw_buckets = 2000000
net.ipv4.tcp_mem = 30000000 30000000 30000000
net.ipv4.tcp_rmem = 30000000 30000000 30000000
net.ipv4.tcp_timestamps = 0
net.ipv4.tcp_wmem = 30000000 30000000 30000000
vm.zone_reclaim_mode=1

For each of the NICs:
set arp_announce = 2
set arp_ignore = 1
set txqueuelen 240000
enable tso and gso
Bind interrupt to a core corresponding to the server instance

Server instances were started using numactl  binding 2 instances per chip.
Stop iptables.
Stop irqbalance.
Configure 27000 hugepages.

System was configured with 4 drives as 2 RAID 1 volumes
for jms and server logs.

Database Server HW (SUT hardware)
Hardware Vendor: Dell OS Vendor: Oracle Corporation
Model Name: Dell PowerEdge R910 OS Name: Oracle Linux 5 Update 6 x86_64
Processor: Ten Core Intel(R) Xeon(R) CPU E7- 4870 Filesystem: ext3
MHz: 2394 Disks: H800 card, 4 x M1220 disk arrays each with 24 146GB 15k disks
# of CPUs: 40 cores, 4 chips, 10 cores/chip, 2 threads/core (Hyper-Threading) Network Interface: 1 Intel 10Gb NIC
Memory (MB): 517015 Other Hardware: See notes
DIMM[0] Count: 64 DIMM[0] Size: 8192
L1 Cache: 32KB(I)+32KB(D) on chip per core # of Systems: 1
L2 Cache: 256 KB on chip per core H/W Available: Apr-2011
Other Cache: 30MB(I+D) L3 on chip per chip OS Available: Jan-2011
Notes / Tuning Information 
Added to /etc/sysctl.conf:
fs.file-max = 262144
kernel.sem = 250 32000 100 142
kernel.shmall = 10737418240
kernel.shmmax = 4398046511104
net.core.netdev_max_backlog = 400000
net.core.optmem_max = 30000000
net.core.rmem_default = 30000000
net.core.rmem_max = 30000000
net.core.somaxconn = 40000
net.core.wmem_default = 30000000
net.core.wmem_max = 30000000
net.ipv4.ip_local_port_range = 1024 65000
net.ipv4.tcp_fin_timeout = 10
net.ipv4.tcp_max_syn_backlog = 30000
net.ipv4.tcp_max_tw_buckets = 2000000
net.ipv4.tcp_mem = 30000000 30000000 30000000
net.ipv4.tcp_rmem = 30000000 30000000 30000000
net.ipv4.tcp_timestamps = 0
net.ipv4.tcp_wmem = 30000000 30000000 30000000
vm.zone_reclaim_mode=1
Oracle kernel-uek-2.6.32-100.26.2.el5 was running on the system.
For each of the NICs:
set arp_announce = 2
set arp_ignore = 1
set txqueuelen 240000
enable tso and gso
bind interrupts to all cores in a round-robin mode.

8 Oracle listener processes were started, and 2 bound to each processor.
Stop iptables.
Stop irqbalance.
Configure 180000 hugepages.

External storage configuration:
3x Dell PowerVault MD1220 (72x 146GB 15K 6Gb SAS) for data files;
1x Dell PowerVault MD1220 (24x 146GB 15K 6Gb SAS) for redo logs.

Primary and Satellite Drivers HW (non-SUT hardware)
Hardware Vendor: Dell OS Vendor: Oracle Corporation
Model Name: Dell PowerEdge R410 OS Name: Oracle Linux 5 Update 6 x86_64
Processor: Quad Core Intel(R) Xeon(R) E5620 Filesystem: ext3
MHz: 2394 Disks: 1 x 160GB SATA drive
# of CPUs: 8 cores, 2 chips, 4 cores/chip, 2 threads/core (Hyper-Threading) Network Interface: 1 x Intel 10Gb NIC
Memory (MB): 64540 Other Hardware: none
L1 Cache: 32KB(I)+32KB(D) on chip per core # of Systems: 4
L2 Cache: 256KB on chip per core H/W Available: Apr-2011
Other Cache: 12MB L3 on chip per chip OS Available: Jan-2011
Notes / Tuning Information 
Added to /etc/sysctl.conf:
fs.file-max = 524288
kernel.sem = 250 32000 100 128
kernel.shmall = 10737418240
kernel.shmmax = 51539607552
net.core.netdev_max_backlog = 400000
net.core.optmem_max = 30000000
net.core.rmem_default = 30000000
net.core.rmem_max = 30000000
net.core.somaxconn = 40000
net.core.wmem_default = 30000000
net.core.wmem_max = 30000000
net.ipv4.ip_local_port_range = 1024 65000
net.ipv4.tcp_fin_timeout = 10
net.ipv4.tcp_max_syn_backlog = 30000
net.ipv4.tcp_max_tw_buckets = 2000000
net.ipv4.tcp_mem = 30000000 30000000 30000000
net.ipv4.tcp_rmem = 30000000 30000000 30000000
net.ipv4.tcp_timestamps = 0
net.ipv4.tcp_wmem = 30000000 30000000 30000000
vm.zone_reclaim_mode=1
Oracle kernel-uek-2.6.32-100.26.2.el5 was running on the system.
For each of the NICs:
set arp_announce = 2
set arp_ignore = 1
set txqueuelen 240000
enable tso and gso

Stop iptables.
Stop irqbalance.

Bind interrupts to all cores of all chips

Emulator HW (non-SUT hardware)
Hardware Vendor: Dell OS Vendor: Oracle Corporation
Model Name: Dell PowerEdge R710 OS Name: Oracle Linux 5 Update 6 x86_64
Processor: Six Core Intel(R) Xeon(R) X5670 Filesystem: ext3
MHz: 2926 Disks: H200 card with 2 x 146GB disks
# of CPUs: 12 cores, 2 chips, 6 cores/chip, 2 threads/core (Hyper-Threading) Network Interface: 2x 10Gb NIC
Memory (MB): 72622 Other Hardware: none
L1 Cache: 32KB(I)+32KB(D) on chip per core # of Systems: 1
L2 Cache: 256KB on chip per core H/W Available: Apr-2011
Other Cache: 12MB L3 on chip per chip OS Available: Jan-2011
Notes / Tuning Information 
Added to /etc/sysctl.conf:
fs.file-max = 262144
kernel.sem = 250 32000 100 128
kernel.shmall = 10737418240
kernel.shmmax = 51539607552
net.core.netdev_max_backlog = 400000
net.core.optmem_max = 30000000
net.core.rmem_default = 30000000
net.core.rmem_max = 30000000
net.core.somaxconn = 40000
net.core.wmem_default = 30000000
net.core.wmem_max = 30000000
net.ipv4.ip_local_port_range = 1024 65000
net.ipv4.tcp_fin_timeout = 10
net.ipv4.tcp_max_syn_backlog = 30000
net.ipv4.tcp_max_tw_buckets = 2000000
net.ipv4.tcp_mem = 30000000 30000000 30000000
net.ipv4.tcp_rmem = 30000000 30000000 30000000
net.ipv4.tcp_timestamps = 0
net.ipv4.tcp_wmem = 30000000 30000000 30000000
vm.zone_reclaim_mode=1
Oracle kernel-uek-2.6.32-100.26.2.el5 was running on the system.
For each of the NICs:
set arp_announce = 2
set arp_ignore = 1
set txqueuelen 240000
enable tso and gso
bind interrupts to all cores of one chip, one NIC/chip.

Stop iptables.
Stop irqbalance.

Configure 16000 hugepages.

Benchmark Modifications
Schema Modifications: 
  Tablespace sizes were increased to support the Injection rate.
  Scripts to create the DB are included in the FDA.
  Table and index initrans were modified.
  Table M_WORKORDER, O_ORDERLINE and O_ORDERS were horizontally partitioned.
  Table M_BOM, M_INVENTORY and M_PARTS were hash clustered.
  System managed undo was used.
Load Program Modifications: 
  No modifications to the load programs were made.

Benchmark Configuration Information
Isolation Requirement Info: 
  The ItemEnt bean was cached for 20 minute intervals by setting:
  eclipselink.query-results-cache.expiry=1200000
  in the ord-orm.xml deployment descriptor.
  
  The benchmark meets the isolation level requirements by
  version column checking on entities against
  the database.
Durability Requirement Info: 
  To ensure database durability, RAID 1 was used for the
  database files and database redo logs
Storage Requirement Info: 
  A 75 minute run at an injection rate of 7500 increased storage by 18.2 GB
  This extrapolates to 350 GB storage for a 24 hour run.
  The database was configured with 7 TB of mirrored storage.

Bill of Materials 
Supplier  Description                                                             Product #          Qty
--------  ---------------------------------------------------------------------   ----------------   ---

Application Server:
Dell      PowerEdge R910  R910 Chassis for up to Sixteen 2.5-Inch Hard Drives     R91016               1
Dell      Memory  64GB Memory (64x1GB), 1066MHz, Single Ranked RDIMMs             64G1RPO              1
Dell      Dual Two-Port Embedded Broadcom NetXtreme II 5709 Gigabit Ethernet      OBC5709              1
Dell      2 x Intel Xeon E7-4870 2.40GHz, 30M cache, 6.40 GT/s QPI                E74870               1
Dell      Additional Processors 'Upgrade to Four Intel Xeon E7-4870 2.40GHz'      4XE74870             1
Dell      Hard Drives     HD Multi-Select                                         HDMULTI              1
Dell      PERC H700 Integrated RAID Controller, 512MB Cache                       H7I512               1
Dell      RAID 1/RAID 1 PERC H200 or PERC H700 Controllers (Non-Mixed Drives)     MSR1R1               1
Dell      3 Year ProSupport and Mission Critical 4HR 7x24 Onsite Pack             U3IPME4              1
Dell      Hard Drives (2) 146GB 15K RPM Serial-Attach SCSI 6Gbps 2.5in Hotplug    146A615              1
Dell      Hard Drives (2) 73GB 15K RPM Serial-Attach SCSI 6Gbps 2.5in Hotplug     76A615               1
Dell      Network Adapter Intel X520 DA 10GB, Dual Port SFP+,PCIe-8 NIC           10GICL               2

Database Server:
Dell      PowerEdge R910  R910 Chassis for up to Four 2.5-Inch Hard Drives        R9104B               1
Dell      512GB Memory (64x8GB), 1066MHz, Quad Ranked RDIMMs                      512S64O              1
Dell      Dual Two-Port Embedded Broadcom NetXtreme II 5709 Gigabit Ethernet      OBC5709              1
Dell      2 x Intel Xeon E7-4870 2.40GHz, 30M cache, 6.40 GT/s QPI                E74870               1
Dell      Additional Processors 'Upgrade to Four Intel Xeon E7-4870 2.40GHz'      4XE74870             1
Dell      Hard Drives     HD Multi-Select                                         HDMULTI              1
Dell      Internal Controller     PERC H200 Integrated                            H200I                1
Dell      PCIe Riser Card R910 Add-in Card with 4x Low Profile PCIe               PCIERSR              1
Dell      PERC H800 RAID Adapter for External JBOD, 512MB                         H8A512               2
Dell      RAID 1 for PERC H200 or PERC H700 Controllers (Non-Mixed Drives)        MSR1                 1
Dell      3 Year ProSupport and Mission Critical 4HR 7x24 Onsite Pack             U3IPME4              1
Dell      Hard Drives (2) 146GB 15K RPM Serial-Attach SCSI 6Gbps 2.5in Hotplug    146A615              1
Dell      Network Adapter Intel X520 DA 10GB, Dual Port SFP+,PCIe-8 NIC           10GICL               1

Database Server External Storage:
Dell      PowerVault MD1220, Rackmount SAS, 24 Bay,Power Supply                   MD1220               4
Dell      HD Multi-Select                                                         HDMULT               4
Dell      2 Encl Mgmt Modules, SAS Only                                           EMM                  4
Dell      Bezel ASSY,MD1220                                                       BEZEL                4
Dell      6Gb SAS Cable, 1M                                                       2XCB1M               4
Dell      3 Year ProSupport and Mission Critical 4HR 7x24                         U3IPME4              4
Dell      Hard Drives (24) 146G,SAS6GB,15K,2.5 HDD                                146A52               4

Network:
Dell      PowerConnect 8024F, 24 10 GbE SFP+ Ports, Four Combo Ports              P8024F               1
Dell      3 Year ProSupport and Mission Critical 4HR 7x24 Onsite Pack             U3IPME4              1

Oracle    Oracle Linux Basic Support for 3 years                                                       2

Oracle    Oracle Database 11g Enterprise Edition, Per Processor
-         Unlimited Users for 3 years                                                                  *
Oracle    Partitioning, Per Processor, Unlimited Users for 3 years                                     *
Oracle    Oracle Premium Support for 3 years                                                           2

Oracle    Oracle WebLogic Server Standard Edition Release 10.3.4
-         Per Processor for 3 years                                                                    *
Oracle    Oracle Premium Support for 3 years                                                           1

(* 40 = TBD * 40) Explanation:  For the purposes of counting
the number of processors which require licensing, a multicore chip with 'n' cores
shall be determined by multiplying 'n' cores by a factor of [To Be Determined (TBD) prior to GA].

Other Benchmark Information 
  DNS round robin load balancing was used.

General Notes 
The only errors in the driver log files were those that are
normally generated by this benchmark.

On the database, incremental checkpointing ensured that no buffer will
remain dirty (in the cache) for more than the allowed time.

For questions about this result, please contact the submitter: Oracle Corporation
For other inquiries, please contact webmaster@spec.org

Copyright © 2009-2011 Standard Performance Evaluation Corporation

First published at SPEC.org on 06-Apr-2011