SPEC Seal of Reviewal SPECjAppServer®2004 Result
Copyright © 2004 Standard Performance Evaluation Corporation
Oracle WebLogic Server Standard Edition Release 10.3.3 on Dell PowerEdge R810
5,739.17 SPECjAppServer2004 JOPS@Standard
Submitter:
Oracle Corporation		 SPEC license # 73 Test date:
May-2010
Software Products
Oracle WebLogic Server Standard Edition Release 10.3.3
Oracle JRockit(R) 6.0 JDK (R28.0.0) (Linux x86 64bit)
Java HotSpot(TM) 64-Bit Server VM on Linux, version 1.6.0_17
Oracle JDBC Driver 11.2.0.1.0 (Thin)
Oracle Database Enterprise Edition Release 11.2.0.1.0 		Software Configurations
J2EE Application Server
Emulator SW Config
Database SW Config
Driver SW Config Primary and Satellites 		Hardware Systems
J2EE Application Server
Database Server HW
Primary Driver HW
Satellite Driver #1 HW
Satellite Driver #2
Emulator HW

System Configuration Diagram

Benchmark
Modifications
Configuration
Bill of Materials
Other Info
General Notes
Full Disclosure Archive

SUT Configuration
J2EE Server Nodes: 1   DB Server Nodes: 1
J2EE Server CPUs: 16 cores, 2 chips   DB Server CPUs: 16 cores, 2 chips
J2EE Instances: 8   DB Instances: 1
Other SUT Components:
   

Benchmark Settings
Dealer Injection Rate: 3,440   Ramp Up Time: 1,200 seconds
# of Dealer Agents: 18   Ramp Down Time: 300 seconds
# of Manufacturing Agents: 6   Steady State Time: 3,600 seconds
DB Load Injection Rate: 4,000   Trigger Time: 1,600 seconds

Detailed Results
Dealer Transaction Mix Count Tx. Mix
Purchase 3,101,795 25.02%
Manage 3,097,129 24.98%
Browse 6,198,296 50.00%
Total # Dealer Transactions 12,397,220
Total # Manufacturing Transactions 8,263,789
Response Times Average Maximum 90th% Reqd
Purchase 0.23 22.91 0.20 2.00
Manage 0.16 36.50 0.30 2.00
Browse 0.32 17.63 0.30 2.00
Manufacturing 1.52 8.68 2.25 5.00
Reproducibility Run (SPECjAppServer2004 JOPS) 5,750.69

Oracle WebLogic Server Standard Edition Release 10.3.3
Vendor: Oracle Corporation Availability: Apr-2010
CTS Version: 5.0 Date Passed CTS: Feb-2007
OS Name: Oracle Enterprise Linux 5 Update 4 x86_64
EJB Protocol: RMI/T3

Oracle JRockit(R) 6.0 JDK (R28.0.0) (Linux x86 64bit)
Vendor: Oracle Corporation Availability: Apr-2010
OS Name: Oracle Enterprise Linux 5 Update 4 x86_64

Java HotSpot(TM) 64-Bit Server VM on Linux, version 1.6.0_17
Vendor: Oracle Corporation Availability: Nov-2009
OS Name: Red Hat Enterprise Linux 5 Update 4 x86_64

Oracle JDBC Driver 11.2.0.1.0 (Thin)
Vendor: Oracle Corporation Availability: Oct-2009
OS Name: Oracle Enterprise Linux 5 Update 4 x86_64

Oracle Database Enterprise Edition Release 11.2.0.1.0
Vendor: Oracle Corporation Availability: Oct-2009
OS Name: Oracle Enterprise Linux 5 Update 4 x86_64

J2EE Application Server
J2EE Product: Oracle WebLogic Server Standard Edition Release 10.3.3
JVM Product: Oracle JRockit(R) 6.0 JDK (R28.0.0) (Linux x86 64bit)
JDBC Product: Oracle JDBC Driver 11.2.0.1.0 (Thin)
Hardware: J2EE Application Server
# of Instances: 8
Interfaces:
Web Interface for the Dealer Domain
Web Interface for the Supplier Domain
EJB Interface for the Dealer Domain
EJB Interface for the Manufacturing Domain
EJB Interface for the Supplier Domain
Notes / Tuning Information 
-showversion -Xlargepages:exitOnFailure=true -Xms3640M -Xmx3640M -Xns1700M -XXaggressive
-Xgc:genpar -XXgcthreads=4 -Xlargepages -Xverbose:opt,gcpause,compaction
-XXCompressedRefs=size=4G -Dweblogic.MuxerClass=weblogic.socket.NIOSocketMuxer
-Dweblogic.SocketReaders=2 -Dweblogic.management.discover=false
-Dweblogic.diagnostics.debug.DebugLogger.DISABLED=true -Doracle.jdbc.defaultRowPrefetch=200
-Djavax.xml.parsers.DocumentBuilderFactory=weblogic.xml.jaxp.RegistryDocumentBuilderFactory

Emulator SW Config
JVM Product: Java HotSpot(TM) 64-Bit Server VM on Linux, version 1.6.0_17
Web Product: Oracle WebLogic Server Standard Edition Release 10.3.3
Hardware: Emulator HW
# of Instances: 1
Notes / Tuning Information 
-Xmx20g -Xms20g -Xmn2g -Xss272k -XX:PermSize=95m -XX:MaxPermSize=512M
-XX:+UseLargePages -XX:+AggressiveOpts -XX:+DisableExplicitGC
-verbosegc -Xloggc:emugc.log -XX:+PrintGCDetails -XX:+PrintGCTimeStamps -XX:+PrintCommandLineFlags
-Dsun.net.inetaddr.ttl=1 -Dnetworkaddress.cache.ttl=1 -Dweblogic.SocketReaders=1
-Dweblogic.management.discover=false
-Djavax.xml.parsers.DocumentBuilderFactory=com.sun.org.apache.xerces.internal.jaxp.DocumentBuilderFactoryImpl

Database SW Config
DB Product: Oracle Database Enterprise Edition Release 11.2.0.1.0
Hardware: Database Server HW
# of Instances: 1
Notes / Tuning Information 
db_name                 = spec
compatible              = 11.2.0.1.0
control_files           = ?/dbs/cntrlspec
aq_tm_processes         = 0
db_4k_cache_size        = 12000M
db_8k_cache_size        = 20000M
db_block_checking       = FALSE
db_block_checksum       = FALSE
db_block_size           = 2048
db_cache_advice         = OFF
db_cache_size           = 45000M
db_file_multiblock_read_count = 128
db_files                = 256
db_keep_cache_size      = 10000M
db_writer_processes     = 8
dml_locks               = 2200
filesystemio_options    = DirectIO
log_buffer              = 67108864
log_checkpoint_interval = 0
log_checkpoints_to_alert= TRUE
open_cursors            = 2000
parallel_max_servers    = 100
pga_aggregate_target    = 0
processes               = 2000
query_rewrite_enabled   = FALSE
replication_dependency_tracking = FALSE
session_cached_cursors  = 2000
sessions                = 2205
shared_pool_size        = 6000M
statistics_level        = BASIC
timed_statistics        = FALSE
trace_enabled           = FALSE
transactions            = 15000
transactions_per_rollback_segment = 1
undo_management         = AUTO
undo_retention          = 180
undo_tablespace         = undo_ts

Driver SW Config Primary and Satellites
JVM Product: Java HotSpot(TM) 64-Bit Server VM on Linux, version 1.6.0_17
Hardware: Primary Driver HW
# of Instances: 3
Notes / Tuning Information 
-server -Xms2048M -Xmx2048M -XX:+DisableExplicitGC -XX:+UseParallelGC
-Dsun.net.inetaddr.ttl=0 -Dnetworkaddress.cache.ttl=0

J2EE Application Server (SUT hardware)
Hardware Vendor: Dell OS Vendor: Oracle Corporation
Model Name: Dell PowerEdge R810 OS Name: Oracle Enterprise Linux 5 Update 4 x86_64
Processor: Eight Core Intel(R) Xeon(R) X7560 Filesystem: ext3
MHz: 2262 Disks: 2x 73GB SAS 15K RPM
# of CPUs: 16 cores, 2 chips, 8 cores/chip, 2 threads/core (Hyper-Threading) Network Interface: 4x Quad Port Gigabit NIC
Memory (MB): 131072 Other Hardware: See notes
L1 Cache: 32KB(I)+32KB(D) on chip per core # of Systems: 1
L2 Cache: 256KB on chip per core H/W Available: Mar-2010
Other Cache: 24MB L3 on chip per chip OS Available: Sep-2009
Notes / Tuning Information 
Added to /etc/sysctl.conf:
fs.file-max = 262144
kernel.sem = 250 32000 100 128
kernel.shmall = 268435456
kernel.shmmax = 137438953472
net.core.netdev_max_backlog = 400000
net.core.optmem_max = 30000000
net.core.rmem_default = 30000000
net.core.rmem_max = 30000000
net.core.somaxconn = 40000
net.core.wmem_default = 30000000
net.core.wmem_max = 30000000
net.ipv4.ip_local_port_range = 1024 65000
net.ipv4.tcp_fin_timeout = 10
net.ipv4.tcp_max_syn_backlog = 30000
net.ipv4.tcp_max_tw_buckets = 2000000
net.ipv4.tcp_mem = 30000000 30000000 30000000
net.ipv4.tcp_rmem = 30000000 30000000 30000000
net.ipv4.tcp_timestamps = 0
net.ipv4.tcp_wmem = 30000000 30000000 30000000
vm.zone_reclaim_mode=1

For each of the NICs:
set arp_announce = 2
set arp_ignore = 1
set txqueuelen 60000
enable tso and gso
bind interrupt to a core corresponding to the server instance

Server instances were started using numactl, binding 4 instances per chip.
Stop iptables.
Stop irqbalance.
Configure 50000 hugepages.

Other hardware:
Dell PERC H700 Integrated RAID Controller

Database Server HW (SUT hardware)
Hardware Vendor: Dell OS Vendor: Oracle Corporation
Model Name: Dell PowerEdge R810 OS Name: Oracle Enterprise Linux 5 Update 4 x86_64
Processor: Eight Core Intel(R) Xeon(R) X6550 Filesystem: ext3
MHz: 2000 Disks: 2x 73GB SAS 15K RPM
# of CPUs: 16 cores, 2 chips, 8 cores/chip, 2 threads/core (Hyper-Threading) Network Interface: 2x Quad Port Gigabit NIC
Memory (MB): 131072 Other Hardware: See notes
L1 Cache: 32KB(I)+32KB(D) on chip per core # of Systems: 1
L2 Cache: 256KB on chip per core H/W Available: Mar-2010
Other Cache: 18MB L3 on chip per chip OS Available: Sep-2009
Notes / Tuning Information 
Added to /etc/sysctl.conf:
fs.aio-max-nr= 1048576
fs.file-max = 6815744
kernel.msgmni = 2878
kernel.sem = 250 32000 100 128
kernel.shmmax = 137438953472
net.core.netdev_max_backlog = 400000
net.core.rmem_default = 30000000
net.core.rmem_max = 30000000
net.core.somaxconn = 15000
net.core.wmem_default = 30000000
net.core.wmem_max = 30000000
net.ipv4.ip_local_port_range = 1024 65000
net.ipv4.tcp_max_syn_backlog = 12000
net.ipv4.tcp_mem = 30000000 30000000 30000000
net.ipv4.tcp_rmem = 30000000 30000000 30000000
net.ipv4.tcp_timestamps = 0
net.ipv4.tcp_wmem = 30000000 30000000 30000000

For each of the NICs used:
set arp_announce = 2
set arp_ignore = 1
set txqueuelen 60000
enable tso and gso

Stop iptables.
Stop irqbalance.
Configure 50000 hugepages.

Lgwr nice priority was set to -20
named nice priority was set to -10
8 Oracle listener processes were started and bound each to 4 Hardware Threads.

Other hardware:
3x Dell PowerVault MD1220 24-Bay Disk Enclosure
72x Dell 146GB 15K RPM SAS Hard Disk
1x Dell PERC H800 SAS RAID Controller

2 enclosures were configured as RAID10 for data
1 enclosure was configured as RAID10 for redo logs

Primary Driver HW (non-SUT hardware)
Hardware Vendor: Dell OS Vendor: Oracle Corporation
Model Name: Dell PowerEdge R900 OS Name: Oracle Enterprise Linux 5 Update 4 x86_64
Processor: Six Core Intel(R) Xeon(R) X7460 Filesystem: ext3
MHz: 2660 Disks: 2x 73GB SAS 15K RPM
# of CPUs: 24 cores, 4 chips, 6 cores/chip Network Interface: 2x Quad Port Gigabit NIC
Memory (MB): 49152 Other Hardware: none
L1 Cache: 32KB(I)+32KB(D) on chip per core # of Systems: 1
L2 Cache: 3x 3MB on chip H/W Available: Sep-2008
Other Cache: 16MB L3 on chip per chip OS Available: Sep-2009
Notes / Tuning Information 
Added to /etc/sysctl.conf:
fs.file-max = 262144
kernel.sem = 250 32000 100 128
net.core.netdev_max_backlog = 400000
net.core.optmem_max = 30000000
net.core.rmem_default = 30000000
net.core.rmem_max = 30000000
net.core.somaxconn = 40000
net.core.wmem_default = 30000000
net.core.wmem_max = 30000000
net.ipv4.ip_local_port_range = 1024 65000
net.ipv4.tcp_fin_timeout = 10
net.ipv4.tcp_max_syn_backlog = 30000
net.ipv4.tcp_max_tw_buckets = 2000000
net.ipv4.tcp_mem = 30000000 30000000 30000000
net.ipv4.tcp_rmem = 30000000 30000000 30000000
net.ipv4.tcp_timestamps = 0
net.ipv4.tcp_wmem = 30000000 30000000 30000000

For each of the NICs used:
set arp_announce = 2
set arp_ignore = 1
set txqueuelen 60000
enable tso and gso

Stop iptables.

Satellite Driver #1 HW (non-SUT hardware)
Hardware Vendor: Dell OS Vendor: Oracle Corporation
Model Name: Dell PowerEdge R905 OS Name: Oracle Enterprise Linux 5 Update 4 x86_64
Processor: Six Core AMD(R) 8425HE Filesystem: ext3
MHz: 2100 Disks: 2x 73GB SAS 15K RPM
# of CPUs: 24 cores, 4 chips, 6 cores/chip Network Interface: 2x Quad Port Gigabit NIC
Memory (MB): 65536 Other Hardware: none
L1 Cache: 64KB(I)+32KB(D) on chip per core # of Systems: 1
L2 Cache: 3072KB on chip H/W Available: Mar-2008
Other Cache: 5MB L3 OS Available: Sep-2009
Notes / Tuning Information 
Added to /etc/sysctl.conf:
fs.file-max = 262144
kernel.sem = 250 32000 100 128
net.core.netdev_max_backlog = 400000
net.core.optmem_max = 30000000
net.core.rmem_default = 30000000
net.core.rmem_max = 30000000
net.core.somaxconn = 40000
net.core.wmem_default = 30000000
net.core.wmem_max = 30000000
net.ipv4.ip_local_port_range = 1024 65000
net.ipv4.tcp_fin_timeout = 10
net.ipv4.tcp_max_syn_backlog = 30000
net.ipv4.tcp_max_tw_buckets = 2000000
net.ipv4.tcp_mem = 30000000 30000000 30000000
net.ipv4.tcp_rmem = 30000000 30000000 30000000
net.ipv4.tcp_timestamps = 0
net.ipv4.tcp_wmem = 30000000 30000000 30000000

For each of the NICs used:
set arp_announce = 2
set arp_ignore = 1
set txqueuelen 60000
enable tso and gso

Stop iptables.

Satellite Driver #2 (non-SUT hardware)
Hardware Vendor: Dell OS Vendor: Oracle Corporation
Model Name: Dell PowerEdge 6850 OS Name: Oracle Enterprise Linux 5 Update 4 x86_64
Processor: Dual Core Intel(R) Xeon(R) 7140 Filesystem: ext3
MHz: 3392 Disks: 2x 73GB SAS 15K RPM
# of CPUs: 8 cores, 4 chips, 2 cores/chip, 2 threads/core (Hyper-Threading) Network Interface: 1x Quad Port Gigabit NIC; 2x Dual Port Gigabit NIC
Memory (MB): 32768 Other Hardware: none
L1 Cache: 12KB(I)+16KB(D) on chip per core # of Systems: 1
L2 Cache: 1024KB on chip per core H/W Available: Aug-2007
Other Cache: 16MB(I+D) L3 on chip per chip OS Available: Sep-2009
Notes / Tuning Information 
Added to /etc/sysctl.conf:
fs.file-max = 262144
kernel.sem = 250 32000 100 128
net.core.netdev_max_backlog = 400000
net.core.optmem_max = 30000000
net.core.rmem_default = 30000000
net.core.rmem_max = 30000000
net.core.somaxconn = 40000
net.core.wmem_default = 30000000
net.core.wmem_max = 30000000
net.ipv4.ip_local_port_range = 1024 65000
net.ipv4.tcp_fin_timeout = 10
net.ipv4.tcp_max_syn_backlog = 30000
net.ipv4.tcp_max_tw_buckets = 2000000
net.ipv4.tcp_mem = 30000000 30000000 30000000
net.ipv4.tcp_rmem = 30000000 30000000 30000000
net.ipv4.tcp_timestamps = 0
net.ipv4.tcp_wmem = 30000000 30000000 30000000

For each of the NICs used:
set arp_announce = 2
set arp_ignore = 1
set txqueuelen 60000
enable tso and gso

Stop iptables.

Emulator HW (non-SUT hardware)
Hardware Vendor: Dell OS Vendor: Oracle Corporation
Model Name: Dell PowerEdge R900 OS Name: Oracle Enterprise Linux 5 Update 4 x86_64
Processor: Quad Core Intel(R) Xeon(R) E7220 Filesystem: ext3
MHz: 2925 Disks: 2x 73GB SAS 15K RPM
# of CPUs: 8 cores, 2 chips, 4 cores/chip Network Interface: 1x Quad Port Gigabit NIC; 2x Dual Port Gigabit NIC
Memory (MB): 32768 Other Hardware: none
L1 Cache: 32KB(I)+32KB(D) on chip per core # of Systems: 1
L2 Cache: 4096KB on chip per core H/W Available: Sep-2008
Other Cache: none OS Available: Sep-2009
Notes / Tuning Information 
Added to /etc/sysctl.conf:
fs.file-max = 262144
kernel.sem = 250 32000 100 128
net.core.netdev_max_backlog = 400000
net.core.optmem_max = 30000000
net.core.rmem_default = 30000000
net.core.rmem_max = 30000000
net.core.somaxconn = 40000
net.core.wmem_default = 30000000
net.core.wmem_max = 30000000
net.ipv4.ip_local_port_range = 1024 65000
net.ipv4.tcp_fin_timeout = 10
net.ipv4.tcp_max_syn_backlog = 30000
net.ipv4.tcp_max_tw_buckets = 2000000
net.ipv4.tcp_mem = 30000000 30000000 30000000
net.ipv4.tcp_rmem = 30000000 30000000 30000000
net.ipv4.tcp_timestamps = 0
net.ipv4.tcp_wmem = 30000000 30000000 30000000

For each of the NICs used:
set arp_announce = 2
set arp_ignore = 1
set txqueuelen 60000
enable tso and gso

Stop iptables.
Configure 12000 huge pages.

Benchmark Modifications
Schema Modifications: 
  Tablespace sizes were increased to support the Injection rate. Table and index
  initrans were modified. The C_CUSTOMERINVENTORY, M_WORKORDER and O_ORDERLINE tables were
  horizontally partitioned. C_CUSTOMER, M_PARTS, M_BOM and M_INVENTORY were hash clustered.
  Table locks were disabled during the run for all the tables using ALTER TABLE DISABLE TABLE LOCK.
  Scripts to create the DB are included in the FDA.
Load Program Modifications: 
  The load program was not modified.

Benchmark Configuration Information
Isolation Requirement Info: 
  The following Beans were deployed in READ_COMMITTED mode as per the benchmark
  requirement:
  Mfg      - AssemblyEnt, BomEnt, ComponentEnt, LargeOrderEnt, PartEnt
  Orders   - ItemEnt
  Supplier - SupplierCompEnt, SupplierEnt
  
  All other beans were deployed using pessimistic locking mode such that all
  selects including finders are issued with a FOR UPDATE clause in select
  statement:
  Corp     - CustomerEnt, CustomerInventoryEnt
  Mfg      - InventoryEnt, WorkOrderEnt
  Orders   - OrderEnt, OrderLineEnt
  Supplier - POEnt, POLineEnt, SComponentEnt
  Util     - SequenceEnt
  
  The ItemEnt bean was cached for 20 minute intervals by setting
  the following in bea-orders.xml deployment descriptor:
  concurrency-strategy to ReadOnly
  read-timeout-seconds to 1200
Durability Requirement Info: 
  To ensure database durability, RAID 10 was used for the data files and redo logs.
  
  The application server used RAID 1 to provide durability for
  server logs and JMS persistence filestores.
  
  The RAID controller on the database and the application server machines were
  configured with Write-Back cache policy supported with battery backup unit on
  the controller.
Storage Requirement Info: 
  A 80 min run at Injection Rate of 3340 increased storage by 6.9 GB.
  Extrapolating for 24 hrs we need 124 GB. The system is configured with
  over 5TB of durable storage.
Argument Passing Semantics: 
  Oracle WebLogic Server Standard Edition uses pass-by-value as required by
  the EJB specification.

Bill of Materials 
Supplier  Description                                   SKU #              Qty
--------  -------------------------------------------   ----------------   ---
Application Server
Dell      PowerEdge 810, 6x 2.5" HD                     224-8088             1 
Dell      2 Eight Core Intel(r) Xeon(r) X7560,          317-3280             1
          8x256KB L2 24MB L3 Cache, 2.26GHz,      
Dell      PERC H700 Intergrated RAID controller         342-0371             1
Dell      128GB, 1066Mhz, Quad Ranked RDIMMS            317-3440             1 
Dell      73GB, SAS, 2.5-inch, 15K RPM Hard Drive       342-0426             2
Intel     Intel Pro 1000PT Quad Port Gigabit NIC        430-2688             3
Dell      3Yr GOLD ENTERPRISE SUPPORT: 7x24 HW/SW,      984-1519,984-1528    1
          Escalation Mgmt 4hr 7x24 Onsite               310-3785,960-7532
                                                        960-7892,970-3620    


Database Server
Dell      PowerEdge 810, 6x 2.5" HD                     224-8088             1 
Dell      2 Eight Core Intel(r) Xeon(r) X6550,          317-8535             1
          8x256KB L2 18MB L3 Cache, 2.00GHz,      
Dell      PERC H700 Intergrated RAID controller         342-0371             1                 
Dell      128GB 1066Mhz, Quad Ranked RDIMMS             317-3440             1
Dell      73GB, SAS, 2.5-inch, 15K RPM Hard Drive       342-0426             2
Intel     Intel Pro 1000PT Quad Port Gigabit NIC        430-2688             1
Dell      PowerVault MD1220 24-Bay Disk Enclosure       224-7093             3
Dell      146GB,6GBps,SAS,2.5-inch,15K                  341-9889            72
Dell      PERC H800 SAS RAID Controller                 342-0368             3
Dell      3Yr GOLD ENTERPRISE SUPPORT: 7x24 HW/SW,      981-3170,981-3752    1
          Escalation Mgmt 4hr 7x24 Onsite               981-3652,981-3692


Oracle    Oracle Enterprise Linux Basic Support for 3 years                  2

Oracle    Oracle Database 11g Enterprise Edition, Per Processor              8*
          Unlimited Users for 3 years                                       
Oracle    Partitioning, Per Processor, Unlimited Users for 3 years           8*
Oracle    Oracle Premium Support for 3 years                                 2

Oracle    Oracle WebLogic Server Standard Edition Release 10.3,              8*
          Per Processor for 3 years                                         
Oracle    Oracle Premium Support for 3 years                                 1


(* 8 = 0.50 * 16)  Explanation:  For the purposes of counting
the number of processors which require licensing, an Intel multicore chip with "n"
cores shall be determined by multiplying "n" cores by a factor of 0.50).

Other Benchmark Information 
  The xerces implementation version 2.8.1 from xml.apache.org was used as it comes
  packaged with Oracle Weblogic Server Standard Edition.
  
  Requests were directed to the Appserver instances using DNS round robin, with
  the database node acting as the DNS server.

General Notes 
On the database, incremental checkpointing ensured that no buffer will remain
dirty (in the cache) for more than the allowed time.

The only errors in the driver error logs are the application errors generated by
this benchmark.

For questions about this result, please contact the submitter: Oracle Corporation
For other inquiries, please contact webmaster@spec.org

Copyright © 2004 Standard Performance Evaluation Corporation

First published at SPEC.org on 03-Jun-2010