SPEC Seal of Reviewal SPECjEnterprise®2010 Result
Copyright © 2009-2015 Standard Performance Evaluation Corporation
Oracle WebLogic Server Standard Edition Release 12.1.3 on Oracle Server X5-2
21,504.30 SPECjEnterprise2010 EjOPS
Submitter:
Oracle Corporation
SPEC license # 73 Test date:
Mar-2015
Software Products
Oracle WebLogic Server Standard Edition Release 12.1.3
Java HotSpot(TM) 64-Bit Server VM on Linux, version 1.8.0_40
Oracle JDBC Driver 12.1.0.2(Thin)
Oracle Database 12c Enterprise Edition Release 12.1.0.2
Oracle Grid Infrastructure 12c Release 12.1.0.2
Software Configurations
Java EE Application Server
Emulator Software Config
Database Software Config
Driver Software Config
Hardware Systems
Java EE AppServer HW
Database Server HW
Load Driver & Emulator HW

System Configuration Diagram

Benchmark
Modifications
Configuration
Bill of Materials
Other Info
General Notes
Full Disclosure Archive

SUT Configuration
JEE Server Nodes: 1   DB Server Nodes: 1
JEE Server CPUs: 36 cores, 2 chips   DB Server CPUs: 36 cores, 2 chips
JEE Instances: 4   DB Instances: 1
Other SUT Components:
   

Benchmark Settings
Dealer Injection Rate: 13,500   Ramp Up Time: 600 seconds
DB Load Injection Rate: 20,000   Steady State Time: 3,600 seconds
# of Dealer Agents: 135,000   Ramp Down Time: 300 seconds
# of Manufacturing Agents: 40,500  

Detailed Results
Dealer Transaction Mix Count Tx. Mix Failure Count
Purchase 12,229,040 25.00% 1
Manage 12,228,867 25.00% 7
Browse 24,464,433 50.01% 0
Total # Dealer Transactions 48,922,340
Manufacturing Transaction Mix Count Tx. Mix Failure Count
CreateVehicleEJB 14,245,237 50.00% 1,697
CreateVehicleWS 14,247,886 50.00% 1,666
Total # Manufacturing Transactions 28,493,123
Response Times Average Standard Deviation Maximum 90th% Reqd
Purchase 0.064 0.08 4.338 0.130 2.000
Manage 0.046 0.05 4.157 0.090 2.000
Browse 0.077 0.09 3.564 0.150 2.000
CreateVehicleEJB 0.268 0.19 6.762 0.450 5.000
CreateVehicleWS 0.258 0.11 1.955 0.425 5.000
Reproducibility Run (SPECjEnterprise2010 EjOPS) 21,509.68

Oracle WebLogic Server Standard Edition Release 12.1.3
Vendor: Oracle Corporation Availability: Jun-2015
CTS Version: 6.0 Date Passed CTS: Jul-2013
OS Name: Oracle Linux 6 Update 5 x86_64
EJB Protocol: RMI/T3

Java HotSpot(TM) 64-Bit Server VM on Linux, version 1.8.0_40
Vendor: Oracle Corporation Availability: Mar-2015
OS Name: Oracle Linux 6 Update 5 x86_64

Oracle JDBC Driver 12.1.0.2(Thin)
Vendor: Oracle Corporation Availability: Jul-2014
OS Name: Oracle Linux 6 Update 5 x86_64

Oracle Database 12c Enterprise Edition Release 12.1.0.2
Vendor: Oracle Corporation Availability: Jul-2014
OS Name: Oracle Linux 6 Update 5 x86_64

Oracle Grid Infrastructure 12c Release 12.1.0.2
Vendor: Oracle Corporation Availability: Jul-2014
Description: Grid Infrastructure for Automatic Storage Management (ASM)

Java EE Application Server
JEE Product: Oracle WebLogic Server Standard Edition Release 12.1.3
JVM Product: Java HotSpot(TM) 64-Bit Server VM on Linux, version 1.8.0_40
JDBC Product: Oracle JDBC Driver 12.1.0.2(Thin)
Hardware: Java EE AppServer HW
# of Instances: 4
Interfaces:
Web Interface for the Order Domain
Web Services Interface for the Supplier Domain
EJB Interface for the Manufacturing Domain
Web Services Interface for the Manufacturing Domain
Notes / Tuning Information
JVM Options:
-server -Xms18g -Xmx18g -Xmn16g -Xss256k -XX:MetaspaceSize=200M -XX:+AggressiveOpts
-XX:+UseParallelOldGC -XX:ParallelGCThreads=9 -verbose:gc -XX:+PrintGCDetails -XX:+PrintGCTimeStamps
-XX:InitialCodeCacheSize=200m -XX:ReservedCodeCacheSize=200m -XX:+UseCompressedOops -XX:-UseBiasedLocking
-XX:+AlwaysPreTouch -XX:InitialSurvivorRatio=24 -XX:SurvivorRatio=24 -XX:TargetSurvivorRatio=90
-XX:-UseAdaptiveSizePolicy -XX:+UseLargePages -Djava.net.preferIPv4Stack=true
-Djaxws.transport.streaming=true -XX:-TieredCompilation -Dweblogic.ProductionModeEnabled=true
-Dweblogic.management.discover=false -Dweblogic.diagnostics.debug.DebugLogger.DISABLED=true
-Doracle.jdbc.defaultRowPrefetch=200
-Djavax.xml.parsers.DocumentBuilderFactory=weblogic.xml.jaxp.RegistryDocumentBuilderFactory
-Dweblogic.threadpool.MinPoolSize=30 -Dsun.net.inetaddr.ttl=0 -Dnetworkaddress.cache.ttl=0
-Dcom.sun.xml.ws.spi.db.BindingContextFactory=com.sun.xml.ws.db.glassfish.JAXBRIContextFactory
-Djavax.xml.bind.JAXBContext=com.sun.xml.bind.v2.ContextFactory
-Dweblogic.MuxerClass=weblogic.socket.NIOSocketMuxer -Dweblogic.SocketReaders=2

Server instances were started using numactl binding 1 instance per 9 cores.

Oracle patch for WebLogic Server Standard Edition 12.1.3 20720853.

Emulator Software Config
JEE Product: Oracle WebLogic Server Standard Edition Release 12.1.3
JVM Product: Java HotSpot(TM) 64-Bit Server VM on Linux, version 1.8.0_40
Hardware: Load Driver & Emulator HW
# of Instances: 4
Notes / Tuning Information
-showversion -server -Xms10g -Xmx10g -Xmn5g -Xss272k
-XX:MetaspaceSize=200M -XX:+UseLargePages
-XX:+AggressiveOpts -XX:+DisableExplicitGC -verbosegc -Xloggc:emugc.log
-XX:+PrintGCDetails -XX:+PrintGCTimeStamps -XX:+PrintCommandLineFlags
-XX:-TraceClassUnloading -Djava.net.preferIPv4Stack=true
-Dweblogic.MuxerClass=weblogic.socket.NIOSocketMuxer -Dweblogic.SocketReaders=1
-Dhttp.keepAlive=true -Dhttp.keepAliveCache.lifeTime=6000000 -Dweblogic.management.discover=false
-Dweblogic.diagnostics.debug.DebugLogger.DISABLED=true
-Djavax.xml.parsers.DocumentBuilderFactory=weblogic.xml.jaxp.RegistryDocumentBuilderFactory
-Dsun.net.inetaddr.ttl=0 -Dnetworkaddress.cache.ttl=0 -XX:-TieredCompilation

Server instances were started using numactl binding 2 instances per chip.

Database Software Config
DB Product: Oracle Database 12c Enterprise Edition Release 12.1.0.2
Hardware: Database Server HW
# of Instances: 1
Character Set: US7ASCII
Notes / Tuning Information


db_name                       = specdb
control_files                 = +DATA/cntrlspecdb
aq_tm_processes               = 0
compatible                    = 11.2.0
db_block_size                 = 2048
db_block_checking             = FALSE
db_block_checksum             = FALSE
db_cache_size                 = 60G
db_cache_advice               = OFF
db_4k_cache_size              = 10G
db_8k_cache_size              = 4G
db_keep_cache_size            = 6G
db_file_multiblock_read_count = 128
db_files                      = 256
ddl_lock_timeout              = 30
deferred_segment_creation     = false
dml_locks                     = 1000
filesystemio_options          = DirectIO
log_buffer                    = 536870912
log_checkpoint_interval       = 0
log_checkpoints_to_alert      = TRUE
open_cursors                  = 2400
parallel_max_servers          = 100
pga_aggregate_target          = 0
processes                     = 4000
query_rewrite_enabled         = FALSE
replication_dependency_tracking = FALSE
session_cached_cursors        = 8000
sessions                      = 6000
shared_pool_size              = 16G
statistics_level              = BASIC
timed_statistics              = FALSE
trace_enabled                 = FALSE
transactions                  = 6000
transactions_per_rollback_segment = 1
undo_management               = AUTO
undo_retention                = 30
undo_tablespace               = undo_ts

Grid Infrastructure was installed to use Oracle ASM for DATA and LOG disk groups

Driver Software Config
JVM Product: Java HotSpot(TM) 64-Bit Server VM on Linux, version 1.8.0_40
Hardware: Load Driver & Emulator HW
# of Instances: 8
Notes / Tuning Information
-server -Xms3200M -Xmx3200M -Dsun.net.inetaddr.ttl=0 -Dnetworkaddress.cache.ttl=0
-Dhttp.keepAliveCache.lifeTime=600000 -Djava.net.preferIPv4Stack=true -verbosegc
-Dcom.sun.xml.ws.spi.db.BindingContextFactory=com.sun.xml.ws.db.glassfish.JAXBRIContextFactory
-Djavax.xml.bind.JAXBContext=com.sun.xml.bind.v2.ContextFactory

Java EE AppServer HW (SUT hardware)
Hardware Vendor: Oracle Corporation OS Vendor: Oracle Corporation
Model Name: Oracle Server X5-2 OS Name: Oracle Linux 6 Update 5 x86_64
Processor: Intel Xeon processor E5-2699 v3 (Intel Turbo Boost Technology up to 3.6 GHz) Filesystem: ext3
MHz: 2300 Disks: 2x 600GB SAS-2 HDD and 2x 400GB SSD
# of CPUs: 36 cores, 2 chips, 18 cores/chip, 2 threads/core (Hyper-Threading) Network Interface: 4x 10Gbit onboard and 3x 10GBit Dual-port NICs
Memory (MB): 262144 Other Hardware:
DIMM[0] Count: 16 DIMM[0] Size: 16384
L1 Cache: 32KB I + 32KB D on chip per core # of Systems: 1
L2 Cache: 256KB(I+D) on chip, per core H/W Available: Dec-2014
Other Cache: 45MB (I+D) on chip per chip OS Available: Dec-2013
Notes / Tuning Information
BIOS Setting:
COD (Cluster on Die) is enabled in BIOS SW 1.2, with availability date of June 2015.

Added to /etc/sysctl.conf:
kernel.shmall = 10737418240
net.core.netdev_max_backlog = 600000
net.core.optmem_max = 40000000
net.core.rmem_default = 40000000
net.core.rmem_max = 40000000
net.core.somaxconn = 60000
net.core.wmem_default = 40000000
net.core.wmem_max = 40000000
net.ipv4.ip_local_port_range = 1024 65000
net.ipv4.tcp_fin_timeout = 10
net.ipv4.tcp_max_syn_backlog = 60000
net.ipv4.tcp_max_tw_buckets = 2000000
net.ipv4.tcp_mem = 40000000 40000000 40000000
net.ipv4.tcp_rmem = 40000000 40000000 40000000
net.ipv4.tcp_timestamps = 0
net.ipv4.tcp_wmem = 40000000 40000000 40000000
net.ipv6.conf.all.disable_ipv6=1
net.ipv6.conf.default.disable_ipv6=1
net.ipv6.conf.lo.disable_ipv6=1
vm.zone_reclaim_mode=1
vm.nr_hugepages = 60000
vm.hugetlb_shm_group = 502

echo NO_GENTLE_FAIR_SLEEPERS > /sys/kernel/debug/sched_features

For each of the NICs:
set arp_announce = 2
set arp_ignore = 1
set txqueuelen 60000
enable tso and gso
On NICs used for driver and emulator communication:
set rx-usecs 300
On NICs used for database communication:
set rx-usecs 64
Bind interrupt to a core corresponding to the server instance

Server instances were started using numactl binding 2 instance per chip.
Stop iptables.
Stop irqbalance.

Mirrored SSDs were used for JMS and server log files.

Database Server HW (SUT hardware)
Hardware Vendor: Oracle Corporation OS Vendor: Oracle Corporation
Model Name: Oracle Server X5-2 OS Name: Oracle Linux 6 Update 5 x86_64
Processor: Intel Xeon processor E5-2699 v3 (Intel Turbo Boost Technology up to 3.6 GHz) Filesystem: ext3
MHz: 2300 Disks: 2x 300GB SAS-2 HDD, see notes
# of CPUs: 36 cores, 2 chips, 18 cores/chip, 2 threads/core (Hyper-Threading) Network Interface: 4x 10GBit onboard and 2x 10Gbit Dual Port NIC
Memory (MB): 524288 Other Hardware: 1x Sun 16Gb FC Dual Port HBA
DIMM[0] Count: 16 DIMM[0] Size: 32768
L1 Cache: 32KB I + 32KB D on chip per core # of Systems: 1
L2 Cache: 256KB(I+D) on chip, per core H/W Available: Mar-2015
Other Cache: 45MB (I+D) on chip per chip OS Available: Dec-2013
Notes / Tuning Information
Added to /etc/sysctl.conf:
fs.file-max = 6815744
fs.aio-max-nr = 1048576
kernel.shmall = 10737418240
kernel.shmmni = 4096
kernel.sem = 250 32000 100 128
net.core.netdev_max_backlog = 400000
net.core.optmem_max = 30000000
net.core.rmem_default = 30000000
net.core.rmem_max = 30000000
net.core.somaxconn = 40000
net.core.wmem_default = 30000000
net.core.wmem_max = 30000000
net.ipv4.ip_local_port_range = 9000 65535
net.ipv4.tcp_fin_timeout = 10
net.ipv4.tcp_max_syn_backlog = 30000
net.ipv4.tcp_max_tw_buckets = 2000000
net.ipv4.tcp_mem = 30000000 30000000 30000000
net.ipv4.tcp_rmem = 30000000 30000000 30000000
net.ipv4.tcp_timestamps = 0
net.ipv4.tcp_wmem = 30000000 30000000 30000000
net.ipv6.conf.all.disable_ipv6=1
net.ipv6.conf.default.disable_ipv6=1
net.ipv6.conf.lo.disable_ipv6=1
vm.zone_reclaim_mode=1
vm.nr_hugepages = 90000
vm.hugetlb_shm_group = 502

For each of the NICs:
set arp_announce = 2
set arp_ignore = 1
set txqueuelen 60000
enable tso and gso

4 Oracle listener processes were started, 2 processes bound per processor.
Bind each listener's network interrupts to its local processor.
Stop iptables.
Stop irqbalance.

External storage configuration:
1x Oracle Server X5-2L configured with 4x 1.6 TB NVMe PCIe SSDs,
2x 600GB Disks, and 1x Sun 16Gb FC Dual Port HBA for the database files.
1x Oracle Server X5-2L configured with 14x 600 GB disks, 1x Sun 16Gb FC
Dual Port HBA, and onboard PCI HW Raid controller for redo logs.

Load Driver & Emulator HW (non-SUT hardware)
Hardware Vendor: Oracle Corporation OS Vendor: Oracle Corporation
Model Name: Sun Blade X6270 M2 Server Module OS Name: Oracle Linux 5 Update 7 x86_64
Processor: Intel Xeon X5680 Filesystem: ext3
MHz: 3333 Disks: 2 x 146GB 15K RPM SAS
# of CPUs: 12 cores, 2 chips, 6 cores/chip (2 threads/core) Network Interface: 1x 10Gbit NIC
Memory (MB): 73728 Other Hardware: none
L1 Cache: 32KB(I)+32KB(D) per core # of Systems: 9
L2 Cache: 256KB per core H/W Available: Jul-2010
Other Cache: 12 MB I+D L3 on chip per chip OS Available: Jul-2011
Notes / Tuning Information
Added to /etc/sysctl.conf:
fs.file-max = 524288
kernel.shmall = 10737418240
kernel.shmmax = 68719476736
kernel.sem = 250 32000 100 128
net.core.netdev_max_backlog = 400000
net.core.optmem_max = 30000000
net.core.rmem_default = 30000000
net.core.rmem_max = 30000000
net.core.somaxconn = 40000
net.core.wmem_default = 30000000
net.core.wmem_max = 30000000
net.ipv4.ip_local_port_range = 1024 65000
net.ipv4.tcp_fin_timeout = 10
net.ipv4.tcp_max_syn_backlog = 30000
net.ipv4.tcp_max_tw_buckets = 2000000
net.ipv4.tcp_mem = 30000000 30000000 30000000
net.ipv4.tcp_rmem = 30000000 30000000 30000000
net.ipv4.tcp_timestamps = 0
net.ipv4.tcp_wmem = 30000000 30000000 30000000
vm.zone_reclaim_mode=1

For each of the NICs:
set arp_announce = 2
set arp_ignore = 1
set txqueuelen 240000
enable tso and gso

8 Systems were used as drivers, each with 1x 10Gbit NIC.
1 System was used as Emulator, with 1x 10Gbit NIC and configured with 22500 hugepages.

Benchmark Modifications
Schema Modifications:
  Tablespace sizes were increased to support the Injection rate.
  Scripts to create the DB are included in the FDA.
  Table and index initrans were modified.
  Table M_WORKORDER, O_CUSTINVENTORY, O_ORDERLINE and O_ORDERS were horizontally partitioned.
  Table M_BOM, M_INVENTORY and M_PARTS were hash clustered.
  System managed undo was used.
Load Program Modifications:
  The Load program was modified to be able to run on JDK 8.
  Entry 1.8 was added in faban/harness/faban/master/bin/startup.sh, as an appropriate JAVA_VERSION.
  Modified source file is included in the FDA - FDA/Deploy/faban_fix

Benchmark Configuration Information
Isolation Requirement Info:
  The ItemEnt bean was cached for 20 minute intervals by setting:
  eclipselink.query-results-cache.expiry=1200000
  in the ord-orm.xml deployment descriptor.
  
  The benchmark meets the isolation level requirements by
  version column checking on entities against
  the database.
Durability Requirement Info:
  To ensure database durability, RAID 1 was used for the
  database files and database redo logs maintained
  on the two Sun Server X5-2L storage servers.
  
  The application server was configured with 2 SSD drives
  configured with RAID 1 for jms and server logs.
Storage Requirement Info:
  A 75 minute run at an injection rate of 13500 increased storage by 27 GB
  This extrapolates to 518 GB storage for a 24 hour run.
  The database was configured with 4.8 TB of mirrored storage.
  

Bill of Materials
Supplier  Description                                   Product #          Qty
--------  -------------------------------------------   ----------------   ---
Application Server
Oracle	   Oracle Server X5-2: model family	         7110316	     1
Oracle     Oracle Server X5-2: base chassis              7110337             1
Oracle	   2.3GHz Intel 18-Core Xeon E5-2699 v3		 7110346	     2
Oracle	   Heatsink for 1U				 7110350	     2
Oracle	   8 by 2.5'' Disk Cage			 	 7110339	     1
Oracle     16GB DDR4-2133 DIMM				 7110353            16
Oracle	   600GB 10K RPM SAS-2 HDD			 7105213             2
Oracle	   400GB 2.5'' SAS-3 SSD 			 7110932             2
Oracle	   Sun Dual 10 GigE SFP+ PCIe 2.0 NIC		 1109A-Z	     2
Oracle	   10 GigE Dual Rate SFP+ SR Transceiver, MM	 2129A		     4
Oracle     2.5-inch HDD filler panel                     6331A-N             4
Oracle     DVD bay filler panel                          7110359             1
Oracle     Sun Dual Port 10 GbE PCIe 2.0 Adapter         7100563             1
Oracle     Power Cord                                    333V-10-10-C14      2
Oracle     Oracle Linux 6.5                              7105726             1

Database Server
Oracle	   Oracle Server X5-2: model family 	         7110316	     1
Oracle     Oracle Server X5-2: base chassis              7110337             1
Oracle	   2.3GHz Intel 18-Core Xeon E5-2699 v3		 7110346	     2
Oracle	   Heatsink for 1U				 7110350	     2
Oracle	   8 by 2.5'' Disk Cage			         7110339	     1
Oracle     32GB DDR4-2133 DIMM				 7110355	    16
Oracle	   600GB 10K RPM SAS-2 HDD			 7105213             2
Oracle	   Sun Storage 16 Gbit FC PCI-E HBA Dual Port	 7101673             1
Oracle	   Sun Dual 10 GigE SFP+ PCIe 2.0 NIC		 1109A-Z	     1
Oracle	   10 GigE Dual Rate SFP+ SR Transceiver, MM	 2129A		     2
Oracle     Sun Storage 16Gb FC shortwave optics          7101675             1
Oracle     DVD bay filler panel                          7110359             1
Oracle     Sun Dual Port 10 GbE PCIe 2.0 Adapter         7100563             1
Oracle     2.5-inch HDD filler panel                     6331A-N             6
Oracle     Power Cord                                    333V-10-10-C14      2
Oracle     Oracle Linux 6.5                              7105726             1

Storage HW
Oracle     Oracle Server X5-2L: model family             7110317             1
Oracle     Oracle Server X5-2L: base chassis             7110338             1
Oracle     2.4 GHz Intel Xeon E5-2630 v3                 7110349             2
Oracle	   8 by 2.5'' Disk Cage			         7110340	     1
Oracle     Heatsink                                      7110351             2
Oracle     8GB DDR4-2133 DIMM                            7110352             4
Oracle	   600GB 10K RPM SAS-2 HDD			 7105213             2
Oracle	   Sun Storage 16 Gbit FC PCI-E HBA Dual Port	 7101673             1
Oracle     Sun Storage 16Gb FC shortwave optics          7101675             1
Oracle     NVMe PCIe 3.0 Switch Ctlr                     7110357             1
Oracle     1.6 TB NVMe PCIe 3.0 SSD                      7110926             4
Oracle     Filler panel for disk drives                  6331A-N             2
Oracle     DVD bay filler panel                          7110359             1
Oracle     PCIe filler panel                             7102748             3
Oracle     Power Cord                                    333V-10-10-C14      2
Oracle     Oracle Solaris 11.2 SRU 7                     7100734             1

Oracle     Oracle Server X5-2L: model family             7110317             1
Oracle     Oracle Server X5-2L: base chassis             7110338             1
Oracle     24 Slot Disk cage                             7110341             1
Oracle     2.4 GHz Intel Xeon E5-2630 v3                 7110349             2
Oracle     Heatsink                                      7110351             2
Oracle     8GB DDR4-2133 DIMM                            7110352             4
Oracle	   600GB 10K RPM SAS-2 HDD			 7105213            14
Oracle	   Sun Storage 16 Gbit FC PCI-E HBA Dual Port	 7101673             1
Oracle     Sun Storage 16Gb FC shortwave optics          7101675             1
Oracle     Filler panel for disk drives                  6331A-N            12
Oracle     DVD bay filler panel                          7110359             1
Oracle     PCIe filler panel                             7102748             4
Oracle     Power Cord                                    333V-10-10-C14      2
Oracle     Oracle Solaris 11.2 SRU 7                     7100734             1

Oracle     Oracle Premier Support for Systems 3 years    Q-PREM-SPRT-SYS     1

Oracle     Oracle Grid Infrastructure 12c 		 *
Oracle     Oracle Database 12c Enterprise Edition
-          Per Processor for 3 years (for 18 processors)                    18
Oracle     Partitioning, Per Processor for 3 years (for 18 processors)      18
Oracle     Oracle Premium Support for 3 years                                2

Oracle     Oracle WebLogic Server Standard Edition Release 12.1.3
-          Per Processor for 3 years (for 18 processors)                    18
Oracle     Oracle Premium Support for 3 years                                1

* Included with Oracle Database 12c Enterprise Edition



Other Benchmark Information
  DNS round robin load balancing was used. DNS server ran on DB node.
  
  All network connections were 10 Gbps.
  

General Notes
The only errors in the driver log files were those that are
normally generated by this benchmark.

On the database, incremental checkpointing ensured that no buffer will
remain dirty (in the cache) for more than the allowed time.



For questions about this result, please contact the submitter: Oracle Corporation
For other inquiries, please contact webmaster@spec.org

Copyright © 2009-2015 Standard Performance Evaluation Corporation

First published at SPEC.org on 01-Apr-2015