SPEC Seal of Reviewal SPECjEnterprise®2010 Result
Copyright © 2009-2013 Standard Performance Evaluation Corporation
Oracle WebLogic Server Standard Edition Release 12.1.1 and Oracle Database 11gR2 on Oracle SPARC T5-8 using Solaris Zones
27,843.57 SPECjEnterprise2010 EjOPS
Submitter:
Oracle Corporation
SPEC license # 73 Test date:
Apr-2013
Software Products
Oracle WebLogic Server Standard Edition Release 12.1.1
Java HotSpot(TM) 64-Bit Server VM on Solaris, version 1.7.0_15
Oracle JDBC Driver 11.2.0.3(Thin)
Oracle Database 11g Enterprise Edition Release 11.2.0.3
Software Configurations
JEE Application Server
Emulator Software Config
Database Software Config
Driver Software Config
Hardware Systems
JEE AppServer & Database Server HW
Load Driver & Emulator HW

System Configuration Diagram

Benchmark
Modifications
Configuration
Bill of Materials
Other Info
General Notes
Full Disclosure Archive

SUT Configuration
JEE Server Nodes: 1   DB Server Nodes: 1
JEE Server CPUs: 64 cores, 4 chips   DB Server CPUs: 64 cores, 4 chips
JEE Instances: 8   DB Instances: 1
Other SUT Components:
    None

Benchmark Settings
Dealer Injection Rate: 17,500   Ramp Up Time: 900 seconds
DB Load Injection Rate: 20,000   Steady State Time: 3,600 seconds
# of Dealer Agents: 175,000   Ramp Down Time: 300 seconds
# of Manufacturing Agents: 52,500  

Detailed Results
Dealer Transaction Mix Count Tx. Mix Failure Count
Purchase 15,811,034 25.00% 5
Manage 15,808,693 25.00% 4
Browse 31,615,727 50.00% 0
Total # Dealer Transactions 63,235,454
Manufacturing Transaction Mix Count Tx. Mix Failure Count
CreateVehicleEJB 18,505,812 50.01% 3,453
CreateVehicleWS 18,495,573 49.99% 3,391
Total # Manufacturing Transactions 37,001,385
Response Times Average Standard Deviation Maximum 90th% Reqd
Purchase 0.311 0.77 13.609 0.710 2.000
Manage 0.181 0.36 15.308 0.410 2.000
Browse 0.390 0.87 9.620 1.110 2.000
CreateVehicleEJB 0.221 0.21 4.780 0.400 5.000
CreateVehicleWS 0.220 0.17 4.185 0.400 5.000
Reproducibility Run (SPECjEnterprise2010 EjOPS) 27,870.51

Oracle WebLogic Server Standard Edition Release 12.1.1
Vendor: Oracle Corporation Availability: Dec-2011
CTS Version: 6.0 Date Passed CTS: Dec-2011
OS Name: Solaris 11.1 64-bit
EJB Protocol: RMI/T3

Java HotSpot(TM) 64-Bit Server VM on Solaris, version 1.7.0_15
Vendor: Oracle Corporation Availability: Feb-2013
OS Name: Solaris 11.1 64-bit

Oracle JDBC Driver 11.2.0.3(Thin)
Vendor: Oracle Corporation Availability: Sep-2011
OS Name: Solaris 11.1 64-bit

Oracle Database 11g Enterprise Edition Release 11.2.0.3
Vendor: Oracle Corporation Availability: Sep-2011
OS Name: Solaris 11.1 64-bit

JEE Application Server
JEE Product: Oracle WebLogic Server Standard Edition Release 12.1.1
JVM Product: Java HotSpot(TM) 64-Bit Server VM on Solaris, version 1.7.0_15
JDBC Product: Oracle JDBC Driver 11.2.0.3(Thin)
Hardware: JEE AppServer & Database Server HW
# of Instances: 8
Interfaces:
Web Interface for the Order Domain
Web Services Interface for the Supplier Domain
EJB Interface for the Manufacturing Domain
Web Services Interface for the Manufacturing Domain
Notes / Tuning Information
JVM Options:
-d64 -server -XX:AllocatePrefetchDistance=256 -XX:AllocatePrefetchStyle=1
-Xms12g -Xmx12g -Xmn6g -Xss256k -XX:MaxPermSize=256m -XX:+AggressiveOpts
-XX:+UseParallelGC -XX:ParallelGCThreads=24 -verbose:gc -XX:+PrintGCDetails
-XX:+PrintGCTimeStamps -XX:-TraceClassUnloading -XX:+UseParallelOldGC
-XX:ReservedCodeCacheSize=64m -XX:CICompilerCount=8 -XX:+UseCompressedOops
-XX:-UseBiasedLocking -XX:+AlwaysPreTouch -XX:InitialSurvivorRatio=4
-XX:SurvivorRatio=4 -XX:TargetSurvivorRatio=90 -XX:-UseAdaptiveSizePolicy
-XX:LargePageSizeInBytes=2g
-Dweblogic.SocketReaders=16 -Dweblogic.diagnostics.debug.DebugLogger.DISABLED=true
-Doracle.jdbc.defaultRowPrefetch=200 -Dweblogic.management.discover=false
-Dweblogic.llr.table.specjds=wl_llr_jent31
-Djavax.xml.parsers.DocumentBuilderFactory=weblogic.xml.jaxp.RegistryDocumentBuilderFactory
-Dweblogic.threadpool.MinPoolSize=30 -Dsun.net.inetaddr.ttl=0 -Dnetworkaddress.cache.ttl=0
-Dcom.sun.xml.ws.spi.db.BindingContextFactory=com.sun.xml.ws.db.glassfish.JAXBRIContextFactory
-Djavax.xml.bind.JAXBContext=com.sun.xml.bind.v2.ContextFactory

Java process started in FX class using /usr/bin/priocntl -e -c FX
Java process started with LD_PRELOAD_64=/usr/lib/sparcv9/libumem.so

Emulator Software Config
JEE Product: Oracle WebLogic Server Standard Edition Release 12.1.1
JVM Product: Java HotSpot(TM) 64-Bit Server VM on Solaris, version 1.7.0_15
Hardware: Load Driver & Emulator HW
# of Instances: 8
Notes / Tuning Information
JVM Options:
-d64 -server -Xms20g -Xmx20g -Xmn3g -Xss256k -XX:+AggressiveOpts
-XX:+UseParallelGC -XX:ParallelGCThreads=32 -XX:LargePageSizeInBytes=4m
-verbose:gc -XX:+PrintGCDetails -XX:+PrintGCTimeStamps -XX:-TraceClassUnloading
-XX:PermSize=256m -XX:MaxPermSize=512M -XX:+UseCompressedOops
-Dsun.net.inetaddr.ttl=0 -Dnetworkaddress.cache.ttl=0 -Dhttp.keepAliveCache.lifeTime=600000
-Dweblogic.management.discover=false -Dweblogic.SocketReaders=1
-Dweblogic.diagnostics.debug.DebugLogger.DISABLED=true

Java process started in FX class using /usr/bin/priocntl -e -c FX
Java process started with LD_PRELOAD_64=/usr/lib/amd64/libumem.so


Database Software Config
DB Product: Oracle Database 11g Enterprise Edition Release 11.2.0.3
Hardware: JEE AppServer & Database Server HW
# of Instances: 1
Character Set: US7ASCII
Notes / Tuning Information
Database Options:

db_name                         = spec
control_files                   = ?/dbs/cntrlspec
cpu_count                       = 128
aq_tm_processes                 = 0
compatible                      = 11.2.0.3.0.0
db_block_size                   = 2048
db_block_checksum               = FALSE
db_block_checking               = FALSE
db_cache_size                   = 14G
db_cache_advice                 = off
db_4k_cache_size                = 10G
db_8k_cache_size                = 4G
db_keep_cache_size              = 10G
db_recycle_cache_size           = 1G
db_file_multiblock_read_count   = 128
db_files                        = 256
db_writer_processes             = 32
deferred_segment_creation       = false
ddl_lock_timeout                = 30
disk_asynch_io                  = TRUE
dml_locks                       = 1000
filesystemio_options            = setall
log_buffer                      = 100663296
log_checkpoint_interval         = 0
log_checkpoints_to_alert        = TRUE
open_cursors                    = 2400
parallel_max_servers            = 100
processes                       = 8000
query_rewrite_enabled           = FALSE
replication_dependency_tracking = FALSE
sessions                        = 12000
shared_pool_size                = 16G
statistics_level                = BASIC
timed_statistics                = false
trace_enabled                   = false
transactions                    = 12000
transactions_per_rollback_segment = 1
undo_management                 = AUTO
undo_retention                  = 600
undo_tablespace                 = undo_ts

Oracle database processes runs in the FX class using the command
/usr/bin/priocntl -s -c FX -i pid PID
Oracle Log Writer run in a single core by executing
in FX class at priority 60 using the command
/usr/bin/priocntl -s -c FX -p 60 -m 60 -i pid PID
The four database listener processes run in separate locality groups using the command
/usr/bin/plgrp -I future -A LGROUP/strong PID
The database container was configured with four virtual NICS
connected to 4 virtual switches for access by the application servers.
The Solaris 11.1 container and resource pool configuration is in FDA/Config/Containers/.

Driver Software Config
JVM Product: Java HotSpot(TM) 64-Bit Server VM on Solaris, version 1.7.0_15
Hardware: Load Driver & Emulator HW
# of Instances: 18
Notes / Tuning Information
JVM Options
-d64 -server -Xms6400M -Xmx6400M -Xss256k -Dsun.net.inetaddr.ttl=0
-Dnetworkaddress.cache.ttl=0 -Djava.net.preferIPv4Stack=true -verbosegc
-Dhttp.keepAliveCache.lifeTime=600000 -XX:+PrintFlagsFinal
-Dcom.sun.xml.ws.spi.db.BindingContextFactory=com.sun.xml.ws.db.glassfish.JAXBRIContextFactory
-Djavax.xml.bind.JAXBContext=com.sun.xml.bind.v2.ContextFactory


JEE AppServer & Database Server HW (SUT hardware)
Hardware Vendor: Oracle Corporation OS Vendor: Oracle Corporation
Model Name: SPARC T5-8 OS Name: Oracle Solaris 11.1 64-bit SRU 4.5
Processor: SPARC T5 Filesystem: ZFS
MHz: 3600 Disks: 4x 300GB 10K RPM SAS, 4x 100GB SDD
# of CPUs: 128 cores, 8 chips, 16 cores/chip (128 HW threads/chip) Network Interface: 5x 10 Gbit dual-port NICs
Memory (MB): 2097152 Other Hardware:
DIMM[0] Count: 128 DIMM[0] Size: 16384
L1 Cache: 16KB(I)+16KB(D) per core # of Systems: 1
L2 Cache: 128 KB (I+D) per core H/W Available: Mar-2013
Other Cache: 8 MB (I+D) per chip OS Available: Feb-2013
Notes / Tuning Information
Tuning in /etc/system:
set autoup = 345600
set plat_disable_mempm = 1
set lpg_alloc_prefer = 1
set lgrp_mem_pset_aware = 1

Network Tuning:
ndd -set /dev/tcp tcp_conn_req_max_q 40000
ndd -set /dev/tcp tcp_conn_req_max_q0 40000
ndd -set /dev/tcp tcp_xmit_hiwat 524288
ndd -set /dev/tcp tcp_recv_hiwat 524288
ndd -set /dev/tcp tcp_smallest_anon_port 4096
ndd -set /dev/tcp tcp_naglim_def 1
ndd -set /dev/tcp tcp_time_wait_interval 10000
ndd -set /dev/tcp tcp_fin_wait_2_flush_interval 10000
ndd -set /dev/udp udp_recv_hiwat 2097152
ndd -set /dev/udp udp_xmit_hiwat 2097152
Tuning in /kernel/drv/ixgbe.conf:
ixgbe: intr_throttling=3000

Configuration Notes:
8 application server instances were hosted in 8 separate Solaris Containers
configured using 8x Solaris 11.1 Resource Pools bound to 4 cpu chips (64 cores).
Oracle database runs in a Solaris Container bound to a resource pool configured on 4 cpu chips (64 cores).

External Disk configuration:
6x Sun Server X3-2L each configured with 4x F40 Flash PCI Cards
and COMSTAR software used for database files.
2x 2540 M2 Storage Arrays  each configured with 12x 600GB disks and
2x RAID controllers
The COMSTAR configuration for the database files is in FDA/Schema/SVM.

Stop intrd.
Solaris 11.1 Support Repository Update 4.5


Load Driver & Emulator HW (non-SUT hardware)
Hardware Vendor: Oracle Corporation OS Vendor: Oracle Corporation
Model Name: Sun Fire X4170 M2 OS Name: Solaris 10 9/10 64-bit
Processor: Intel Xeon X5670 Filesystem: UFS
MHz: 2930 Disks: 2 x 146GB 15K RPM SAS
# of CPUs: 12 cores, 2 chips, 6 cores/chip (2 threads/core) Network Interface: 1x 10 Gbit NIC
Memory (MB): 98304 Other Hardware: none
L1 Cache: 32KB(I)+32KB(D) per core # of Systems: 22
L2 Cache: 256KB per core H/W Available: Jul-2010
Other Cache: 8 MB I+D L3 on chip per chip OS Available: Sep-2010
Notes / Tuning Information
Tuning in /etc/system:
set ddi_msix_alloc_limit=8
set ip:ip_soft_rings_cnt=16
Network Tuning:
ndd -set /dev/tcp tcp_conn_req_max_q 40000
ndd -set /dev/tcp tcp_conn_req_max_q0 40000
ndd -set /dev/tcp tcp_xmit_hiwat 524288
ndd -set /dev/tcp tcp_recv_hiwat 524288
ndd -set /dev/tcp tcp_smallest_anon_port 4096
ndd -set /dev/tcp tcp_naglim_def 1
ndd -set /dev/tcp tcp_time_wait_interval 10000
Configuration Notes:
18 Driver instances ran on 18 systems.
8 Emulator instances ran on 4 systems.


Benchmark Modifications
Schema Modifications:
  Tablespace sizes were increased to support the Injection rate.
  Scripts to create the DB are included in the FDA.
  Table and index initrans were modified.
  Table M_WORKORDER, O_CUSTINVENTORY, O_CUSTOMER, O_ORDERLINE and O_ORDERS were horizontally partitioned.
  Table M_BOM, M_INVENTORY and M_PARTS were hash clustered.
  System managed undo was used.
Load Program Modifications:
  No modifications to the load programs were made.

Benchmark Configuration Information
Isolation Requirement Info:
  The ItemEnt bean was cached for 20 minute intervals by setting:
  eclipselink.query-results-cache.expiry=1200000
  in the ord-orm.xml deployment descriptor.
  
  The benchmark meets the isolation level requirements by
  version column checking on entities against
  the database.
Durability Requirement Info:
  To ensure database durability, RAID 1 was used for the
  database files and database redo logs maintained
  on the Sun Server 3X-2L storage servers and 2540 M2 arrays.
  
  The application server system was configured with 4
  mirrored SSDs for jms and server logs.
Storage Requirement Info:
  An 80 minute run at an injection rate of 17500 increased storage by 46 GB
  This extrapolates to 828 GB storage for a 24 hour run.
  The database was configured with 11.6 TB of mirrored storage.
  

Bill of Materials
Supplier  Description                                   Product #          Qty
--------  -------------------------------------------   ----------------   ---
Application & Database Server:
Oracle    SPARC T5-8 Server, Base Chassis               7104192             1
Oracle    SPARC T5 Processor Module 2xT5 16C 3.6GHz	7104194		    4
Oracle    16GB DDR3 Memory DIMM				7104198		  128
Oracle    300 GB 10K RPM SAS HDD                        7105211		    4
Oracle    100 GB SSD                                    7101422             4
Oracle    8GB PCI-E Dual FC/GbE Host Adapter            SG-PCIE2FC-EM8-Z    6
Oracle    10GBE Dual Port SFP+                          1109A-Z             5
Oracle    10 GigE Dual Rate SFP+ SR Transceiver, MMF    2129A              10
Oracle    Power Cord: North America, 4 meter		SELY9P11Z	    4

Storage Servers:
Oracle    Sun Server X3-2L, base chassis                7102750		    6
Oracle    12 Slot Disk cage                             7102743             6
Oracle    2.4 Ghz Intel Xeon E5-2609                    7100604            12
Oracle    8 GB DIMM DDR3                                7100790            12
Oracle    600 GB 10K RPM SAS HDD                        XRA-SS2CF-600G10K2 12
Oracle    Sun Storage 6 Gb SAS PCIe HBA                 SGX-SAS6-INT-Z      6
Oracle    Sun StorageTek 8 Gb FC PCIe HBA               SG-PCIE2FC-EM8-N    6
Oracle    Sun Flash Accelerator F40 PCIe Card		7104482		   24
Oracle    Power Cords - 2.5m				333A-25-15-NEMA	   12
Oracle    Solaris 11.1                                  7100734             1

Oracle    Sun Storage 2540-M2 Array			7100183		    2
Oracle    AC Power Supply   		                7100021		    4
Oracle    600 GB 15K RPM SAS2 HDD			7100415		   24
Oracle    Power Cords - 2.5m				333A-25-15-NEMA	    4

Oracle    Oracle Premier Support for Systems 3 years    Q-PREM-SPRT-SYS     1

Oracle    Oracle Database 11gR2 Enterprise Edition
-         Per Processor for 3 years (for 32 processors)                    32*
Oracle    Oracle Partitioning
-         Per Processor for 3 years (for 32 processors)                    32*
Oracle    Oracle Premium Support for 3 years                                2

Oracle    Oracle WebLogic Server Standard Edition Release 12.1.1
-         Per Processor for 3 years (for 32 processors)                    32*
Oracle    Oracle Premium Support for 3 years                                1

(* 32 = 0.5 * 64) Explanation:  For the purposes of counting
the number of processors which require licensing, a multicore chip with 'n' core
shall be determined by multiplying 'n' cores by a factor of 0.5.



Other Benchmark Information
  DNS round robin load balancing was used with the DNS server running
  on the application/database server. The DNS named processes
  was run in the RT class using /usr/bin/priocntl -s -c RT -p 1 -i pid.
  All network connections were 10 Gbit.
  

General Notes
The only errors in the driver log files were those that are
normally generated by this benchmark.

On the database, incremental checkpointing ensured that no buffer will
remain dirty (in the cache) for more than the allowed time.



For questions about this result, please contact the submitter: Oracle Corporation
For other inquiries, please contact webmaster@spec.org

Copyright © 2009-2013 Standard Performance Evaluation Corporation

First published at SPEC.org on 01-May-2013