| MPI2007 license: | 13 | Test date: | Feb-2012 |
|---|---|---|---|
| Test sponsor: | Intel Corporation | Hardware Availability: | Mar-2012 |
| Tested by: | Pavel Shelepugin | Software Availability: | Sep-2011 |
| Benchmark | Base | Peak | ||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Ranks | Seconds | Ratio | Seconds | Ratio | Seconds | Ratio | Ranks | Seconds | Ratio | Seconds | Ratio | Seconds | Ratio | |
| Results appear in the order in which they were run. Bold underlined text indicates a median measurement. | ||||||||||||||
| 104.milc | 256 | 41.6 | 37.6 | 35.2 | 44.5 | 35.4 | 44.2 | |||||||
| 107.leslie3d | 256 | 129 | 40.4 | 129 | 40.4 | 129 | 40.4 | |||||||
| 113.GemsFDTD | 256 | 211 | 29.9 | 211 | 29.9 | 212 | 29.7 | |||||||
| 115.fds4 | 256 | 26.7 | 73.0 | 26.7 | 73.1 | 28.2 | 69.3 | |||||||
| 121.pop2 | 256 | 270 | 15.3 | 271 | 15.2 | 271 | 15.3 | |||||||
| 122.tachyon | 256 | 63.8 | 43.9 | 63.5 | 44.1 | 63.7 | 43.9 | |||||||
| 126.lammps | 256 | 120 | 24.2 | 121 | 24.1 | 121 | 24.2 | |||||||
| 127.wrf2 | 256 | 97.0 | 80.4 | 95.2 | 81.9 | 95.0 | 82.0 | |||||||
| 128.GAPgeofem | 256 | 35.0 | 59.0 | 34.8 | 59.3 | 34.9 | 59.2 | |||||||
| 129.tera_tf | 256 | 70.3 | 39.4 | 70.3 | 39.4 | 70.2 | 39.4 | |||||||
| 130.socorro | 256 | 64.1 | 59.6 | 63.8 | 59.8 | 66.4 | 57.5 | |||||||
| 132.zeusmp2 | 256 | 53.8 | 57.6 | 53.6 | 57.9 | 54.0 | 57.4 | |||||||
| 137.lu | 256 | 49.2 | 74.8 | 50.9 | 72.2 | 49.4 | 74.4 | |||||||
| Hardware Summary | |
|---|---|
| Type of System: | Homogeneous |
| Compute Node: | Endeavor Node |
| Interconnects: | IB Switch Gigabit Ethernet |
| File Server Node: | NFS |
| Total Compute Nodes: | 16 |
| Total Chips: | 32 |
| Total Cores: | 256 |
| Total Threads: | 512 |
| Total Memory: | 1 TB |
| Base Ranks Run: | 256 |
| Minimum Peak Ranks: | -- |
| Maximum Peak Ranks: | -- |
| Software Summary | |
|---|---|
| C Compiler: | Intel C++ Composer XE 2011 for Linux, Version 12.0.5.220 Build 20110719 |
| C++ Compiler: | Intel C++ Composer XE 2011 for Linux, Version 12.0.5.220 Build 20110719 |
| Fortran Compiler: | Intel Fortran Composer XE 2011 for Linux, Version 12.0.5.220 Build 20110719 |
| Base Pointers: | 64-bit |
| Peak Pointers: | 64-bit |
| MPI Library: | Intel MPI Library 4.0.3.008 for Linux |
| Other MPI Info: | None |
| Pre-processors: | No |
| Other Software: | None |
| Hardware | |
|---|---|
| Number of nodes: | 16 |
| Uses of the node: | compute |
| Vendor: | Intel |
| Model: | R1208GLBPP |
| CPU Name: | Intel Xeon E5-2670 |
| CPU(s) orderable: | 1-2 chips |
| Chips enabled: | 2 |
| Cores enabled: | 16 |
| Cores per chip: | 8 |
| Threads per core: | 2 |
| CPU Characteristics: | Intel Turbo Boost Technology up to 3.3 GHz, 8.0 GT/s QPI, Hyper-Threading enabled |
| CPU MHz: | 2600 |
| Primary Cache: | 32 KB I + 32 KB D on chip per core |
| Secondary Cache: | 256 KB I+D on chip per core |
| L3 Cache: | 20 MB I+D on chip per chip, 20 MB shared / 8 cores |
| Other Cache: | None |
| Memory: | 64 GB (8 x 8 GB 2Rx4 PC3-12800R, ECC, running at 1333MHz and CL9) |
| Disk Subsystem: | Seagate 600 GB SSD ST9600205SS |
| Other Hardware: | None |
| Adapter: | Intel (ESB2) 82575EB Dual-Port Gigabit Ethernet Controller |
| Number of Adapters: | 1 |
| Slot Type: | PCI-Express x8 |
| Data Rate: | 1Gbps Ethernet |
| Ports Used: | 2 |
| Interconnect Type: | Ethernet |
| Adapter: | Mellanox MHQH29-XTC |
| Number of Adapters: | 1 |
| Slot Type: | PCIe x8 Gen2 |
| Data Rate: | InfiniBand 4x QDR |
| Ports Used: | 1 |
| Interconnect Type: | InfiniBand |
| Software | |
|---|---|
| Adapter: | Intel (ESB2) 82575EB Dual-Port Gigabit Ethernet Controller |
| Adapter Driver: | e1000 |
| Adapter Firmware: | None |
| Adapter: | Mellanox MHQH29-XTC |
| Adapter Driver: | OFED 1.5.3.1 |
| Adapter Firmware: | 2.10.0 |
| Operating System: | Red Hat EL 6.1, kernel 2.6.32-131 |
| Local File System: | Linux/ext2 |
| Shared File System: | NFS |
| System State: | Multi-User |
| Other Software: | Platform LSF 8.0 |
| Hardware | |
|---|---|
| Number of nodes: | 1 |
| Uses of the node: | fileserver |
| Vendor: | Intel |
| Model: | S7000FC4UR |
| CPU Name: | Intel Xeon CPU |
| CPU(s) orderable: | 1-4 chips |
| Chips enabled: | 4 |
| Cores enabled: | 16 |
| Cores per chip: | 4 |
| Threads per core: | 2 |
| CPU Characteristics: | -- |
| CPU MHz: | 2926 |
| Primary Cache: | 32 KB I + 32 KB D on chip per core |
| Secondary Cache: | 8 MB I+D on chip per chip, 4 MB shared / 2 cores |
| L3 Cache: | None |
| Other Cache: | None |
| Memory: | 64 GB |
| Disk Subsystem: | 8 disks, 500GB/disk, 2.7TB total |
| Other Hardware: | None |
| Adapter: | Intel 82563GB Dual-Port Gigabit Ethernet Controller |
| Number of Adapters: | 1 |
| Slot Type: | PCI-Express x8 |
| Data Rate: | 1Gbps Ethernet |
| Ports Used: | 1 |
| Interconnect Type: | Ethernet |
| Software | |
|---|---|
| Adapter: | Intel 82563GB Dual-Port Gigabit Ethernet Controller |
| Adapter Driver: | e1000e |
| Adapter Firmware: | N/A |
| Operating System: | RedHat EL 5 Update 4 |
| Local File System: | None |
| Shared File System: | NFS |
| System State: | Multi-User |
| Other Software: | None |
| Hardware | |
|---|---|
| Vendor: | Mellanox |
| Model: | Mellanox MTS3600Q-1UNC |
| Switch Model: | Mellanox MTS3600Q-1UNC |
| Number of Switches: | 46 |
| Number of Ports: | 36 |
| Data Rate: | InfiniBand 4x QDR |
| Firmware: | 7.2.0 |
| Topology: | Fat tree |
| Primary Use: | MPI traffic |
| Hardware | |
|---|---|
| Vendor: | Force10 Networks |
| Model: | Force10 S50, Force10 C300 |
| Switch Model: | Force10 S50, Force10 C300 |
| Number of Switches: | 15 |
| Number of Ports: | 48 |
| Data Rate: | 1Gbps Ethernet, 10Gbps Ethernet |
| Firmware: | 8.2.1.0 |
| Topology: | Fat tree |
| Primary Use: | Cluster File System |
The config file option 'submit' was used.
130.socorro (base): "nullify_ptrs" src.alt was used. MPI startup command: mpiexec.hydra command was used to start MPI jobs. BIOS settings: Intel Hyper-Threading Technology (SMT): Enabled (default is Enabled) Intel Turbo Boost Technology (Turbo) : Enabled (default is Enabled) RAM configuration: Compute nodes have 2x8-GB RDIMM on each memory channel. Network: Forty six 36-port switches: 18 core switches and 28 leaf switches. Each leaf has one link to each core. Remaining 18 ports on 25 of 28 leafs are used for compute nodes. On the remaining 3 leafs the ports are used for FS nodes and other peripherals. Job placement: Each MPI job was assigned to a topologically compact set of nodes, i.e. the minimal needed number of leaf switches was used for each job: 1 switch for 16/32/64/128/256 ranks, 2 switches for 512 ranks, 4 switches for 1024 ranks, 8 switches for 2048 ranks. Platform LSF was used for job submission. It has no impact on performance. Information can be found at: http://www.platform.com
| mpiicc |
| 126.lammps: | mpiicpc |
| mpiifort |
| mpiicc mpiifort |
| 121.pop2: | -DSPEC_MPI_CASE_FLAG |
| 126.lammps: | -DMPICH_IGNORE_CXX_SEEK |
| 127.wrf2: | -DSPEC_MPI_CASE_FLAG -DSPEC_MPI_LINUX |