The Standard Performance Evaluation Corporation (SPEC) has released a new benchmark suite that measures the performance of clusters running the much-loved - and much-despised - Message-Passing Interface protocols.

SPEC's new MPI2007 serves as a new brand of supercomputing benchmark. The fresh test suite helps distinguish the performance of CPUs, memory, communications interconnect, compilers and the shared file system in clusters. The benchmark ignores other components such as the OS, graphics or I/O system.

"SPEC saw the need within the research and science communities for a standardization benchmark suite based on real MPI applications," said SPEC chairman Kalyan Kumaran. "As with all of our benchmarks, SPEC MPI2007 benefits from SPEC's nearly two decades of experience in establishing source code and data sets, measurement tools, run rules and peer review that help ensure comparable and repeatable results."

The software test has two sets of metrics; one running from the CD without any tuning and a peak metric option, which allows for tuning of compilers and compiler flags to get the best performance. The measurements are normalized against a reference system to produce a "bigger-is-better" metric. The current reference is an eight-node cluster of Celestica A2210 systems with AMD's Opteron processors connected via GigE.

The software supports 32 and 64-bit architectures, and runs on Linux, Unix and Windows. A medium-sized data set in SPEC MPI2007 scales up to 512 processors. SPEC is currently working on larger data sets.

Thus far, AMD, HP, QLogic and SGI have hopped aboard the benchmark test. The results are available at SPEC's website here.

SPEC MPI2007 is available now for $800 on DVD. The new suite joins SPEC's other high performance computing benchmarks, HPC2002; for parallel and distributed architectures, and OMP2001; for shared-memory parallel processing. ®

Related stories

• Start-up rolls out meaty desktop cluster (8 November 2007)

  https://www.theregister.com/2007/11/08/scalable_servers_flexblade/

• SGI fires up fancy NAS for dummies (30 September 2007)

  https://www.theregister.com/2007/09/30/sgi_nexis_nas/

• Forget R&D, Sun buys its Lustre now (12 September 2007)

  https://www.theregister.com/2007/09/12/sun_buys_lustre/

• HP's graphics library goes GPL (6 August 2007)

  https://www.theregister.com/2007/08/06/opensource_library_hp/

• IBM to win $200m supercomputer contract (6 August 2007)

  https://www.theregister.com/2007/08/06/ibm_to_build_200m_supercomputer/

• Supercomputer Wars: IBM vs. Sun vs. Google vs. Quantum Boxes (20 July 2007)

  https://www.theregister.com/2007/07/20/woodlands_scc_episodetwo/

• Blades carve up Top 500 supercomputers list (5 July 2007)

  https://www.theregister.com/2007/07/05/top500_supercomputers_announced/

• Facing up to parallelism (2 July 2007)

  https://www.theregister.com/2007/07/02/smith_parallel_coming/

• HP fires up Multi-Core Aid effort (27 June 2007)

  https://www.theregister.com/2007/06/27/hp_multicore_mop/

• HPC bar goes lower and wider (27 June 2007)

  https://www.theregister.com/2007/06/27/hpc_goes_low/

• Platform dives into Intel's world of clusters (27 June 2007)

  https://www.theregister.com/2007/06/27/cluster_platform/

• HP and Microsoft embrace and extend around HPC (26 June 2007)

  https://www.theregister.com/2007/06/26/ms_hp_hpc/

• Sun's new supercomputer and switch are bigger than yours (26 June 2007)

  https://www.theregister.com/2007/06/26/sun_constellation_supercomputer/