Feeds

IBM taps Red Hat for cut-throat priced Linux on big supers

LoadLeveler replaced by Platform LSF on x86 clusters

High performance access to file storage

Big Blue is going to Red Hat for a Linux environment for its largest supercomputers, and it is mothballing its own LoadLeveler workload manager for x86 clusters in favor of the Platform LSF control freak that it acquired a little more than a year ago.

It is no surprise that IBM has chosen Red Hat Enterprise Linux 6 as the Linux of choice for its massively parallel BlueGene/Q supercomputers and the Power 775 behemoth that was to be the "Blue Waters" machine at the University of Illinois and that is now being positioned as a big data muncher. (Cray eventually got the Blue Waters contract.)

Both RHEL 6 and SUSE Linux Enterprise Server 11 are supported on Power-based machines, so they can in theory both run on these specialized boxes. But IBM and Red Hat got together and tuned up RHEL 6 for the 18-core PowerPC A2 in the BlueGene/Q and the four chip, 32 core Power7 multichip module used in the Power 775 server nodes, exploiting not only their processors and memory but also the proprietary interconnects that these machines both employ to scale out to 100 petaflops in the case of BlueGene/Q and several tens of petaflops with the Power 775s.

IBM and Red Hat are not just getting together to tune up RHEL 6 for these non-standard machines, but have also come up with special per-rack pricing for support contracts for Shadowman's Linux, which are only available through Big Blue.

This special packaging is called RHEL 6 High Performance Computing, appropriately enough, and it is available on half or full racks with BlueGene/Q machines and for each quad-core module in the Power 775 nodes, and contract terms run from two to five years, which is the practical useful life for a capacity-class supercomputer. And it is considerably cheaper than buying RHEL 6 for plain vanilla Power7-based servers, too.

A rack of BlueGene/Q boxes has 32 processor nodes in a node card, 16 node cards in a midplane, and two midplanes in a rack. That is 1,024 nodes in a rack, as you can see here.

A standard subscription to RHEL 6 for a two-socket Power7-based server is $2,700 and for a four-socket server is $5,400, so a single-socket node like that used in the BlueGene/Q system would cost $1,350. So a rack would run you $1.1m per year at list price.

That is nuts, obviously, and no cheapskate HPC shop with people who understand Linux as well as either IBM or Red Hat is going to pay that. But a two-year contract costs only $90,000, or $45,000 per year, or 24.4 times less money as list price for the Power-based machines. (It is $43.95 per node per year.)

If you go all the way to a five-year contract, you can get it for a rack of BlueGene/Q for $225,000, which works out to the same $45,000 per year per rack. So customers are not getting a discount for a longer term contract, as is common given the time value of money. But look at the discount rate off list for RHEL support.

On the Power 775 servers, the special RHEL 6 edition from IBM costs $1,066 for each quad-core module for a two year contract, or $533 per socket per year. That works out to 2.5 times less money per socket than a regular RHEL for Power support contract, and if you normalize it for core counts, it is more like ten times cheaper.

In other HPC software news, IBM has announced that it is going to put all of its weight behind the Platform LSF workload scheduler on x86-based clusters and withdraw its own Tivoli-branded LoadLeveler program for x86-based machines. IBM will sell LoadLeveler for x86-based machines until March 15 of next year and support the software until April 30, 2015.

The LoadLeveler V5 for both AIX and Linux on Power will continue to be sold and supported on Power Systems servers and the variant for the BlueGene/Q will also still be available, too. That said, IBM is telling customers that Platform LSF is the workload scheduler of choice for its System x, PureFlex, and Power Systems clusters and grids, so take that into consideration when you are planning. ®

High performance access to file storage

More from The Register

next story
Seagate brings out 6TB HDD, did not need NO STEENKIN' SHINGLES
Or helium filling either, according to reports
European Court of Justice rips up Data Retention Directive
Rules 'interfering' measure to be 'invalid'
Dropbox defends fantastically badly timed Condoleezza Rice appointment
'Nothing is going to change with Dr. Rice's appointment,' file sharer promises
Cisco reps flog Whiptail's Invicta arrays against EMC and Pure
Storage reseller report reveals who's selling what
Bored with trading oil and gold? Why not flog some CLOUD servers?
Chicago Mercantile Exchange plans cloud spot exchange
Just what could be inside Dropbox's new 'Home For Life'?
Biz apps, messaging, photos, email, more storage – sorry, did you think there would be cake?
IT bods: How long does it take YOU to train up on new tech?
I'll leave my arrays to do the hard work, if you don't mind
prev story

Whitepapers

Mainstay ROI - Does application security pay?
In this whitepaper learn how you and your enterprise might benefit from better software security.
Five 3D headsets to be won!
We were so impressed by the Durovis Dive headset we’ve asked the company to give some away to Reg readers.
3 Big data security analytics techniques
Applying these Big Data security analytics techniques can help you make your business safer by detecting attacks early, before significant damage is done.
The benefits of software based PBX
Why you should break free from your proprietary PBX and how to leverage your existing server hardware.
Mobile application security study
Download this report to see the alarming realities regarding the sheer number of applications vulnerable to attack, as well as the most common and easily addressable vulnerability errors.