Amazon gooses HPC cloud with Xeon E5s

Passes the Linpack speed test

Boost IT visibility and business value

SC11 Amazon Web Services, the cloud computing unit of the online retailing giant, has been peddling special HPC instances of its EC2 cloud for more than a year now.

This week, in conjunction with the SC11 supercomputing conference in Seattle, the company announced that it has beefed up its HPC cloud with the new Xeon E5 processors from Intel, and has put the new iron through the Linpack paces to get it ranked on the latest Top 500 supercomputers list.

Amazon first came out with its dedicated HPC instances back in July 2010 after recognizing that HPC users needed faster 10 Gigabit Ethernet networking between physically adjacent nodes, and also to have the precise specifications of the nodes available to them so they could properly tune their workloads and get balanced performance across identical nodes. In this case, Amazon networked a bunch of two-socket x86 servers using Intel's quad-core Xeon X5570 chips, which spin at 2.93GHz.

When virtualized, this physical server node, which was called a Cluster Compute Instance, presented 33.5 EC2 compute units and 23GB of virtual memory to HPC applications. Initially, AMD restricted the cluster size to eight nodes, or 64 cores and about 750 gigaflops of peak theoretical performance. (That's a little more than you get in an Nvidia Tesla GPU.) Amazon told El Reg back then that it had tested an 880 server subcluster internally and delivered 41.82 teraflops of oomph sustained on the Linpack test.

A year ago, at the SC10 conference, Amazon added two Nvidia M2050 fanless GPU coprocessors to each physical server, each capable of pushing 515 gigaflops of peak double-precision floating math. The idea was to give customers who might want to build ceepie-geepie hybrid supercomputers a place to play around with the technology first before making substantial investments in hardware. Or, in some cases, to allow researchers who never will have any interest in owning iron a chance to play with CPU-GPU clusters.

This week, Amazon is announcing Cluster Compute 2 (CC2) instances running atop the EC2 cloud, which sport two eight-core Xeon E5 processors per socket. With HyperThreading turned on, there are 32 threads in the CC2 instance and a much larger 88 EC2 compute units, almost three times the capacity of the original HPC instances (now called CC1) that Amazon was peddling only 16 months ago.

This CC2 instance – which is technically known as the cc2.8xlarge instance in Amazon-speak – presents 60.5GB of virtual memory and 3.37TB of disk storage to HPC applications; its cores run at 2.6GHz and it is using 10GE networking between the nodes, as before.

These CC2 instances cost $2.40 per hour if you buy them on demand (the same price as the CC1 instances 16 months ago), with lower prices if you reserve them ahead or buy them on the spot market. Amazon has also dropped the price of the CC1 instance to $1.30 per hour if the old iron can work for you. That's a 45.8 per cent reduction in price, by the way – something you can't get from real hardware vendors, rest assured. The CC2 instances can run Linux or Windows Server 2008 R2 instances that have pre-packaged to run atop Amazon's variant of the Xen hypervisor for x86 platforms.

Just to show that cloud computing is just as real for HPC as is a cluster of physical servers residing in your data center, Amazon took 1,064 of the CC2 instances and ran the Linpack benchmark test on it.

This cluster had 17,024 Xeon E5 cores running at 2.6GHz and had a peak theoretical performance of 354.1 teraflops. On the Linpack test, the cloudy cluster delivered 240.1 teraflops of sustained performance. It would cost you $2,554 to rent such a CC2 setup for an hour; with reserved and spot pricing, it could cost a lot less. Buying such a cluster would easily cost many millions of dollars, even with steep discounts. By the way, this Amazon virtual HPC cluster ranked number 42 on the Top 500 list.

As was the case with the CC1 instances, the CC2 instances are only available in Amazon's Northern Virginia data center at the moment. You can fire up a two-node CC2 cluster right now, but if you want more nodes that than, you have to contact AWS to get permission. Amazon says that it will be adding the CC2 HPC instances in its other data centers in 2012. ®

The essential guide to IT transformation

More from The Register

next story
The Return of BSOD: Does ANYONE trust Microsoft patches?
Sysadmins, you're either fighting fires or seen as incompetents now
Microsoft: Azure isn't ready for biz-critical apps … yet
Microsoft will move its own IT to the cloud to avoid $200m server bill
Oracle reveals 32-core, 10 BEEELLION-transistor SPARC M7
New chip scales to 1024 cores, 8192 threads 64 TB RAM, at speeds over 3.6GHz
Docker kicks KVM's butt in IBM tests
Big Blue finds containers are speedy, but may not have much room to improve
US regulators OK sale of IBM's x86 server biz to Lenovo
Now all that remains is for gov't offices to ban the boxes
Gartner's Special Report: Should you believe the hype?
Enough hot air to carry a balloon to the Moon
Flash could be CHEAPER than SAS DISK? Come off it, NetApp
Stats analysis reckons we'll hit that point in just three years
Dell The Man shrieks: 'We've got a Bitcoin order, we've got a Bitcoin order'
$50k of PowerEdge servers? That'll be 85 coins in digi-dosh
prev story


5 things you didn’t know about cloud backup
IT departments are embracing cloud backup, but there’s a lot you need to know before choosing a service provider. Learn all the critical things you need to know.
Implementing global e-invoicing with guaranteed legal certainty
Explaining the role local tax compliance plays in successful supply chain management and e-business and how leading global brands are addressing this.
Build a business case: developing custom apps
Learn how to maximize the value of custom applications by accelerating and simplifying their development.
Rethinking backup and recovery in the modern data center
Combining intelligence, operational analytics, and automation to enable efficient, data-driven IT organizations using the HP ABR approach.
Next gen security for virtualised datacentres
Legacy security solutions are inefficient due to the architectural differences between physical and virtual environments.