Feeds

IBM explores 67.1m-core computer for running entire internet

Ruby on Rails on Rails on Rails on Rails

Combat fraud and increase customer satisfaction

Exclusive We'll hand it to IBM's researchers. They think big - really big. Like holy-crap-what-have-you-done big.

The Register has unearthed a research paper that shows IBM working on a computing system capable "of hosting the entire internet as an application." This mega system relies on a re-tooled version of IBM's Blue Gene supercomputers so loved by the high performance computing crowd. IBM's researchers have proposed tweaking the Blue Gene systems to run today's most popular web applications such as Linux, Apache, MySQL and Ruby on Rails.

The IBM paper rightly points out that both large SMP (symmetric multi-processing) systems and clusters have their merits for massive computing tasks. Of late, however, most organizations looking to crunch through really big jobs have preferred clusters, which provide certain economic advantages. Customers can buy lots of general purpose hardware and networking components at a low cost and cobble the systems together to equal or surpass the performance of gigantic SMPs.

Sun Microsystems, Amazon.com, Google and Microsoft stand as just some of the companies using these clusters to offer software, processing power and storage to other businesses. Their customers tap into these larger systems and can "grow" their applications as needed by firing up more and more of the provided computing infrastructure.

But there are a few problems with this approach, including the amount of space and energy the clusters require. So, IBM wants to angle Blue Gene boxes at the web software jobs, believing it can run numerous applications on a single box at a lower cost than a cluster.

"We hypothesize that for a large class of web-scale workloads the Blue Gene/P platform is an order of magnitude more efficient to purchase and operate than the commodity clusters in use today," the IBM researchers wrote.

Under a project code-named 'Kittyhawk,' IBM has started running new types of applications on Blue Gene. For example, it has run the SpecJBB benchmark for testing Java performance and the LAMP (Linux Apache MySQL Perl/Python) software, finding comparable performance to today's clusters.

Blue Innards

IBM's unique Blue Gene design has attracted a lot of attention from national labs and other major HPC customers. In fact, four of the 10 fastest supercomputers on the planet rely on the Blue Gene architecture, including the world's fastest machine: the Blue Gene/L at Lawrence Livermore National Laboratory.

The newer Blue Gene/P system combines hundreds and thousands of low-power processor cores to make a single box. A typical configuration would include four 850MHz PowerPC cores arranged in a system-on-a-chip model with built-in memory and interconnect controllers. You can take 32 of these "nodes" and pop them onto a card. Then you have 16 of those cards slot into a midplane. Each server rack has two midplanes, leaving you with 1024 nodes and 2TB of memory. In theory, you can connect up to 16,384 racks, providing up to 67.1m cores with 32PB of memory. That'll get some work done.

Each rack boasts IO bandwidth of 640Gb/s, which puts our theoretical system at 10.4Pb/s.

The architecture of Blue Gene gives IBM a so-called "hybrid" approach, according to the researchers, where they can get the best of both the SMP and cluster worlds.

"The key fact to note is that the nodes themselves can be viewed for the most part as general purpose computers, with processors, memory and external IO," they wrote. "The one major exception to this is that the cores have been extended with an enhanced floating point unit to enable super-computing workloads."

So, you're working with systems in a sense very similar to the individual x86 boxes that make up most clusters. Although the unique packaging of the Blue Gene systems along with their low-power cores allows IBM to create a more reliable computer - by more than two orders of magnitude - than commodity boxes which fail all the time.

To date, IBM's Blue Gene systems, which obviously have remarkable scale, have been aimed at running a single job well across the entire box.

But now we're on to flashier stuff.

Combat fraud and increase customer satisfaction

Next page: Is the Future Blue?

More from The Register

next story
This time it's 'Personal': new Office 365 sub covers just two devices
Redmond also brings Office into Google's back yard
Kingston DataTraveler MicroDuo: Turn your phone into a 72GB beast
USB-usiness in the front, micro-USB party in the back
Dropbox defends fantastically badly timed Condoleezza Rice appointment
'Nothing is going to change with Dr. Rice's appointment,' file sharer promises
BOFH: Oh DO tell us what you think. *CLICK*
$%%&amp Oh dear, we've been cut *CLICK* Well hello *CLICK* You're breaking up...
AMD's 'Seattle' 64-bit ARM server chips now sampling, set to launch in late 2014
But they won't appear in SeaMicro Fabric Compute Systems anytime soon
Amazon reveals its Google-killing 'R3' server instances
A mega-memory instance that never forgets
Cisco reps flog Whiptail's Invicta arrays against EMC and Pure
Storage reseller report reveals who's selling what
Microsoft builds teleporter weapon to send VMware into Azure
Updated Virtual Machine Converter now converts Linux VMs too
prev story

Whitepapers

Securing web applications made simple and scalable
In this whitepaper learn how automated security testing can provide a simple and scalable way to protect your web applications.
3 Big data security analytics techniques
Applying these Big Data security analytics techniques can help you make your business safer by detecting attacks early, before significant damage is done.
The benefits of software based PBX
Why you should break free from your proprietary PBX and how to leverage your existing server hardware.
Top three mobile application threats
Learn about three of the top mobile application security threats facing businesses today and recommendations on how to mitigate the risk.
Combat fraud and increase customer satisfaction
Based on their experience using HP ArcSight Enterprise Security Manager for IT security operations, Finansbank moved to HP ArcSight ESM for fraud management.