Feeds

Sun packs 150 billion web pages into meat locker

Getting your arms around the internet

Build a business case: developing custom apps

Sun follows Google

But as Page reached for a patent on the idea, Kahle's brainstorm sparked two other minds over at Sun Microsystems. In the past, Sun has said that its Modular Datacenter - originally code-named Project Blackbox - grew out of a discussion between Sun chief technology officer Greg Papadopoulos and Danny Hills, now co-chairman and chief technology officer of a California consulting operation called Applied Minds. But this morning, Papadopoulus acknowledged that project sprung from Kahle, whom he had worked with at the Cambridge supercomputer maker Thinking Machines.

Wayback Machine - cables on movable trays

Blackbox racks are tracked. And cables too

"Danny Hills and I developed the original concept for Project Blackbox, but our inspiration was Brewster - the first person we know of to say 'Hey, we should put a bunch of circuit boards in a shipping container and blow cold air over them,'" Padadopoulus told the gathered digerati this morning in the heart of California's Silicon Valley.

Padadopoulus and company officially announced the Sun Modular Datacenter, or Sun MD, in January 2008. And according to Jud Cooley, the project's director of engineering, Sun has shipped its shipping containers "in the low double digits" to operations as far flung as the Radboud University Nijmegen Medical Centre in the Netherlands and the Belgian wind turbine outfit Hansen Transmissions.

Wayback Machine - smoke detector

Blackbox fire suppression

And now it's hosting the Wayback Machine in a container tucked between the Spanish tile roofs of its Santa Clara campus, just down the road from Google. Measuring 20 feet longer by 8 feet deep by 8 feet high, the modular net history holds two petabytes of data - with space for another two.

Sun's cramped container includes eight server racks on sliding tracks, each racking nine Sun Fire x4500 "Thumper" servers running Solaris 10 and Sun's ZFS file system. And the necessary networking, power, cooling, and fire-fighting hardware is packed in as well. All it needs from the outside world is a power source (25kW per rack) and a cooling-fluid hook-up (ordinary tap water).

As you walk into the container, with the fans whirring and the racks tight on either side, you feel as if you've walked into a meat locker. Though it's slightly warmer. And it smells better. And you know it's crunching data. Holding 2 quadrillion characters of information, the Wayback Machine processes 500 queries per second, and it's growing at a rate of four billion data rows per month.

Wayback Machine - spring-mounted racks

In case of earthquake, spring-mounts - but snug the bolts, lads

The rub is that this particular shipping container won't be shipped. The Wayback Machine will live at Sun forever - or least until IBM buys the company and pulls the plug. But the 20-foot container is another step towards Kahle's dream of a digital Alexandria capable of surviving a Caesarean fire - and most any other earthly disaster.

"Even if this first data center never moves, it encapsulates engineering efforts in a building that's reproducible," Kahle told us. "It's something that's centrally manufacturable and shippable."

Meanwhile, Google has built an internet archive of its own. "They're storing more than they let on," Kahle says. But the aims of Google's modular data center project are, shall we say, more commercial. ®

Photos and additional reporting by Rik Myslewski

Boost IT visibility and business value

More from The Register

next story
Sysadmin Day 2014: Quick, there's still time to get the beers in
He walked over the broken glass, killed the thugs... and er... reconnected the cables*
Auntie remains MYSTIFIED by that weekend BBC iPlayer and website outage
Still doing 'forensics' on the caching layer – Beeb digi wonk
SHOCK and AWS: The fall of Amazon's deflationary cloud
Just as Jeff Bezos did to books and CDs, Amazon's rivals are now doing to it
VVOL update: Are any vendors NOT leaping into bed with VMware?
It's not yet been released but everyone thinks it's the dog's danglies
BlackBerry: Toss the server, mate... BES is in the CLOUD now
BlackBerry Enterprise Services takes aim at SMEs - but there's a catch
prev story

Whitepapers

Implementing global e-invoicing with guaranteed legal certainty
Explaining the role local tax compliance plays in successful supply chain management and e-business and how leading global brands are addressing this.
The Essential Guide to IT Transformation
ServiceNow discusses three IT transformations that can help CIO's automate IT services to transform IT and the enterprise.
Consolidation: The Foundation for IT Business Transformation
In this whitepaper learn how effective consolidation of IT and business resources can enable multiple, meaningful business benefits.
How modern custom applications can spur business growth
Learn how to create, deploy and manage custom applications without consuming or expanding the need for scarce, expensive IT resources.
Build a business case: developing custom apps
Learn how to maximize the value of custom applications by accelerating and simplifying their development.