Feeds

Sun packs 150 billion web pages into meat locker

Getting your arms around the internet

Top three mobile application threats

If you believe the Gospel According to Robert J. Cringley, Google pilfered its top-secret modular data center from the Internet Archive.

In a now-famous 2005 online expose, Cringley puts Google co-founder Larry Page at a pitch meeting where the Internet Archive's Bruce Baumgart considers the advantages of stuffing a full-fledged data center into a shipping container. The Archive's "Petabyte Box" presentation is dated November 8, 2003, and on December 30, Google filed for a patent describing its own containerized data center.

Less than four years later, the patent was granted. And according to one former employee, it's now the norm for Google to erect its ultra-hot data centers by piecing together intermodal shipping containers pre-packed with servers and cooling equipment. Inside the Mountain View Chocolate Factory, Page and company call it Project Will Power.

The Internet Archive eventually built the Petabyte Box - though it shrunk the name a bit and stopped short of actually packing its compact contraption into a shipping container. A PetaBox planted at the San Francisco Presido has long hosted the Archive's Wayback Machine - an 150 billion-page web history dating back to 1996.

Wayback Machine - the container

Internet history in a box

Now, more than five years after first pitching the idea, the outfit that launched the container revolution has finally containerized itself. This morning, deep inside the sun-splashed Santa Clara campus of Sun Microsystems, Internet Archive founder Brewster Kahle cut the ribbon on a single Sun Modular Datacenter housing the entire Wayback Machine. That's thirteen years of archived web pages packed into a container significantly smaller than your living room.

"At a metaphysical level, what we're doing today is reconceptualizing what a computer is...We're reconceptualizing what a library is," said Kahle, the MIT-trained computer scientist who sold his Alexa web-ranking engine to Amazon before birthing the not-for-profit Internet Archive.

Wayback Machine - Greg Papadopoulos and Brewster Kahle

Inside the Wayback Machine with Sun's Greg Papadopoulos and the Internet Archive's Brewster Kahle

"You can actually take a tour of this data center and ask 'How big is the web?' You can ask 'How much does it weigh?' These are things you can actually wrap your hands around in a very literal way."

Combat fraud and increase customer satisfaction

Next page: In the beginning...

More from The Register

next story
This time it's 'Personal': new Office 365 sub covers just two devices
Redmond also brings Office into Google's back yard
Kingston DataTraveler MicroDuo: Turn your phone into a 72GB beast
USB-usiness in the front, micro-USB party in the back
AMD's 'Seattle' 64-bit ARM server chips now sampling, set to launch in late 2014
But they won't appear in SeaMicro Fabric Compute Systems anytime soon
Brit boffins use TARDIS to re-route data flows through time and space
'Traffic Assignment and Retiming Dynamics with Inherent Stability' algo can save ISPs big bucks
Microsoft's Nadella: SQL Server 2014 means we're all about data
Adds new big data tools in quest for 'ambient intelligence'
prev story

Whitepapers

Securing web applications made simple and scalable
In this whitepaper learn how automated security testing can provide a simple and scalable way to protect your web applications.
Combat fraud and increase customer satisfaction
Based on their experience using HP ArcSight Enterprise Security Manager for IT security operations, Finansbank moved to HP ArcSight ESM for fraud management.
The benefits of software based PBX
Why you should break free from your proprietary PBX and how to leverage your existing server hardware.
SANS - Survey on application security programs
In this whitepaper learn about the state of application security programs and practices of 488 surveyed respondents, and discover how mature and effective these programs are.
3 Big data security analytics techniques
Applying these Big Data security analytics techniques can help you make your business safer by detecting attacks early, before significant damage is done.