Feeds

Google boasts of melting data center antidote

No chillers? No problem

Application security programs and practises

Structure 09 Google is developing some sort of back-end technology that automatically - and nearly instantly - redistributes live compute loads when a data center is in danger of overheating. Or maybe this is just talk. Google prefers to at least maintain the illusion of data-center nirvana.

During a panel discussion last week at Structure 09, an annual mini-conference dedicated to all-things cloudy, Google senior manager of engineering and architecture Vijay Gill had a bit of fun with Google's well-known penchant for corporate secrecy - almost as much fun as he had at the expense of Microsoft.

When Facebook vice president of operations Jonathan Heiliger asked Gill to describe Google's now famous back-end infrastructure, Gill couldn't help but respond with a deadpan "Unfortunately, I can’t talk about that at all."

Gill promptly admitted this was a joke, and his audience chuckled. "Everybody at Google loves to say that," grumbled Gill's Facebook counterpart. But much the same words would resurface later in the conversation.

After Gill turned his nose up at Microsoft's back-end, Heiliger asked the sort of question that so often turns up during these conference panel discussions: "If you could wave your magic wand," Heiliger asked, "to create some bit of kit or new technology [for infrastructure] that we don't have today, what would it be?"

"Thanks for setting that one up, John," was the sarcastic reply from the irrepressible Gill. "We didn't discuss that one." But he semi-answered the question anyway, returning to the subject of Google's data center design, which he had at least alluded to earlier in pointing his audience to a recently-published paper on the subject: The Datacenter as a Computer: An Introduction to the Design of Warehouse-Scale Machines.

"What we are building here - and of course this is the title of the [paper] - is warehouse-sized compute platforms," Gill said. "You have to have integration with everything right from the chillers down all the way to the CPU. Sometimes, there's a temperature excursion, and you might want to do a quick load-shedding - a quick load-shedding to prevent a temperature excursion because, hey, you have a data center with no chillers. You want to move some load off. You want to cut some CPUs and some of the processes in RAM."

Apparently, Google is working to detect temperature spikes and automatically respond to them in near real-time. Gill even seems to be saying that the company hopes to instantly redistribute workloads between data centers.

"How do you manage the system and optimize it on a global-level? That is the interesting part," Gill continued. "What we’ve got here [with Google] is massive - like hundreds of thousands of variable linear programming problems that need to run in quasi-real-time. When the temperature starts to excurse in a data center, you don’t have the luxury to sitting around for a half an hour...You have on the order of seconds."

Heiliger asked Gill if this was a technology Google is using today. "I could not possibly comment on that," Gill replied, drawing more laughter from his audience. Another panel member - LinkedIn vp of technical operations Lloyd Taylor, who was once director of global operations for Google - raised his hand as if to answer the question. But naturally, he didn't.

It's no secret that Google's distributed file system, GFS, and its distributed compute platform, MapReduce, are designed to deal with frequent hardware failures. When one machine goes down, its tasks are quickly picked up by another. But Gill indicated that Google is working to automatically respond not just to outright failures but to temperature spikes. He even seemed to be saying that the company is developing a way to sidestep the imminent breakdown of an entire data center ("a data center with no chillers") and to do so on "a global-level."

If Google has indeed developed a technology capable of such responses, it hasn't perfected the thing. If you've used Gmail in the past few months, chances are you're aware of this.

Google's strict code of corporate secrecy is often balanced by a pathological need to tell the world how great it is. And Gill showed a bit of both last week. It was entertaining - if not enlightening. ®

Bridging the IT gap between rising business demands and ageing tools

More from The Register

next story
Apple fanbois SCREAM as update BRICKS their Macbook Airs
Ragegasm spills over as firmware upgrade kills machines
Auntie remains MYSTIFIED by that weekend BBC iPlayer and website outage
Still doing 'forensics' on the caching layer – Beeb digi wonk
Attack of the clones: Oracle's latest Red Hat Linux lookalike arrives
Oracle's Linux boss says Larry's Linux isn't just for Oracle apps anymore
THUD! WD plonks down SIX TERABYTE 'consumer NAS' fatboy
Now that's a LOT of porn or pirated movies. Or, you know, other consumer stuff
EU's top data cops to meet Google, Microsoft et al over 'right to be forgotten'
Plan to hammer out 'coherent' guidelines. Good luck chaps!
US judge: YES, cops or feds so can slurp an ENTIRE Gmail account
Crooks don't have folders labelled 'drug records', opines NY beak
Manic malware Mayhem spreads through Linux, FreeBSD web servers
And how Google could cripple infection rate in a second
prev story

Whitepapers

Top three mobile application threats
Prevent sensitive data leakage over insecure channels or stolen mobile devices.
Implementing global e-invoicing with guaranteed legal certainty
Explaining the role local tax compliance plays in successful supply chain management and e-business and how leading global brands are addressing this.
Top 8 considerations to enable and simplify mobility
In this whitepaper learn how to successfully add mobile capabilities simply and cost effectively.
Application security programs and practises
Follow a few strategies and your organization can gain the full benefits of open source and the cloud without compromising the security of your applications.
The Essential Guide to IT Transformation
ServiceNow discusses three IT transformations that can help CIO's automate IT services to transform IT and the enterprise.