Feeds

Google blames Gmail outage on data centre collapse

Domino effect crashes through the cloud

The smart choice: opportunity from uncertainty

Google has apologised for yesterday’s major Gmail meltdown after some of its data centres in Europe failed to cope with a routine maintenance event.

The company’s web-based email service was flat as a pancake for about three hours yesterday morning as Mountain View engineers attempted to fix the problem, which affected vast swathes of the firm’s 113m strong global user base.

Businesses and individuals were unable to gain access to their email accounts via the internet until around 12:30 GMT on Shrove Tuesday.

“This morning, there was a routine maintenance event in one of our European data centers," said Google’s site reliability boss Acacio Cruz yesterday. "This typically causes no disruption because accounts are simply served out of another data centre.

“Unexpected side effects of some new code that tries to keep data geographically close to its owner caused another data centre in Europe to become overloaded, and that caused cascading problems from one data center to another. It took us about an hour to get it all back under control.”

Google said it had fixed the bugs and also shared the pain with its users.

“We run Google on Gmail, so outages like this affect us the same way they affect you. We always investigate the root causes of rare outages like this one, so we can prevent similar problems in the future,” said Cruz.

Many complained on the Google Apps and Gmail forums about the lengthy outage, while others worked around the problem by accessing their email using Imap on a desktop client or through their iPhone or other handset apps.

Premier Edition Google Apps customers such as The Guardian and Salesforce have been promised at least 99.9 per cent Gmail uptime per month. If Google fails to deliver on the terms of its service level agreement it has to cough up a penalty.

That translates as a commitment to no more than 45 minutes of downtime a month - so presumably, affected businesses will be expecting to see a cheque in the post.

In fact Google is offering paying customers who cough up $50 per user, per year for the service, 15 days free credit, according to Associated Press. ®

Mobile application security vulnerability report

More from The Register

next story
Auntie remains MYSTIFIED by that weekend BBC iPlayer and website outage
Still doing 'forensics' on the caching layer – Beeb digi wonk
Major problems beset UK ISP filth filters: But it's OK, nobody uses them
It's almost as though pr0n was actually rather popular
Microsoft unsheathes cheap Android-killer: Behold, the Lumia 530
Say it with us: I'm King of the Landfill-ill-ill-ill
All those new '5G standards'? Here's the science they rely on
Radio professor tells us how wireless will get faster in the real world
Apple orders huge MOUNTAIN of 80 MILLION 'Air' iPhone 6s
Bigger, harder trouser bulges foretold for fanbois
Yorkshire cops fail to grasp principle behind BT Fon Wi-Fi network
'Prevent people that are passing by to hook up to your network', pleads plod
US freemium mobile network eyes up Europe
FreedomPop touts 'free' calls, texts and data
Oh girl, you jus' didn't: Level 3 slaps Verizon in Netflix throttle blowup
Just hook us up to more 10Gbps ports, backbone biz yells in tit-for-tat spat
prev story

Whitepapers

Designing a Defense for Mobile Applications
Learn about the various considerations for defending mobile applications - from the application architecture itself to the myriad testing technologies.
How modern custom applications can spur business growth
Learn how to create, deploy and manage custom applications without consuming or expanding the need for scarce, expensive IT resources.
Reducing security risks from open source software
Follow a few strategies and your organization can gain the full benefits of open source and the cloud without compromising the security of your applications.
Boost IT visibility and business value
How building a great service catalog relieves pressure points and demonstrates the value of IT service management.
Consolidation: the foundation for IT and business transformation
In this whitepaper learn how effective consolidation of IT and business resources can enable multiple, meaningful business benefits.