Feeds

Worldwide Gmail crash was due to Google Sync bug

Engineer: How Oompah-Loompah config foul-up pulled down world's email

Top three mobile application threats

It was a Googler misconfiguring a sync server that took out Chrome and Gmail on Monday, an engineer has stated on dev forums.

The reason for Gmail's brief burnout on Monday has been winkled out, and it was connected to the rolling crashes suffered on the Chrome browser on the same day.

It was a human error in configuring a Chrome component that throttled traffic in Chrome and then on several other Google services, explained Chrome engineer Tim Steele in a post on the Google code forum.

The component controlled traffic for Chrome Sync - a service that allows users to synchronise their customised Chrome browser across all of their devices, giving them the same bookmarks, widgets, settings and browsing history.

A small change to its configuration settings meant the load-balancing component started to throttle traffic when it wasn't supposed to. And because the component is core to the infrastructure that many Google services depend on, it affected them too.

It was Chrome Sync users who were hit by the outage first.

Steele explained:

- Chrome Sync Server relies on a backend infrastructure component to enforce quotas on per-datatype sync traffic.
- That quota service experienced traffic problems today due to a faulty load balancing configuration change.
- That change was to a core piece of infrastructure that many services at Google depend on. This means other services may have been affected at the same time, leading to the confounding original title [the Gmail bug] of this bug.
- Because of the quota service failure, Chrome Sync servers reacted too conservatively by telling clients to throttle "all" data types, without accounting for the fact that not all client versions support all data types.

The crash is due to faulty logic responsible for handling "throttled" data types on the client when the data types are unrecognized.

There is WRONG in the cloud. ®

High performance access to file storage

More from The Register

next story
This time it's 'Personal': new Office 365 sub covers just two devices
Redmond also brings Office into Google's back yard
Kingston DataTraveler MicroDuo: Turn your phone into a 72GB beast
USB-usiness in the front, micro-USB party in the back
Dropbox defends fantastically badly timed Condoleezza Rice appointment
'Nothing is going to change with Dr. Rice's appointment,' file sharer promises
Inside the Hekaton: SQL Server 2014's database engine deconstructed
Nadella's database sqares the circle of cheap memory vs speed
BOFH: Oh DO tell us what you think. *CLICK*
$%%&amp Oh dear, we've been cut *CLICK* Well hello *CLICK* You're breaking up...
Just what could be inside Dropbox's new 'Home For Life'?
Biz apps, messaging, photos, email, more storage – sorry, did you think there would be cake?
IT bods: How long does it take YOU to train up on new tech?
I'll leave my arrays to do the hard work, if you don't mind
Amazon reveals its Google-killing 'R3' server instances
A mega-memory instance that never forgets
prev story

Whitepapers

Top three mobile application threats
Learn about three of the top mobile application security threats facing businesses today and recommendations on how to mitigate the risk.
Combat fraud and increase customer satisfaction
Based on their experience using HP ArcSight Enterprise Security Manager for IT security operations, Finansbank moved to HP ArcSight ESM for fraud management.
The benefits of software based PBX
Why you should break free from your proprietary PBX and how to leverage your existing server hardware.
Five 3D headsets to be won!
We were so impressed by the Durovis Dive headset we’ve asked the company to give some away to Reg readers.
SANS - Survey on application security programs
In this whitepaper learn about the state of application security programs and practices of 488 surveyed respondents, and discover how mature and effective these programs are.