Feeds

Hardware failure melts down Chocolate Factory

CloudFlare engineers sort out Google's problem

Intelligent flash storage arrays

Google users in Southeast Asia had an outage last night after an Indonesian ISP had a bit of a meltdown.

Engineers at content-delivery provider CloudFlare noticed the outage at around 2:24 UTC on Tuesday after their own Google Apps services went offline. The outage was primarily an Asian problem and the company estimates between 3 and 5 per cent of the total internet population was affected.

CloudFlare network engineer Tom Paseka said on the company blog that an analysis of the problem showed that the company was unable to reach Google's public DNS server, and saw that packets of data were being rerouted via Indonesian ISP Moratel, and that this was causing the outage.

"This wasn't malicious at all," Paseka told The Register. "It was a hardware failure that caused the initial problem, and then a software failure following on. Moratel were aware of the router failure but not the problem with the uplink."

Network engineers are a chummy lot, staying in contact around the world. Paseka called an engineer he knows at Moratel and between them they got the problem sorted out and the service back online within around 30 minutes.

Google didn't even need to be involved in the fix, although Paseka said they were nice enough to get in contact after the event to say thank you. The Chocolate Factory had no official statement on the matter, but sources familiar with the affair said that the issue did highlight some problems with the current trust-based systems of routing. ®

Internet Security Threat Report 2014

More from The Register

next story
Download alert: Nearly ALL top 100 Android, iOS paid apps hacked
Attack of the Clones? Yeah, but much, much scarier – report
Broadband sellers in the UK are UP TO no good, says Which?
Speedy network claims only apply to 10% of customers
Virgin Media struck dumb by NATIONWIDE packet loss balls-up
Turning it off and on again fixes glitch 12 HOURS LATER
Yahoo! blames! MONSTER! email! OUTAGE! on! CUT! CABLE! bungle!
Weekend woe for BT as telco struggles to restore service
Fujitsu CTO: We'll be 3D-printing tech execs in 15 years
Fleshy techie disses network neutrality, helmet-less motorcyclists
Facebook, working on Facebook at Work, works on Facebook. At Work
You don't want your cat or drunk pics at the office
Soz, web devs: Google snatches its Wallet off the table
Killing off web service in 3 months... but app-happy bonkers are fine
prev story

Whitepapers

Why and how to choose the right cloud vendor
The benefits of cloud-based storage in your processes. Eliminate onsite, disk-based backup and archiving in favor of cloud-based data protection.
Getting started with customer-focused identity management
Learn why identity is a fundamental requirement to digital growth, and how without it there is no way to identify and engage customers in a meaningful way.
How to determine if cloud backup is right for your servers
Two key factors, technical feasibility and TCO economics, that backup and IT operations managers should consider when assessing cloud backup.
High Performance for All
While HPC is not new, it has traditionally been seen as a specialist area – is it now geared up to meet more mainstream requirements?
Internet Security Threat Report 2014
An overview and analysis of the year in global threat activity: identify, analyze, and provide commentary on emerging trends in the dynamic threat landscape.