Feeds

Hardware failure melts down Chocolate Factory

CloudFlare engineers sort out Google's problem

The Power of One eBook: Top reasons to choose HP BladeSystem

Google users in Southeast Asia had an outage last night after an Indonesian ISP had a bit of a meltdown.

Engineers at content-delivery provider CloudFlare noticed the outage at around 2:24 UTC on Tuesday after their own Google Apps services went offline. The outage was primarily an Asian problem and the company estimates between 3 and 5 per cent of the total internet population was affected.

CloudFlare network engineer Tom Paseka said on the company blog that an analysis of the problem showed that the company was unable to reach Google's public DNS server, and saw that packets of data were being rerouted via Indonesian ISP Moratel, and that this was causing the outage.

"This wasn't malicious at all," Paseka told The Register. "It was a hardware failure that caused the initial problem, and then a software failure following on. Moratel were aware of the router failure but not the problem with the uplink."

Network engineers are a chummy lot, staying in contact around the world. Paseka called an engineer he knows at Moratel and between them they got the problem sorted out and the service back online within around 30 minutes.

Google didn't even need to be involved in the fix, although Paseka said they were nice enough to get in contact after the event to say thank you. The Chocolate Factory had no official statement on the matter, but sources familiar with the affair said that the issue did highlight some problems with the current trust-based systems of routing. ®

The Essential Guide to IT Transformation

More from The Register

next story
Brit celebs' homes VANISH from Google's Street View
Tony Blair's digs now a Tone-y Blur
Virgin Media goes titsup AGAIN. The cause? Yet MORE DNS strife
ISP refuses to comment on why outages keep happening
10Gbps over crumbling COPPER: Boffins cram bits down telco wire
XG-FAST tech could finesse fiber connections
ISPs haul GCHQ into COURT over dragnet interwebs snooping
'Exploitation of network infrastructure is unlawful,' says co-claimant
What the world needs now is... a Bluetooth-enabled baby's dummy
Oh NO! Temp-sensor pacifier just got dunked in my tea
BT slapped down by BSkyB over O2 broadband 'switch off' porkies
Ad watchdog tells one-time state monopoly to behave
Siri, did we just take a hit in that voice-recog patent fight?
Yes, Apple, you did, says this Beijing court
Islamic terror peril hits US giants' phone wallets
'We have made the decision to rebrand' says ISIS Isis
BlackBerry knocks Google's KNOX LOCK PICK for Android
John Chen disses Samsung's security solution
Silent Circle takes on Skype, Viber, mobile telcos with crypto-VoIP
But, hey ... we cut the roaming charges, mumble mobile carriers
prev story

Whitepapers

Seven Steps to Software Security
Seven practical steps you can begin to take today to secure your applications and prevent the damages a successful cyber-attack can cause.
Top 8 considerations to enable and simplify mobility
In this whitepaper learn how to successfully add mobile capabilities simply and cost effectively.
Eight steps to building an HP BladeSystem
Building your ideal BladeSystem infrastructure solution begins with eight simple steps, outlined in this whitepaper.
Securing Web Applications Made Simple and Scalable
Learn how automated security testing can provide a simple and scalable way to protect your web applications.
Build a Business Case: Developing Custom Apps
In this whitepaper learn how to maximize the value of custom applications by accelerating and simplifying their development.