Feeds

Level 3's UPS burnout sends websites down in flames

London data centre hit by 3.35am scorcher

3 Big data security analytics techniques

UK sysadmins woke up to a headache this morning after a major power cut at Level 3's data centre in Braham Street, East London, lasted for approximately five hours.

The electrical fault developed at 3.35am, according to an error report seen by The Register, and knocked dozens of companies offline. The facility provides space for server hosting firms and connectivity to the internet's traffic backbone.

From the report it looks as though the failure was caused by a busbar blowing in the Uninterruptible Power Supply (UPS) system that is supposed to protect computers and network equipment from unexpected electrical failures.

Busbars are strips of copper or aluminium that distribute electricity through the data centre. The fault cut the AC supply, leaving just a DC current to machines. The paperwork states:

04:14 GMT - Field Services advised that a UPS system failure has occurred in the London (Braham), England site. Specifically, the switchboard on the UPS system is supplying DC power to the equipment at the site using commercial power; however, the AC power supply to the equipment is down. Technicians are working on the UPS system to restore AC power to the affected equipment.

05:19 GMT - Power technicians have discovered 4 bus-bars scorched on the UPS system which caused the AC power failure. Presently, the power technicians are collaborating on a work-around to restore AC power to the site.

Technicians worked to restore AC power to the affected equipment, and started to succeed by 7.30am. The power was restored by 9am.

ISP LCHost, whose internet traffic is routed through the Level 3 data centre, was among businesses hit by the outage. In a Facebook post, the company wrote earlier this morning:

There is an outage for all ADSL customers at present due to the power failure in Level 3 Braham Street where our onward connection to BT's network passes through. As a result, ADSL customers will be unable to connect at this time.

Level 3 engineers are working to restore power and in the meantime we are examining options for rerouting the connection in the event that the power restoration cannot be achieved in a reasonable time frame.

The ISP added that its connectivity was back to normal by 8.50am.

We've left messages with Level 3, one of the world's top-tier providers of global internet connectivity, to ask for more details. ®

Updated to add

A Level 3 spokeswoman confirmed the data centre suffered a power outage that was "resolved by the team of on-site power technicians".

Combat fraud and increase customer satisfaction

More from The Register

next story
Virgin Media so, so SORRY for turning spam fire-hose on its punters
Hundreds of emails flood inboxes thanks to gaffe
A black box for your SUITCASE: Now your lost luggage can phone home – quite literally
Breakfast in London, lunch in NYC, and your clothes in Peru
AT&T dangles gigabit broadband plans over 100 US cities
So soon after a mulled Google Fiber expansion, fancy that
AT&T threatens to pull out of FCC wireless auctions over purchase limits
Company wants ability to buy more spectrum space in auction
Google looks to LTE and Wi-Fi to help it lube YouTube tubes
Bandwidth hogger needs tube embiggenment if it's to succeed
Turnbull gave NBN Co NO RULES to plan blackspot upgrades
NBN Co faces huge future Telstra bills and reduces fibre footprint
NBN Co plans fibre-to-the-basement blitz to beat cherry-pickers
Heading off at the pass operation given same priority as blackspot fixing
NBN Co in 'broadband kit we tested worked' STUNNER
Announcement of VDSL trial is not proof of concept for fibre-to-the-node
prev story

Whitepapers

Mobile application security study
Download this report to see the alarming realities regarding the sheer number of applications vulnerable to attack, as well as the most common and easily addressable vulnerability errors.
3 Big data security analytics techniques
Applying these Big Data security analytics techniques can help you make your business safer by detecting attacks early, before significant damage is done.
The benefits of software based PBX
Why you should break free from your proprietary PBX and how to leverage your existing server hardware.
Securing web applications made simple and scalable
In this whitepaper learn how automated security testing can provide a simple and scalable way to protect your web applications.
Combat fraud and increase customer satisfaction
Based on their experience using HP ArcSight Enterprise Security Manager for IT security operations, Finansbank moved to HP ArcSight ESM for fraud management.