Feeds

Rackspace flattened by Texas trucker

Keep on hostin'...or not

Application security programs and practises

A major US data centre in Texas was taken out when a truck driver hit a utility pole, sending it crashing into a power transformer.

The Dallas/Fort Worth facility, owned by managed hosting outfit Rackspace, automatically switched to power from its own generators when the accident happened, but chiller units failed to re-start.

The truck hit the transformer at about 6pm central time. There's no word on the condition of the driver yet.

Rackspace wrote: "When we transferred power to our secondary utility power system, the data centre's chilling units were cycled back up.

"At this time, however, the utility provider shut down power in order to allow emergency rescue teams safe access to the accident victim. This repeated cycling of the chillers resulted in increasing temperatures within the data centre. As a precautionary measure we decided to take some customers' servers offline. These servers are now back up, as are the chillers."

All the servers were back at 10.50pm. "It has been a long and hard Monday here at Rackspace," the company's announcement said.

One of the firms downed by the outage was 37signals, a small business software as a service provider. In a company blog post it wrote: "[We] will be using this situation as both a wake-up call and a learning experience. While our systems are engineered to chug through major failure, this 'perfect storm' chain of events beat both our set up and our data centre's sophisticated back-up systems. We will work hard to further diversify our systems in order to make an future downtime event like this even more rare."

The HGV crash marked a climax to a terrible couple of days for the Dallas data centre. Separate internal power grid problems at the company caused an outage for some customers on Sunday before Rackspace switched to generator power.

It then moved back to utility power early on Monday, but almost immediately some servers were forced off the grid again by more internal problems. Engineers were still battling the grid issues when the truck crashed.

El Reg is hosted by Rackspace, but we weren't affected by the outage. ®

Eight steps to building an HP BladeSystem

More from The Register

next story
Sysadmin Day 2014: Quick, there's still time to get the beers in
He walked over the broken glass, killed the thugs... and er... reconnected the cables*
Apple fanbois SCREAM as update BRICKS their Macbook Airs
Ragegasm spills over as firmware upgrade kills machines
Amazon Reveals One Weird Trick: A Loss On Almost $20bn In Sales
Investors really hate it: Share price plunge as growth SLOWS in key AWS division
SHOCK and AWS: The fall of Amazon's deflationary cloud
Just as Jeff Bezos did to books and CDs, Amazon's rivals are now doing to it
EU's top data cops to meet Google, Microsoft et al over 'right to be forgotten'
Plan to hammer out 'coherent' guidelines. Good luck chaps!
US judge: YES, cops or feds so can slurp an ENTIRE Gmail account
Crooks don't have folders labelled 'drug records', opines NY beak
Auntie remains MYSTIFIED by that weekend BBC iPlayer and website outage
Still doing 'forensics' on the caching layer – Beeb digi wonk
Manic malware Mayhem spreads through Linux, FreeBSD web servers
And how Google could cripple infection rate in a second
prev story

Whitepapers

Top three mobile application threats
Prevent sensitive data leakage over insecure channels or stolen mobile devices.
Implementing global e-invoicing with guaranteed legal certainty
Explaining the role local tax compliance plays in successful supply chain management and e-business and how leading global brands are addressing this.
Boost IT visibility and business value
How building a great service catalog relieves pressure points and demonstrates the value of IT service management.
Designing a Defense for Mobile Applications
Learn about the various considerations for defending mobile applications - from the application architecture itself to the myriad testing technologies.
Build a business case: developing custom apps
Learn how to maximize the value of custom applications by accelerating and simplifying their development.