Feeds

LA air traffic meltdown: System simply 'RAN OUT OF MEMORY'

Maybe a reboot will fix it. Maybe a reboot will fix it. Maybe a reboot will fix it. Ma-

Using blade systems to cut costs and sharpen efficiencies

A computer crash that caused the collapse of a $2.4bn air traffic control system may have been caused by a simple lack of memory, insiders close to the cock-up alleged today.

Hundreds of flights were delayed two weeks ago after the air traffic control system that manages the airspace around Los Angeles' LAX airport went titsup as a U-2 spy plane sped overhead.

Although few details about the system crash have been made public, anonymous sources claimed to Reuters that the problem arose when a controller entered the altitude of the spook flight into the En Route Automation Modernisation (ERAM) system, developed by Lockheed Martin.

The U-2's flight plan did not include an altitude for the aircraft, but it did include a route that showed the aircraft leaving and reentering the LAX area multiple times.

As U-2s normally operate at about 60,000ft, a controller seemingly made an educated guess by tapping in that height. The ERAM system then, it is claimed, started to consider all possible altitudes between “ground level and infinity”, sending the software into a death spiral.

ERAM began spitting out error messages and then entered an endless reboot loop, which is a non-optimal state for a piece of critical equipment.

Laura Brown, spokeswoman for the Federal Aviation Administration, said the system was forced to analyse a large number of routes to "de-conflict the aircraft with lower-altitude flights". This process "used a large amount of available memory and interrupted the computer's other flight-processing functions", she added.

"The system is only designed to take so much data per airplane," an anonymous source continued. "It keeps failing itself because it's exceeded the limit of what it can do."

The same sources insisted this vulnerability did not leave the ERAM system open to attacks by miscreants. Which is handy, because it is now being used to help shepherd flights all over the US.

However, there are expected to be two talks at this year's Def Con conference which will discuss ERAM, suggesting it might not be as hack-proof as the authorities claim.

"If it's now understood that there are flight plans that cause the automated system to fail, then the flight plan is an 'attack surface,'" said Dan Kaminsky, co-founder of the White Ops security firm.

"It's certainly possible that there are other forms of flight plans that could cause similar or even worse effects. This is part of the downside of automation."

However Nate Pair, president of the Los Angeles Center for the National Air Traffic Controllers Association, said the fact ERAM was back up and running within an hour was a good indicator of the system's strength.

"We were completely shut down and 46 minutes later we were back up and running," Pair said.

"That could have easily been several hours and then we would have been into flight delays for days because of the ripple effects." ®

The Essential Guide to IT Transformation

More from The Register

next story
BBC goes offline in MASSIVE COCKUP: Stephen Fry partly muzzled
Auntie tight-lipped as major outage rolls on
iPad? More like iFAD: We reveal why Apple fell into IBM's arms
But never fear fanbois, you're still lapping up iPhones, Macs
White? Male? You work in tech? Let us guess ... Twitter? We KNEW it!
Grim diversity numbers dumped alongside Facebook earnings
HP, Microsoft prove it again: Big Business doesn't create jobs
SMEs get lip service - what they need is dinner at the Club
Bose says today is F*** With Dre Day: Beats sued in patent battle
Music gear giant seeks some of that sweet, sweet Apple pie
Amazon Reveals One Weird Trick: A Loss On Almost $20bn In Sales
Investors really hate it: Share price plunge as growth SLOWS in key AWS division
Dude, you're getting a Dell – with BITCOIN: IT giant slurps cryptocash
1. Buy PC with Bitcoin. 2. Mine more coins. 3. Goto step 1
There's NOTHING on TV in Europe – American video DOMINATES
Even France's mega subsidies don't stop US content onslaught
You! Pirate! Stop pirating, or we shall admonish you politely. Repeatedly, if necessary
And we shall go about telling people you smell. No, not really
prev story

Whitepapers

Top three mobile application threats
Prevent sensitive data leakage over insecure channels or stolen mobile devices.
Implementing global e-invoicing with guaranteed legal certainty
Explaining the role local tax compliance plays in successful supply chain management and e-business and how leading global brands are addressing this.
Boost IT visibility and business value
How building a great service catalog relieves pressure points and demonstrates the value of IT service management.
Designing a Defense for Mobile Applications
Learn about the various considerations for defending mobile applications - from the application architecture itself to the myriad testing technologies.
Build a business case: developing custom apps
Learn how to maximize the value of custom applications by accelerating and simplifying their development.