Feeds

Netflix lets free simian software for cloud chaos

Angry ape kills virtual machines at random

5 things you didn’t know about cloud backup

Streaming video provider Netflix has released Chaos Monkey, its homegrown tool that's designed to boost the resilience of cloud-based applications in the bluntest way possible: by knocking them down.

"Do you think your applications can handle a troop of mischievous monkeys loose in your infrastructure?" asks Netflix's Cory Bennett and Ariel Tseitlin in a blog post. "Now you can find out."

The way Chaos Monkey works is conceptually fairly simple. It runs as a service on Amazon Web Services (AWS), where it seeks out Auto Scaling Groups (ASGs) of virtual machine instances. When it finds one, it picks one of its virtual machines at random and terminates it.

At first blush, this may sound like the most maddening piece of software ever, and if a hacker figured out a way to use it maliciously, it could probably cause someone some real headaches.

But Chaos Monkey is a tool, and the reason it runs around your network like a psychopathic ape is because in reality, system failures are one of the most common types of problems the people who manage cloud services must deal with in everyday life.

The point isn't to pull the plug on virtual machines for the fun of it. The point is to ensure that even though the plug has been pulled on a server or two here and there, the overall system is resilient enough to keep running anyway.

"Failures happen and they inevitably happen when least desired or expected," the Netflix developers write. "If your application can't tolerate an instance failure would you rather find out by being paged at 3am or when you're in the office and have had your morning coffee?"

Netflix has made the source code for Chaos Monkey available on GitHub under the Apache open source license. The company says it's just the first of a family of tools it calls the "Simian Army" that it plans to release to the public.

Like Chaos Monkey, the others – including Latency Monkey, Conformity Monkey, Doctor Monkey, Janitor Monkey, Security Monkey, 10-18 Monkey, and the unnervingly-named Chaos Gorilla – are all designed to root out unseen problems in cloud architectures.

The company says Janitor Monkey, which searches for unused resources and disposes of them, is the next likely candidate for release.

But even these tools can't guarantee 100 per cent uptime for cloud-based appplications. During the large-scale AWS outage in June, Netflix was knocked down along with several other customers. Still, Netflix reps say they're confident that the company's rigorous resiliency testing, using the Simian Army among other tools, is the right approach.

"We take our availability very seriously and strive to provide an uninterrupted service to all our members," Netflix developer Greg Orzell wrote in a postmortem of the outage. "We're still bullish on the cloud and continue to work hard to insulate our members from service disruptions in our infrastructure." ®

Boost IT visibility and business value

More from The Register

next story
The Return of BSOD: Does ANYONE trust Microsoft patches?
Sysadmins, you're either fighting fires or seen as incompetents now
Linux turns 23 and Linus Torvalds celebrates as only he can
No, not with swearing, but by controlling the release cycle
Why has the web gone to hell? Market chaos and HUMAN NATURE
Tim Berners-Lee isn't happy, but we should be
China hopes home-grown OS will oust Microsoft
Doesn't much like Apple or Google, either
Apple promises to lift Curse of the Drained iPhone 5 Battery
Have you tried turning it off and...? Never mind, here's a replacement
Sin COS to tan Windows? Chinese operating system to debut in autumn – report
Development alliance working on desktop, mobe software
Eat up Martha! Microsoft slings handwriting recog into OneNote on Android
Freehand input on non-Windows kit for the first time
Linux kernel devs made to finger their dongles before contributing code
Two-factor auth enabled for Kernel.org repositories
prev story

Whitepapers

Implementing global e-invoicing with guaranteed legal certainty
Explaining the role local tax compliance plays in successful supply chain management and e-business and how leading global brands are addressing this.
Endpoint data privacy in the cloud is easier than you think
Innovations in encryption and storage resolve issues of data privacy and key requirements for companies to look for in a solution.
Scale data protection with your virtual environment
To scale at the rate of virtualization growth, data protection solutions need to adopt new capabilities and simplify current features.
Boost IT visibility and business value
How building a great service catalog relieves pressure points and demonstrates the value of IT service management.
High Performance for All
While HPC is not new, it has traditionally been seen as a specialist area – is it now geared up to meet more mainstream requirements?