Feeds

Netflix lets free simian software for cloud chaos

Angry ape kills virtual machines at random

Boost IT visibility and business value

Streaming video provider Netflix has released Chaos Monkey, its homegrown tool that's designed to boost the resilience of cloud-based applications in the bluntest way possible: by knocking them down.

"Do you think your applications can handle a troop of mischievous monkeys loose in your infrastructure?" asks Netflix's Cory Bennett and Ariel Tseitlin in a blog post. "Now you can find out."

The way Chaos Monkey works is conceptually fairly simple. It runs as a service on Amazon Web Services (AWS), where it seeks out Auto Scaling Groups (ASGs) of virtual machine instances. When it finds one, it picks one of its virtual machines at random and terminates it.

At first blush, this may sound like the most maddening piece of software ever, and if a hacker figured out a way to use it maliciously, it could probably cause someone some real headaches.

But Chaos Monkey is a tool, and the reason it runs around your network like a psychopathic ape is because in reality, system failures are one of the most common types of problems the people who manage cloud services must deal with in everyday life.

The point isn't to pull the plug on virtual machines for the fun of it. The point is to ensure that even though the plug has been pulled on a server or two here and there, the overall system is resilient enough to keep running anyway.

"Failures happen and they inevitably happen when least desired or expected," the Netflix developers write. "If your application can't tolerate an instance failure would you rather find out by being paged at 3am or when you're in the office and have had your morning coffee?"

Netflix has made the source code for Chaos Monkey available on GitHub under the Apache open source license. The company says it's just the first of a family of tools it calls the "Simian Army" that it plans to release to the public.

Like Chaos Monkey, the others – including Latency Monkey, Conformity Monkey, Doctor Monkey, Janitor Monkey, Security Monkey, 10-18 Monkey, and the unnervingly-named Chaos Gorilla – are all designed to root out unseen problems in cloud architectures.

The company says Janitor Monkey, which searches for unused resources and disposes of them, is the next likely candidate for release.

But even these tools can't guarantee 100 per cent uptime for cloud-based appplications. During the large-scale AWS outage in June, Netflix was knocked down along with several other customers. Still, Netflix reps say they're confident that the company's rigorous resiliency testing, using the Simian Army among other tools, is the right approach.

"We take our availability very seriously and strive to provide an uninterrupted service to all our members," Netflix developer Greg Orzell wrote in a postmortem of the outage. "We're still bullish on the cloud and continue to work hard to insulate our members from service disruptions in our infrastructure." ®

The essential guide to IT transformation

More from The Register

next story
Munich considers dumping Linux for ... GULP ... Windows!
Give a penguinista a hug, the Outlook's not good for open source's poster child
The Return of BSOD: Does ANYONE trust Microsoft patches?
Sysadmins, you're either fighting fires or seen as incompetents now
Intel's Raspberry Pi rival Galileo can now run Windows
Behold the Internet of Things. Wintel Things
Microsoft cries UNINSTALL in the wake of Blue Screens of Death™
Cache crash causes contained choloric calamity
Eat up Martha! Microsoft slings handwriting recog into OneNote on Android
Freehand input on non-Windows kit for the first time
Linux kernel devs made to finger their dongles before contributing code
Two-factor auth enabled for Kernel.org repositories
prev story

Whitepapers

5 things you didn’t know about cloud backup
IT departments are embracing cloud backup, but there’s a lot you need to know before choosing a service provider. Learn all the critical things you need to know.
Implementing global e-invoicing with guaranteed legal certainty
Explaining the role local tax compliance plays in successful supply chain management and e-business and how leading global brands are addressing this.
Build a business case: developing custom apps
Learn how to maximize the value of custom applications by accelerating and simplifying their development.
Rethinking backup and recovery in the modern data center
Combining intelligence, operational analytics, and automation to enable efficient, data-driven IT organizations using the HP ABR approach.
Next gen security for virtualised datacentres
Legacy security solutions are inefficient due to the architectural differences between physical and virtual environments.