Feeds

'Grid computing Red Hat' lands elephant on VMware cloud

Hadoop for the future

HP ProLiant Gen8: Integrated lifecycle automation

Cloudera - the star-studded Silicon Valley startup that commercialized the epic number crunching of the open source Hadoop project - is now offering a version of its stuffed elephant distro for use on VMWare's imminent vCloud.

Inspired by research papers describing Google’s proprietary software infrastructure, Hadoop is a means of crunching epic amounts of data across a network of distributed machines. And it's named for the yellow stuffed elephant that belonged to the son of its founder, Doug Cutting, who joins Cloudera this week after a stint at Yahoo!

Cloudera has already tweaked its distro for use on Amazon's on-demand infrastructure service, the Elastic Compute Cloud (EC2), and now the company has cooked up management scripts for deploying a Hadoop cluster on vCloud, the infrastructure cloud setup that VMWare announced in September.

"What we've changed are the management scripts around the core Hadoop platform so that they allow you to very easily start up a Hadoop cluster within the vCloud environment," says Amr Awadallah, Cloudera's chief technical officer. "It's very similar to the management scripts we offer for Amazon EC2."

No, you can't actually use the vCloud at the moment. Third-party hosting providers are set to offer sky-high compute resources based on VMware's setup sometime in the first quarter. But VMware has already released the vCloud API, and this is what Cloudera has coded to. The startup is running demonstrations of its vCloud-friendly distro this week at VMworld in San Francisco.

To be clear: Cloudera is not offering a Hadoop service on Amazon EC2 or the VMware cloud. It's offering a distro you (the user) can setup on these public infrastructure clouds - or inside your own data center. And since you can use the vCloud design to setup your own private infrastructure cloud, Cloudera's new management scripts may prove useful even if you don't go the public cloud route.

And in Red Hat-like fashion, Cloudera provides support as well.

If it's a ready-made Hadoop web service you're looking for, you can get that from Amazon itself. Amazon Elastic MapReduce sits Hadoop atop EC2 and the company's simple storage service (S3). But Cloudera will tell you that when run on EC2, its distro out-Amazons Amazon. ®

Eight steps to building an HP BladeSystem

More from The Register

next story
THUD! WD plonks down SIX TERABYTE 'consumer NAS' fatboy
Now that's a LOT of porn or pirated movies. Or, you know, other consumer stuff
EU's top data cops to meet Google, Microsoft et al over 'right to be forgotten'
Plan to hammer out 'coherent' guidelines. Good luck chaps!
US judge: YES, cops or feds so can slurp an ENTIRE Gmail account
Crooks don't have folders labelled 'drug records', opines NY beak
Manic malware Mayhem spreads through Linux, FreeBSD web servers
And how Google could cripple infection rate in a second
FLAPE – the next BIG THING in storage
Find cold data with flash, transmit it from tape
Seagate chances ARM with NAS boxes for the SOHO crowd
There's an Atom-powered offering, too
prev story

Whitepapers

Seven Steps to Software Security
Seven practical steps you can begin to take today to secure your applications and prevent the damages a successful cyber-attack can cause.
Consolidation: The Foundation for IT Business Transformation
In this whitepaper learn how effective consolidation of IT and business resources can enable multiple, meaningful business benefits.
Designing a Defense for Mobile Applications
Learn about the various considerations for defending mobile applications - from the application architecture itself to the myriad testing technologies.
Build a business case: developing custom apps
Learn how to maximize the value of custom applications by accelerating and simplifying their development.
Consolidation: the foundation for IT and business transformation
In this whitepaper learn how effective consolidation of IT and business resources can enable multiple, meaningful business benefits.