Feeds

NoSQL hopeful cozies up to Hadoop data-muncher

Big data love-in

High performance access to file storage

NoSQL data store CouchDB has become Hadoop’s latest convert with delivery of a connector tying together the two big-data architectures.

CouchDB user Couchbase has announced a certified Couchbase Hadoop Connector, developed with Hadoop shop Cloudera.

The connector potentially simplifies movement of data between the Couchbase Server, which Couchbase says is "powered" by CouchDB, and the Cloudera Distribution including Hadoop (CDH). Couchbase uses capabilities of CouchDB such as mobile and sync. Both CouchDB and Hadoop, meanwhile, are Apache Software Foundation (ASF) projects.

The connector does this using Sqoop, a plug-in that's an Apache incubator project. Sqoop can stream data from the Couchbase system to the Cloudera Hadoop distribution.

According to Couchbase, the Sqoop addition will enable both consistent application performance and heavy MapReduce data-crunching of data sets.

The plug-in targets web applications such as ads targeting, where low-latency is needed along with high throughput.

The Hadoop Connector was certified via Cloudera’s Certified Technology program.

Couchbase wasn't the only one cozying up to Hadoop this week. Open-source enterprise data integration start-up Talend announced that version 5 of its suite features enhanced support for Hadoop's data warehouse Hive, the Pig data analysis tool and Sqoop.

Couchbase is closely aligned with the NoSQL crowd. It uses and supports the CouchDB document store with employees such as Jan Lenhardt still contributing to the CouchDB Apache project. Couchbase also utilizes Memcached in its Membase Server. The company's customers include the BBC and Zynga.

CouchDB recently made the news when it was dropped from Canonical's Ubuntu One service after Canonical tried and failed to make the document store scale to millions of users and databases over a period of three years.

Cloudera is home to Hadoop founder Doug Cutting. Hadoop was inspired by Google’s MapReduce for large-scale data-munching.

Cloudera was first to deliver productisation and support for Hadoop, but was this year joined by Yahoo! spin out Hortonworks. The latter has this year worked with Microsoft to develop a Hadoop plug-in for Microsoft’s SQL Server, a move that has ended the life of Microsoft’s own big data cruncher, Dryad. ®

This article has been updated to clarify Couchbase's use and support for CouchDB.

High performance access to file storage

More from The Register

next story
Windows 8.1, which you probably haven't upgraded to yet, ALREADY OBSOLETE
Pre-Update versions of new Windows version will no longer support patches
Android engineer: We DIDN'T copy Apple OR follow Samsung's orders
Veep testifies for Samsung during Apple patent trial
OpenSSL Heartbleed: Bloody nose for open-source bleeding hearts
Bloke behind the cockup says not enough people are helping crucial crypto project
Half of Twitter's 'active users' are SILENT STALKERS
Nearly 50% have NEVER tweeted a word
Windows XP still has 27 per cent market share on its deathbed
Windows 7 making some gains on XP Death Day
Internet-of-stuff startup dumps NoSQL for ... SQL?
NoSQL taste great at first but lacks proper nutrients, says startup cloud whiz
Microsoft lobs pre-release Windows Phone 8.1 at devs who dare
App makers can load it before anyone else, but if they do they're stuck with it
US taxman blows Win XP deadline, must now spend millions on custom support
Gov't IT likened to 'a Model T with a lot of things on top of it'
prev story

Whitepapers

Mainstay ROI - Does application security pay?
In this whitepaper learn how you and your enterprise might benefit from better software security.
Five 3D headsets to be won!
We were so impressed by the Durovis Dive headset we’ve asked the company to give some away to Reg readers.
3 Big data security analytics techniques
Applying these Big Data security analytics techniques can help you make your business safer by detecting attacks early, before significant damage is done.
The benefits of software based PBX
Why you should break free from your proprietary PBX and how to leverage your existing server hardware.
Mobile application security study
Download this report to see the alarming realities regarding the sheer number of applications vulnerable to attack, as well as the most common and easily addressable vulnerability errors.