Feeds

Database gurus slammed for Google post

MapReduce: a "major step backwards"

High performance access to file storage

A database pioneer and honored computer science professor have come under heavy fire for issuing a strong critique of Google's MapReduce technology for processing large unstructured databases.

Ingres inventor and Postgres architect Mike Stonebraker and his colleague, University of Wisconsin computer science professor David DeWitt, have been accused of "not getting" data in the clouds while others have demanded the duo retract what's been branded a "highly inaccurate article".

Stonebraker and DeWitt had criticized MapReduce and slammed moves to introduce MapReduce into the academic curriculum.

They called MapReduce a major step backwards because it is "sub optimal", lacks the features commonly associated with database management systems (DBMS) and is incompatible with "all of the tools DBMS users have come to depend on". They also said that it is not '"novel". They conclude that MapReduce ignores many of the developments in parallel DBMS technology over the last 25 years.

Their joint blog post drew fire from bloggers and a barrage of commentators coming out in support of MapReduce, including a detailed riposte that claimed DeWitt and Stonebraker don't know what they are talking about.

The gist of the counter argument is that MapReduce can't be compared to a relational DBMS because it is a technique for dealing with large amounts of unstructured data rather than the formal tabular data in relational DBMS. Google reckons it processes 20PB of unstructured data a day using MapReduce.

The almost complete lack of support for the view put forward by DeWitt and Stonebraker suggests they might well have misunderstood MapReduce's role in modern data processing.

Given the eminent background of both academics, though, this is surprising. DeWitt has researched large parallel DBMS since the 1980s and, in addition to his pioneering work on Ingres and Postgres, Stonebraker is currently active in the large DBMS area with his new company Vertica.

DeWitt has published more than 100 technical papers and been honored for contributions to database systems having started in the mid 1970s on a NASA- and DARPA-funded project looking at scalable object-relational system for managing very large geo-spatial data sets.

Requests for an interview have yet to be answered.®

Combat fraud and increase customer satisfaction

More from The Register

next story
This time it's 'Personal': new Office 365 sub covers just two devices
Redmond also brings Office into Google's back yard
Oh no, Joe: WinPhone users already griping over 8.1 mega-update
Hang on. Which bit of Developer Preview don't you understand?
Microsoft lobs pre-release Windows Phone 8.1 at devs who dare
App makers can load it before anyone else, but if they do they're stuck with it
Half of Twitter's 'active users' are SILENT STALKERS
Nearly 50% have NEVER tweeted a word
Internet-of-stuff startup dumps NoSQL for ... SQL?
NoSQL taste great at first but lacks proper nutrients, says startup cloud whiz
Ditch the sync, paddle in the Streem: Upstart offers syncless sharing
Upload, delete and carry on sharing afterwards?
New Facebook phone app allows you to stalk your mates
Nearby Friends feature goes live in a few weeks
Microsoft TIER SMEAR changes app prices whether devs ask or not
Some go up, some go down, Redmond goes silent
Batten down the hatches, Ubuntu 14.04 LTS due in TWO DAYS
Admins dab straining server brows in advance of Trusty Tahr's long-term support landing
prev story

Whitepapers

SANS - Survey on application security programs
In this whitepaper learn about the state of application security programs and practices of 488 surveyed respondents, and discover how mature and effective these programs are.
Combat fraud and increase customer satisfaction
Based on their experience using HP ArcSight Enterprise Security Manager for IT security operations, Finansbank moved to HP ArcSight ESM for fraud management.
The benefits of software based PBX
Why you should break free from your proprietary PBX and how to leverage your existing server hardware.
Top three mobile application threats
Learn about three of the top mobile application security threats facing businesses today and recommendations on how to mitigate the risk.
3 Big data security analytics techniques
Applying these Big Data security analytics techniques can help you make your business safer by detecting attacks early, before significant damage is done.