Feeds

Microsoft says scale-out storage not needed for big data

SQL Server guru also thinks data scientists also have limited role … for now

Build a business case: developing custom apps

Infrastructure vendors’ vision of big data rigs based on scale-out NAS won’t come to fruition, according to the Microsoft executive heading the company’s big data push for SQL Server 2012.

David Campbell, a Microsoft Technical Fellow in the Data & Storage Platform Group claims personal responsibility for Microsoft’s adoption of Hadoop as both an app on the Windows platform and Azure. In conversation with The Register he declared himself “Diametrically opposed” to big data rigs built on scale-out storage. To explain his reason he challenged your correspondent to “Do a census of big data implementations. Ask how many are built on off-the-shelf products and how many are built on scale-out storage.”

All the examples Campbell could list were built on commodity hardware. “The evidence is there if you look,” he said, asserting that the market has already decided that a RAIS – redundant array of independent servers – approach typified by the way containerised data centres operate is superior to the somewhat exotic hardware involved in scale-out NAS or dedicated analytical appliances.

“I used to think the big online players were outliers,” he added. Now he thinks they got the approach to big data right the first time.

Campbell is also cool on the role of the data scientist, analytical experts who blend hard-core data-crunching skills with an understanding of moving bits at scale and can then translate their efforts into business insights. Such workers are in very short supply, he says, and industry cannot assume that the crop currently taking up the first university courses in the discipline will reach the workplace in the next five years.

Microsoft has therefore tooled SQL Server 2012 so it can satisfy a data scientist’s darkest big data desires, then pass the results of their efforts to lesser folk in IT and around the business.

“People ask me if they need to hire a data scientist,” Campbell asked a Microsoft event in Sydney today. “I say that if they can connect their people to the output a data scientist creates, maybe not all the work needs to be done in-house.” To help things along, SQL Server 2012 therefore includes Power View, a new data visualisation too which makes it easy - with the help of Excel - to turn data into something the average executive can understand.

Campbell is also optimistic that, over time, more suit-wearing types will be happy to drive tools like Power View, as "milennials" fluent in Excel syntax enter the workforce and start to crunch their own data. ®

The Essential Guide to IT Transformation

More from The Register

next story
BBC goes offline in MASSIVE COCKUP: Stephen Fry partly muzzled
Auntie tight-lipped as major outage rolls on
iPad? More like iFAD: We reveal why Apple fell into IBM's arms
But never fear fanbois, you're still lapping up iPhones, Macs
Sonos AXES support for Apple's iOS4 and 5
Want to use your iThing? You can't - it's too old
Stick a 4K in them: Super high-res TVs are DONE
4,000 pixels is niche now... Don't say we didn't warn you
Philip K Dick 'Nazi alternate reality' story to be made into TV series
Amazon Studios, Ridley Scott firm to produce The Man in the High Castle
There's NOTHING on TV in Europe – American video DOMINATES
Even France's mega subsidies don't stop US content onslaught
You! Pirate! Stop pirating, or we shall admonish you politely. Repeatedly, if necessary
And we shall go about telling people you smell. No, not really
Too many IT conferences to cover? MICROSOFT to the RESCUE!
Yet more word of cuts emerges from Redmond
Joe Average isn't worth $10 a year to Mark Zuckerberg
The Social Network deflates the PC resurgence with mobile-only usage prediction
prev story

Whitepapers

Implementing global e-invoicing with guaranteed legal certainty
Explaining the role local tax compliance plays in successful supply chain management and e-business and how leading global brands are addressing this.
The Essential Guide to IT Transformation
ServiceNow discusses three IT transformations that can help CIO's automate IT services to transform IT and the enterprise.
Consolidation: The Foundation for IT Business Transformation
In this whitepaper learn how effective consolidation of IT and business resources can enable multiple, meaningful business benefits.
How modern custom applications can spur business growth
Learn how to create, deploy and manage custom applications without consuming or expanding the need for scarce, expensive IT resources.
Build a business case: developing custom apps
Learn how to maximize the value of custom applications by accelerating and simplifying their development.