Feeds

Big Data is bovine excrement says Obama's Big Data man

You probably have 'medium data' and are paranoid about privacy, says CTO

Intelligent flash storage arrays

Big Data is “bullshit”, says Harper Reed, Chief Technology Officer at Obama for America 2012.

Speaking at the CeBIT conference in Sydney, Australia, today, Reed said he encountered the the term “Big Data” in 2007 when it referred to a storage problem.

“We used it in 2007 because it was hard to store data,” he said. “People who did it were doing it well.” But not everyone was doing it well, knew how to or had the tools to do so. Six years later, the likes of Hadoop and Hbase mean storing and preparing large volumes of data for analysis are no longer difficult problems, he said, but the term “Big Data” persists.

Reed would rather it had not come into such wide use, if only because he feels most people contemplating an investment in “Big Data” probably don't have enough data to qualify for the term as he understands it.

Rayid Ghani, who shared the Sydney stage and worked alongside Reed as Chief Data Scientist on the Obama 2012 campaign agreed, revealing that his personal domestic storage rig stores more data than he used in the election campaign.

That revelation led Reed to opine that few of the attendees at the event have enough data to qualify as “Big”.

“You probably have medium data,” he said, and the term “Big Data” has now come to represent analytics tools, not the data itself.

Even if Big or Medium Data contains personal information, Ghani said analysis probably wouldn't use it to create eerily well-targeted offers.

“Data on what car you drive was not very useful in the campaign,” he said. “We did not use that much private data.” More useful, Reed said, was simple data points like a response to the question “do you support the President?” With a response to that question and information on whether an individual had voted in the past in hand, the Obama campaign was able to identify a voter as someone worthy of their attention.

Reed also cautioned old people – anyone over 25 in his big-beard-chunky-earrings-and-thick-framed-glasses world – not to panic on the topic of privacy. Oldsters are uneasy with the notion that Facebook et al mines their data he said. Young folk have no such qualms, understand the transactions they participate in and are more familiar with the privacy controls of the services they use.

Oldsters, he said, haven't bothered to learn how to operate those privacy controls and as a result assume their privacy worries are universal.

“Let's not project our fears onto others,” he said. ®

Top 5 reasons to deploy VMware with Tegile

More from The Register

next story
The 'fun-nification' of computer education – good idea?
Compulsory code schools, luvvies love it, but what about Maths and Physics?
Ex-US Navy fighter pilot MIT prof: Drones beat humans - I should know
'Missy' Cummings on UAVs, smartcars and dying from boredom
Facebook, Apple: LADIES! Why not FREEZE your EGGS? It's on the company!
No biological clockwatching when you work in Silicon Valley
Happiness economics is bollocks. Oh, UK.gov just adopted it? Er ...
Opportunity doesn't knock; it costs us instead
'Cowardly, venomous trolls' threatened with TWO-YEAR sentences for menacing posts
UK government: 'Taking a stand against a baying cyber-mob'
Sysadmin with EBOLA? Gartner's issued advice to debug your biz
Start hoarding cleaning supplies, analyst firm says, and assume your team will scatter
Doctor Who's Flatline: Cool monsters, yes, but utterly limp subplots
We know what the Doctor does, stop going on about it already
prev story

Whitepapers

Forging a new future with identity relationship management
Learn about ForgeRock's next generation IRM platform and how it is designed to empower CEOS's and enterprises to engage with consumers.
Cloud and hybrid-cloud data protection for VMware
Learn how quick and easy it is to configure backups and perform restores for VMware environments.
Three 1TB solid state scorchers up for grabs
Big SSDs can be expensive but think big and think free because you could be the lucky winner of one of three 1TB Samsung SSD 840 EVO drives that we’re giving away worth over £300 apiece.
Reg Reader Research: SaaS based Email and Office Productivity Tools
Read this Reg reader report which provides advice and guidance for SMBs towards the use of SaaS based email and Office productivity tools.
Security for virtualized datacentres
Legacy security solutions are inefficient due to the architectural differences between physical and virtual environments.