Feeds

Big Data is bovine excrement says Obama's Big Data man

You probably have 'medium data' and are paranoid about privacy, says CTO

The Power of One Infographic

Big Data is “bullshit”, says Harper Reed, Chief Technology Officer at Obama for America 2012.

Speaking at the CeBIT conference in Sydney, Australia, today, Reed said he encountered the the term “Big Data” in 2007 when it referred to a storage problem.

“We used it in 2007 because it was hard to store data,” he said. “People who did it were doing it well.” But not everyone was doing it well, knew how to or had the tools to do so. Six years later, the likes of Hadoop and Hbase mean storing and preparing large volumes of data for analysis are no longer difficult problems, he said, but the term “Big Data” persists.

Reed would rather it had not come into such wide use, if only because he feels most people contemplating an investment in “Big Data” probably don't have enough data to qualify for the term as he understands it.

Rayid Ghani, who shared the Sydney stage and worked alongside Reed as Chief Data Scientist on the Obama 2012 campaign agreed, revealing that his personal domestic storage rig stores more data than he used in the election campaign.

That revelation led Reed to opine that few of the attendees at the event have enough data to qualify as “Big”.

“You probably have medium data,” he said, and the term “Big Data” has now come to represent analytics tools, not the data itself.

Even if Big or Medium Data contains personal information, Ghani said analysis probably wouldn't use it to create eerily well-targeted offers.

“Data on what car you drive was not very useful in the campaign,” he said. “We did not use that much private data.” More useful, Reed said, was simple data points like a response to the question “do you support the President?” With a response to that question and information on whether an individual had voted in the past in hand, the Obama campaign was able to identify a voter as someone worthy of their attention.

Reed also cautioned old people – anyone over 25 in his big-beard-chunky-earrings-and-thick-framed-glasses world – not to panic on the topic of privacy. Oldsters are uneasy with the notion that Facebook et al mines their data he said. Young folk have no such qualms, understand the transactions they participate in and are more familiar with the privacy controls of the services they use.

Oldsters, he said, haven't bothered to learn how to operate those privacy controls and as a result assume their privacy worries are universal.

“Let's not project our fears onto others,” he said. ®

The Essential Guide to IT Transformation

More from The Register

next story
BBC goes offline in MASSIVE COCKUP: Stephen Fry partly muzzled
Auntie tight-lipped as major outage rolls on
iPad? More like iFAD: We reveal why Apple fell into IBM's arms
But never fear fanbois, you're still lapping up iPhones, Macs
Amazon Reveals One Weird Trick: A Loss On Almost $20bn In Sales
Investors really hate it: Share price plunge as growth SLOWS in key AWS division
Bose says today is F*** With Dre Day: Beats sued in patent battle
Music gear giant seeks some of that sweet, sweet Apple pie
There's NOTHING on TV in Europe – American video DOMINATES
Even France's mega subsidies don't stop US content onslaught
You! Pirate! Stop pirating, or we shall admonish you politely. Repeatedly, if necessary
And we shall go about telling people you smell. No, not really
Too many IT conferences to cover? MICROSOFT to the RESCUE!
Yet more word of cuts emerges from Redmond
Chips are down at Broadcom: Thousands of workers laid off
Cellphone baseband device biz shuttered
Twitch rich as Google flicks $1bn hitch switch, claims snitch
Gameplay streaming biz and search king refuse to deny fresh gobble rumors
prev story

Whitepapers

Designing a Defense for Mobile Applications
Learn about the various considerations for defending mobile applications - from the application architecture itself to the myriad testing technologies.
Implementing global e-invoicing with guaranteed legal certainty
Explaining the role local tax compliance plays in successful supply chain management and e-business and how leading global brands are addressing this.
Top 8 considerations to enable and simplify mobility
In this whitepaper learn how to successfully add mobile capabilities simply and cost effectively.
Seven Steps to Software Security
Seven practical steps you can begin to take today to secure your applications and prevent the damages a successful cyber-attack can cause.
Boost IT visibility and business value
How building a great service catalog relieves pressure points and demonstrates the value of IT service management.