Feeds

Articles about Big Data

Oracle's next-gen Big Data Appliance

Oracle releases 'lite' virtual Big Data appliance

Oracle has released tool that should make it easier for developers to code applications for its Big Data Appliance. Big Data Lite, as the tool is called, bundles Oracle Linux, Cloudera software, Hadoop and plenty of Oracle's cloud connectors, just about replicating the environment available on Big Red's Big Data Appliance. The …
Simon Sharwood, 30 Jan 2014

Flappy Bird crosses over into cryptocurrency, big data

The Flappy Bird phenomenon is showing little sign of hitting one last, fatal, pipe as the game has now spawned at least two Bitcoin clones and a big data analysis of gamers' performance. On the cryptocurrency front, Flappycoin Pool, and the still-to-launch Flappycoin.org are battling it out for supremacy, with the latter …
Simon Sharwood, 18 Feb 2014
Broke - empty pockets

Some first-wave big data projects 'written down' says Deloitte

Consultancy outfit Deloitte reckons early big data projects have had to be written down because they failed, thanks in part to a “buy it and the benefits will come” mentality. The source of failure was sometimes difficulty making open source software work and/or integrate with other systems, Deloitte Australia's technology …
Simon Sharwood, 19 Feb 2014

50,000 women knocked up by big data, wearable tech, crowds and cloud

Big Data, cloud, wearable computing and crowdsourcing boosters now have very, very tangible evidence of the technologies' power: 50,000 new humans. So claims an outfit called Ovuline, which offers an iOS and Android app dubbed Ovia Fertility that asks users to input details about their health and menstrual cycle, and can even …
Simon Sharwood, 27 Feb 2014
iPhone in the Lake

Pivotal and CapGemini jump into 'Big Data Lake'

EMC-spawn Pivotal has a new best friend: CapGemini. The two outfits have let it be known they've buddied up in a “ strategic partnership” that will “combine Capgemini’s expertise in business solutions for big data and analytics with Pivotal’s market leading data platform technologies to deliver solutions for today’s increasingly …
Simon Sharwood, 05 Dec 2013
HMSMobile Swine Flu Center iPhone app

Google flu-finding service diagnosed with 'big data hubris'

A paper in Science claims that Google Flu Trends, unveiled back in 2008 to become a poster-child of Big Data, has one teeny, tiny, fatal flaw: it's almost always wrong. The paper – abstract here – finds that not only did Flu Trends completely miss the 2009 swine flu, but for 100 of the 108 weeks since 2011, Google's predictions …
tumbling dice

IBM bets the farm on big data in annual report

IBM is utterly focussed on big data and analytics as its future growth engines, according to its annual report published over the weekend. But the company has hedged a little on the future of its semiconductor and hardware businesses. Available here, the least-brochure-like bits are to be found in the A Letter from the Chairman …
Simon Sharwood, 10 Mar 2014

Big data: You've got to spend a dollar ... to make fifty-two cents – report

What do you expect from big data mining: easy-to-find gold nuggets of information from the dark pits of the data dumps? According to a recent report from the Wikibon consulting group, almost half of big data projects fail. It also found that the payoffs – using current technology – are not yet worth the costs of running the …
Chris Mellor, 01 Oct 2013
™ Big Data In Focus

Big Data? Yeah, nice buzzword. Give us the nuts and bolts this time

Big Data has crossed the chasm from hype to everyday reality remarkably quickly. Its adoption has been accelerated by hungry data warehousers using big data techniques to get better answers from their data mining activities. ™ Big Data In Focus Attending the TM Big Data InFocus 2014 conference in Amsterdam, it became …
Chris Mellor, 30 Jan 2014

Big data minnow swallowed by security player Accumuli

AIM-listed specialist security player Accumuli has coughed £1.9m for small Bracknell-based big data analytics reseller and integrator EQUALIS, it confirmed to the City today. This bolt-on-buy adds a seven-strong band of big data boffins that sell software from Splunk - for which EQUALIS is Blighty's only authorised training …
Paul Kunert, 02 Dec 2013

Big Data is bovine excrement says Obama's Big Data man

Big Data is “bullshit”, says Harper Reed, Chief Technology Officer at Obama for America 2012. Speaking at the CeBIT conference in Sydney, Australia, today, Reed said he encountered the the term “Big Data” in 2007 when it referred to a storage problem. “We used it in 2007 because it was hard to store data,” he said. “People who …
Simon Sharwood, 28 May 2013
Two teenage girls - one whispering in other's ear

Big Data is like TEENAGE SEX

The joke doing the rounds on social media compares big data to teenage sex: everyone's talking about it, only a few know how to do it, they all think everyone else is at it and so pretend they are too. And humans fumbling about in the dark, so to speak, are the weakest link in the world of analytics and data, said Steve Brazier …
Paul Kunert, 20 Feb 2014
Hadoop Elephant

VMware brings big data to vSphere standard edition

Virtualisation and Hadoop are a natural fit: who wants every node to be physical when there's computing and storage resources out there that could be put to work performing Hadoopery when you need it, then freed to do other stuff at other times? VMware noticed the potential for Hadoop on vSphere ages ago and released “Big Data …
Simon Sharwood, 31 Oct 2013

Supercomputer-maker Cray offers cold storage to hungry Big Data boys

Supercomputer supplier Cray is offering archival storage for cold data with automated movement across four storage tiers. The product is a large-scale tiered storage archive solution intended for the HPC and Big Data markets. Cray's Tiered Adaptive Storage (TAS) offering uses Storage Manager archival software from Versity, in …
Chris Mellor, 06 Nov 2013
australia

Cloud, virtualisation and big data added to TAFE curriculum

A new curriculum for information technology courses taught at Australia's colleges of technical and further education (TAFEs, Polytechnic for UK readers, community college in the USA) has been released. “ICA 11 2.0” emerged yesterday and describes dozens of different qualifications and hundreds of subjects taught at TAFE. The …
Simon Sharwood, 07 Nov 2013
Cirrus clouds

5 years in storage: Flash mutants, big data and (WTF is) the cloud

Over the last five years, there have certainly been a few structural changes: the wannabes and the could've-beens have mostly disappeared through acquisition or general collapse. But the big players are still the big players: EMC, HDS, HP, IBM and NetApp still pretty much dominate the industry. And the big firms core products …
StorageBod, 25 Sep 2013
LaCie 8big

LaCie bigs up 2big, 5big, 8big... WHOMP: Lands big data on your desk

Seagate sub LaCie has announced 2big, 5big and 8big products using 6TB disks and Thunderbolt connects for stonking big fat and fast performance. That’s 12TB in the 2-drive 2big, 30TB in the 5big and 48TB in the 8big rackmount shelf. LaCie says the 8big is its first rackmount Thunderbolt 2 connect product. The 2big transfers …
Chris Mellor, 07 Apr 2014
Hadoop elephant

Apache Foundation embraces real time big data cruncher 'Storm'

The Apache Foundation has voted to accept the “Storm” real time data processing tool into its incubator program, the first step towards making it an official part of the Foundation's open source offerings. Storm aims to do for real time data processing what Hadoop did for batch processing: queue jobs and send them off to a …
Simon Sharwood, 19 Sep 2013

CSC enslaves Infochimps to create army of big data monkeymen

In an announcement so garbled that our Big Data Translator had to be coated in Hadoop-based lubricant to spew out some sense, analytics company Infochimps has been acquired by outsourcer-extraordinaire CSC. The data-analytics company announced it had been acquired on Tuesday alongside CSC's earnings, during which CSC reported a …
Jack Clark, 07 Aug 2013

BBC to spaff £18 MILLION of licence fee cash... on BIG DATA

The Beeb is planing to chuck up to £18m worth of licence fee payers' cash at data analytics suppliers to work their dark arts at the corporation. A tender for a three-year Next Generation Digital Analytics Services agreement appeared in the Official Journal of the European Union* at the weekend. "The BBC is looking for a …
Paul Kunert, 22 Oct 2013
Soul of a New Machine

Big Data is getting too damn big - and nobody is helping to fix this

As vendors race to be better, faster and to differentiate themselves in an already busy marketplace, the real needs of the storage teams can be left unmet - and also those of the storage consumer. At times it is as if the various vendors are building dragsters, calling them family saloons and hoping that nobody notices. The …
StorageBod, 26 Nov 2013
The Register breaking news

IBM: We have placed the Big Data moon on this stick

IBM Research has come up with a new package it calls BLU Acceleration, intended to speed up (big) data analysis and reporting of data held in DB2 and Informix databases, amongst others. The BLU Acceleration package includes these handy features: Data skipping - an ability to skip data that doesn't need analysing, such as …
Chris Mellor, 04 Apr 2013
Nadella

Microsoft's Nadella: SQL Server 2014 means we're all about data

Microsoft's new CEO Satya Nadella made his third trip in as many weeks to San Francisco to announce the third piece in the puzzle that's Microsoft's future strategy: it's all going to be about data, he said. Nadella It's all about the data "The era of ambient intelligence has begun, and we are delivering a platform that …
Iain Thomson, 15 Apr 2014

Seagate: Storage industry ill-prepared for onrushing big data tsunami

The world is producing such a rapidly surging amount of data that the storage industry – both solid-state drives (SSDs) and hard-disk drives (HDDs) – will be hard-pressed to keep up with demand, says one storage-industry insider. "You can take that as a crisis; we see it as an opportunity," HDD manufacturer Seagate's SVP in …
Rik Myslewski, 14 Aug 2013
Sepaton S2100-ES3

Sepaton launches super-duper big data-slurping deduper

Sepaton has updated its 16-node deduping disk-to-disk backup mill with hybrid dedupe methods and has planned a capacity jump to 16 petabytes. The S2100-ES2 generation is being followed by this new VirtuoSO product, which keeps the clustered node limit of 16 dedupe heads front-ending a disk drive array but bumps up the processing …
Chris Mellor, 16 Oct 2013
Doraemon interactive trending map big data

Japan uses big data to map cultural climate change

Big data boffins at Tokyo University have found a novel way to help Japan’s faltering economy: by producing an interactive trending map for manga, gaming and other content producers to see where in Asia their products are most popular. The Asia Trend Map was developed by Tokyo University associate professor Matsuo Yutaka with …
Phil Muncaster, 22 May 2013

Osbo's booze, bingo, biz and big data Budget

Chancellor of the Exchequer George Osborne presented what he described as a Budget for "the makers the doers and the savers" - and let's not forget the bingo players - in today's economy statement to Parliament. There was very little news for the tech world, with one notable exception: the announcement of the Alan Turing …
Kelly Fiveash, 19 Mar 2014
Kindle Big Brother

DARPA calls Big Data boffins: Help us lock up everyone's privates

The American military is looking for number-crunching wizards able to tackle the national security threat posed by, erm... publicly available data. The Defense Advanced Research Projects Agency (DARPA) is searching for boffins to "measure the national security impact of public data and to defend against the malicious use of …
Jasper Hamill, 13 Aug 2013

Big money in Big Data: SGI debuts petabyte-juggling archiving tool

The tidal wave that is unstructured file-based data is lumbering towards data centres. SGI is hoping the Big Data trend means that file access storage will become a hot property. Meanwhile, customers love the idea of all file locations being stored in a single virtual silo, instead of multiple different silos with differing …
Chris Mellor, 23 Apr 2013

Big Data about to bottom out, says Gartner

Big Data hype has peaked and adopters are about to enter Gartner’s dread trough of disillusionment, says one of the firm’s analysts, Svetlana Sicular. Hype about Big Data is certainly prevalent: here at Vulture South the term is often thrown around by vendors who in past years were content to describe their data-crunching …
Simon Sharwood, 23 Jan 2013
The Register breaking news

RSA adds Big Data analytics to security service suite

In just under a month, security folks are coming to San Francisco for the annual RSA show, and if Wednesday's announcement from the company is to go by, one of the major themes at conference will be Big Data. At a press conference at its Massachusetts headquarters, RSA unveiled its Security Analytics appliance that's designed to …
Iain Thomson, 31 Jan 2013

IBM unleashes 'big data' on wind, solar power management

IBM has announced a weather-modeling and power-grid management system with the goal of increasing the effectiveness and efficiency of renewable energy sources such as wind and solar power. "Applying analytics and harnessing big data will allow utilities to tackle the intermittent nature of renewable energy and forecast power …
Rik Myslewski, 12 Aug 2013
The Register breaking news

Big data? Big challenge

Do you find dealing with data like drinking from a fire hydrant? Even as existing data silos continue to grow, an increasing range of external information sources offer new opportunities to understand customers better, to make better decisions or improve service delivery. No organisation is working in a vacuum, however. Time and …
David Gordon, 17 Oct 2012
Why did you click to see the picture with images turned off

Big Blue blasts fibre bottleneck with analog-digital double whammy

Big Blue bade farewell to a bottleneck in data transfer this week with a new analog-to-digital converter capable of up to 180 billion conversions per second, and claimed success in mass producing an earlier design, as well. This double whammy of news was revealed at the International Solid-State Circuits Conference (ISSCC) in …
Jack Clark, 13 Feb 2014
The Register breaking news

Who cares about Big Data

“Big Data” today clearly rules the web pages as market makers promote the topic at the drop of a hat. But with so much effort, and money, being spent promoting BD, is anyone actually doing anything in everyday businesses to exploit this loosely grouped family of technologies? Most readers of The Register acknowledge there are …
Tony Lock, 13 Sep 2012

Murdoch says Microsoft needs 'big clean out'

Rupert Murdoch has issued another in his occasional series of tweets about technology companies. This time the target is Microsoft. Here's the tweet: Microsoft moves and options for future fascinate. Need for big clean out of bureaucracy and focus on next big tech wave. Metadata? — Rupert Murdoch (@rupertmurdoch) April 10, …
Simon Sharwood, 11 Apr 2014
Kindle Big Brother

Big Brother's software firm Palantir valued at $9 BEEELION

How much does it cost to buy out one of big brother's favored toolmakers? Around $9bn, according to a recent valuation of Silicon Valley darling Palantir. The "Big Data" analysis company made a Form D filing with the SEC on Thursday disclosing a $58m cash infusion, and other reports by The Wall Street Journal, The New York Times …
Jack Clark, 06 Dec 2013
Dell logo

Dell punts big fat switch into OpenStack clouds

Dell has tagged software-defined networking (SDN) and big data centre switching in its latest switch/controller release. The late-March launch of a high-capacity switch and a fabric controller are, according to networking sales director Vijay Valayatham, part of a “grander vision about scale-out fabrics and lease-buy …
Job cuts jpeg

Google's Drive SLASH, secret 'big upgrade': Coincidence? HARDLY

Google has slashed its online Drive storage prices so fast, it undercuts all of its rivals – and its own products. The Reg suspects the web king will dramatically lower its infrastructure-as-a-service storage prices as well in two weeks. The dramatic price cut for Google Drive was announced on Thursday: storing 100GB of data in …
Jack Clark, 13 Mar 2014
management big_data4

Tell me, professor, what is big data?

Big Data may be misunderstood and overhyped - but the promise of data growth enabling a goldmine of insight is compelling. Professor Mark Whitehorn, the eminent data scientist, author and occasional Register columnist, explains what big data is and why it is important. Sometimes life is generous and hands you an unexpected gift …
Mark Whitehorn, 12 Aug 2013
Elephant

VMware teaches Serengeti big-data virt new Hadoop tricks

It comes as no surprise that VMware wants companies to run everything virtually rather than on bare metal, and for several years it has pushed the idea of virtualizing the Hadoop stack to make it run better and easier to manage. The tool it created to do that, called Project Serengeti, now has some feature tweaks to try to …
Willem ter Harmsel

If you're pondering a startup, go for big data. This VC might fund you

Enterprise software venture capital firm Atlantic Capital Partners backs a number of up-and-coming startups, including Amplidata, Racktivity and Torch, the firm behind data analytics tool Graylog2. But what makes the firm's partners decide which firms to take a gamble on? ACP was founded in 2010 and invests, at the growth stage …
The Register breaking news

Big Data to battle fraud, cyber crime: EMC guard dog gets a Silver Tail

EMC has signed a deal to acquire web fraud detection specialists Silver Tail Systems. Financial terms of the deal, announced Tuesday, were undisclosed. In a statement, EMC said that Silver Tail’s technology bolsters RSA’s position in the web fraud detection market because its technology complements RSA’s anti-fraud products and …
John Leyden, 01 Nov 2012
The Register breaking news

Big Data skills gap needs filling says tech industry

Concern is growing in the US technology industry about a skills gap in education and training in the field of data analysis. "Last 50 years arguably have been about computer science," said Jeremy Burton, VP of product operations for EMC, during his Monday keynote at Oracle OpenWorld. "The next 50 years are going to be about data …
Iain Thomson, 04 Oct 2012
cable

Dell channels Dr Who, shoves Big Data into Small Data Tardis

Dell reckons it can turn Big Data into, er, Small Data. Hoarded information could be squeezed down to size - potentially reducing disk occupancy by 97 per cent - if the tech titan's numbers add up. The company will bundle RainStor's deduping structured data software with one of its object storage system to provide a …
Chris Mellor, 25 Jul 2012
Ricoh GR Digital III

Big Data's big issue: Where are all the data scientists coming from?

Plug “data scientist” into Google and it is clear the job title has finally come of age and, suddenly there is a huge skills shortage. An oft-quoted source about this shortage is a McKinsey Global Institute study, here. This predicts a talent gap of 140,000 to 190,000 people by 2018 in the US alone. I am always sceptical of IT …
Mark Whitehorn, 02 Nov 2012

Building big data? Are you building a security headache too?

The world and its dog has been shocked by the Prism news story. Early in June, we found out that the US National Security Agency (NSA) had developed a secret data-gathering mechanism to steal all our data and store it in a large data warehouse. We are outraged that it is being mined, searched and otherwise prodded. But do we …
Danny Bradbury, 19 Aug 2013

Big Blue blows big green in SoftLayer public cloud gobble

So much for that whole strategy that cloud biz SoftLayer came up with (of building its own cloud controller and basing its server fleet entirely on Super Micro iron): because Big Blue bought SoftLayer today for an undisclosed sum. Rumors were going around back in March that both IBM and EMC were sniffing around SoftLayer - a …

'Big Data changes EVERYTHING' vs 'Hadoop? For my 200-customer biz?'

As an industry analyst, it sometimes feels like I am flitting between two parallel universes. In one, I sit in rooms with IT marketing professionals and product managers and listen to them talking about how the latest "big thing" is changing everything. In the other, I chat with IT directors and ops managers who want to see …
Dale Vile, 10 May 2013
A blade server from the UV2 super

SGI backs away from public clouds, chases HPC and big data

Supercomputer and high-density server maker Silicon Graphics is still not back on track to profitability, but CEO Jorge Titinger says he knows what to do: Back away from the knife fight of providing infrastructure to public cloud providers and focus on commercial HPC systems, related big data systems, and the storage that sits …