Articles about Big Data

HP flings big data at cloud, sysadmins' faces

Your log files, the story goes, aren't just a record of every every stray packet that grazes your firewall or every temperature spike inside your servers when someone uses the microwave in the lunch room. They're really a treasure trove of hidden indicators that can tell you not just how to stop IT breaking at the worst possible …
Simon Sharwood, 07 Dec 2014

Darwin, Beer and Big Data? Must be a Reg Lecture Video

Reg Events On Tuesday 25 November, Professor Mark Whitehorn kicked off the inaugural Reg Christmas Lectures, and what a night it was... We packed them in upstairs at the Craft Beer Company pub on Leather Lane, Clerkenwell. It was tight, but nobody was stirring, not even a mouse as Mark took the attendees on a whirlwind journey around the …
Joe Fay, 03 Dec 2014

SecureData buys into big data, grabs stake in software developer

Security integrator SecureData has coughed an undisclosed sum for a minority stake in Paterva, the developer and purveyor of big data wares. Security, mobility, social, cloud and big data are the market drivers being talked by vendors from HP and IBM to Microsoft – and now the Kent-based supplier has a footprint in two of those …
Paul Kunert, 05 Aug 2014
Billy_Connolly

Bring your spade: The BIG DATA Gold Rush has begun

The forty-niners rushed to California in search of gold. Some even found it. But most stayed poor and the only people who got reliably rich were people who made and sold the picks and shovels the miners needed. Is that the way it is with big data? Will the only people to get rich be the suppliers of big data computer software, …
Chris Mellor, 03 Oct 2014

€2 BILLION: Steelie Neelie wants US to pay for her Big Data splurge

Knowledge is power. That’s the message from Steelie Neelie as the EU Commission throws half a billion at “big data”. Digital Agenda Commissioner Neelie Kroes announced the EC would contribute €500m to a €2.5bn scheme to leverage the power of big data. The rest will come from industry. According to the Commission, mastering big …
Jennifer Baker, 13 Oct 2014
Carpenters_workbench

Can it be true? A BIG DATA benchmark? Yes, says TPC

Up until now there hasn't been an objective or standard way of comparing different suppliers' big data systems performance. The Transaction Processing Council (TPC) is remedying that with its TPCx-HS benchmark. The TPC provides objective, vendor-neutral benchmarks for things like virtual servers and transaction processing. The …
Chris Mellor, 20 Aug 2014
Japanse suspension bridge

Wonderful wizard of WOS daddy DDN moves into big data

Comment HPC and supercomputer storage company Data Direct Networks (DDN) says its move into enterprise big data is providing a bridge to profits, with 100 per cent revenue growth. The stats it quotes are these: Better than 100 per cent business increase in first half of 2014 compared to first half of 2013 for its enterprise big data …
Chris Mellor, 01 Sep 2014
Oracle's next-gen Big Data Appliance

Oracle releases 'lite' virtual Big Data appliance

Oracle has released tool that should make it easier for developers to code applications for its Big Data Appliance. Big Data Lite, as the tool is called, bundles Oracle Linux, Cloudera software, Hadoop and plenty of Oracle's cloud connectors, just about replicating the environment available on Big Red's Big Data Appliance. The …
Simon Sharwood, 30 Jan 2014

Big Data's being held back by little talent, says Huawei head techie

Big data projects – seen by some as the tech industry’s latest snake oil and others as a potentially valuable tool to dig up fresh information – is being held back by the lack of data scientists for hire. This is according to Ron Raffensperger, Huawei’s chief techie for the IT product line that sits within its Data Centre …
Paul Kunert, 17 Sep 2014
Storage disks, photo: Gavin Clarke

Like condoms, data now comes in big and HUGE sizes

If condoms were made in a range of different sizes, the old joke goes, the options would be “huge”, “gigantic” and “enormous”. We mention the joke in reference to The Linux Foundation's decision to create a new conference, called “Vault”, to “... bring together the world’s leading developers in filesystems and storage in the …
Simon Sharwood, 29 Aug 2014
Archimedes

'Urika': Cray unveils new 1,500-core big data crunching monster

Big data analytics people are constantly panning for nuggets of gold, and Cray has just the machine for them — its Urika-XA. Said to be a single-platform entity, consolidating a wide range of analytics workloads previously needing separate systems, its design has been optimised for compute- and memory-intensive and latency- …
Chris Mellor, 16 Oct 2014

SQL fights back against NoSQL's big data cred with SQL/MDA spec

With the growing popularity of big-data tools like NoSQL databases and Hadoop, it might have looked like SQL could be in line to be moved on from “venerable” tag to “obsolete”, but last week, the ISO SQL working group agreed to start work on SQL/MDA (multi-dimensional array) specs. The people behind SQL have decided it's time to …

El Reg Christmas Lectures to span space, big data and GCHQ

Reg Events What will you be doing in the run-up to Christmas? Mad dash round the shops? Crunching the end of year numbers? Warm white wine and cold sausages in a meeting room? Or will you be kicking back with other similarly bright people, sipping hand crafted beer and listening to a bona fide expert talk about space exploration; or using …
Joe Fay, 09 Oct 2014
Cloud security

Make sure big data doesn't land you in big trouble

Size isn't everything. Big data may be about storing terabytes or petabytes of information but it is also about complexity, and complexity often brings security challenges. Are you ready to handle them? Right now, someone in a marketing or finance role somewhere in your organisation is probably putting together a big data …
Danny Bradbury, 14 Nov 2014

SHARE your big data scientist. They're too costly and rare to keep a whole one – HP exec

Big data is on the strategic priority dashboard of every enterprise tech firm, but coughing a potentially princely sum for skilled people to talk the talk in complex projects may not be commercially viable for some in the channel. It's the age old issue of when to invest in a specific practice, one that Sue Barsamian, HP …
Paul Kunert, 15 Jul 2014
Octopus

What kind of Big Data is yours? Is it data bauxite, data aluminium ... or data Dreamliner?

Analysis Data is valuable. There, we’ve said it, do you feel better? The question is, has data as an information currency - and an entity in and of itself - become inherently more valuable? Now that we have real time transactional big data analytics to enrich our lives, does this mean that the 1s and 0s inside every binary now somehow …

Flappy Bird crosses over into cryptocurrency, big data

The Flappy Bird phenomenon is showing little sign of hitting one last, fatal, pipe as the game has now spawned at least two Bitcoin clones and a big data analysis of gamers' performance. On the cryptocurrency front, Flappycoin Pool, and the still-to-launch Flappycoin.org are battling it out for supremacy, with the latter …
Simon Sharwood, 18 Feb 2014
Broke - empty pockets

Some first-wave big data projects 'written down' says Deloitte

Consultancy outfit Deloitte reckons early big data projects have had to be written down because they failed, thanks in part to a “buy it and the benefits will come” mentality. The source of failure was sometimes difficulty making open source software work and/or integrate with other systems, Deloitte Australia's technology …
Simon Sharwood, 19 Feb 2014
ClusterStor 1500

Seagate and SGI buddy up to flog HPC bigness to big business

Seagate has signed up SGI to resell its ClusterStor supercomputing and big data arrays. SGI will now resell the ClusterStor 1500, 6000, and 9000 products and the Secure Data Appliance (SDA) with its Kerberos network authentication protocol to enable symmetric-key cryptography. SGI competitor Cray OEMs ClusterStor arrays in its …
Chris Mellor, 18 Nov 2014
The new Twitter logo. Pic: Twitter

Twitter, IBM, in deal to create brainy Big Blue Bird

IBM and Twitter have assembled their buzzwords, ranked them into a regiment, and jointly set them loose to march upon a waiting world, by announcing that the avian network will feed data galore to Big Blue's cloudy enterprise big data analytics offerings. Did El Reg add that the pair are promising to transform businesses and …
Un Frog

Huawei set to spin up Big Data R&D facility in France

Huawei is ramping up its data science research operation with a facility in Paris as it pushes further up the technology stack. Renato Lombardi, Huawei’s veep of European R&D, said the effort was part of the firm’s drive to increase its focus on the I in ICT, rather than its pure comms roots. The China-based vendor has been …
Joe Fay, 12 Jun 2014

50,000 women knocked up by big data, wearable tech, crowds and cloud

Big Data, cloud, wearable computing and crowdsourcing boosters now have very, very tangible evidence of the technologies' power: 50,000 new humans. So claims an outfit called Ovuline, which offers an iOS and Android app dubbed Ovia Fertility that asks users to input details about their health and menstrual cycle, and can even …
Simon Sharwood, 27 Feb 2014
Google

Google points big data dollars at cancer

While IBM merely wants to sell stuff to the more esoteric reaches of medical research, Google has stuck a multi-million-dollar toe in the water in its own right, leading a funding round for an outfit called Flatiron Health. In the kind of phrase that only the tech industry could contemplate without a double-take, Forbes …
bug on keyboard

Infosec bods try Big Data in search for better anti-virus mousetrap

Infosec house Panda Security is looking to Big Data and application monitoring as a means to achieve better malware detection. The launch of Panda Advanced Protection Service (PAPS) is a response to the widely known shortcomings of signature-based anti-virus detection as well as a means for Panda to sell extra services. The …
John Leyden, 20 Jun 2014
iPhone in the Lake

Pivotal and CapGemini jump into 'Big Data Lake'

EMC-spawn Pivotal has a new best friend: CapGemini. The two outfits have let it be known they've buddied up in a “ strategic partnership” that will “combine Capgemini’s expertise in business solutions for big data and analytics with Pivotal’s market leading data platform technologies to deliver solutions for today’s increasingly …
Simon Sharwood, 05 Dec 2013
HMSMobile Swine Flu Center iPhone app

Google flu-finding service diagnosed with 'big data hubris'

A paper in Science claims that Google Flu Trends, unveiled back in 2008 to become a poster-child of Big Data, has one teeny, tiny, fatal flaw: it's almost always wrong. The paper – abstract here – finds that not only did Flu Trends completely miss the 2009 swine flu, but for 100 of the 108 weeks since 2011, Google's predictions …

Big data: You've got to spend a dollar ... to make fifty-two cents – report

What do you expect from big data mining: easy-to-find gold nuggets of information from the dark pits of the data dumps? According to a recent report from the Wikibon consulting group, almost half of big data projects fail. It also found that the payoffs – using current technology – are not yet worth the costs of running the …
Chris Mellor, 01 Oct 2013
tumbling dice

IBM bets the farm on big data in annual report

IBM is utterly focussed on big data and analytics as its future growth engines, according to its annual report published over the weekend. But the company has hedged a little on the future of its semiconductor and hardware businesses. Available here, the least-brochure-like bits are to be found in the A Letter from the Chairman …
Simon Sharwood, 10 Mar 2014
™ Big Data In Focus

Big Data? Yeah, nice buzzword. Give us the nuts and bolts this time

Big Data has crossed the chasm from hype to everyday reality remarkably quickly. Its adoption has been accelerated by hungry data warehousers using big data techniques to get better answers from their data mining activities. ™ Big Data In Focus Attending the TM Big Data InFocus 2014 conference in Amsterdam, it became …
Chris Mellor, 30 Jan 2014
Lake Tahoe

HPC storage bods at DDN fish for BIG CATCH in the data lake

Interview Suppliers of storage and analytics systems to the so-called "big data" lake market are enduring turbulent technology transitions and fast-changing requirements, as we saw here. Startups with $100m-plus funding are common and one, Cloudera, has surpassed $1bn in funding, as VCs and startup execs scramble to find their way through …
Chris Mellor, 09 Dec 2014
FlashRay video

My, what big data you have: NetApp's FlashRay to focus on databases

FlashRay, NetApp’s coming all flash array, is a going to be a database machine. That’s according to a NetApp video interview with its Flash Solutions VP. Ty McConney is said VP and at 9 minutes and 46 seconds into the video he answers a question about FlashRay. Youtube Video Ty McConney on FlashRay video He said a first and …
Chris Mellor, 03 Sep 2014

Big data minnow swallowed by security player Accumuli

AIM-listed specialist security player Accumuli has coughed £1.9m for small Bracknell-based big data analytics reseller and integrator EQUALIS, it confirmed to the City today. This bolt-on-buy adds a seven-strong band of big data boffins that sell software from Splunk - for which EQUALIS is Blighty's only authorised training …
Paul Kunert, 02 Dec 2013

Big Data is bovine excrement says Obama's Big Data man

Big Data is “bullshit”, says Harper Reed, Chief Technology Officer at Obama for America 2012. Speaking at the CeBIT conference in Sydney, Australia, today, Reed said he encountered the the term “Big Data” in 2007 when it referred to a storage problem. “We used it in 2007 because it was hard to store data,” he said. “People who …
Simon Sharwood, 28 May 2013
IDC total storage Q1 cy2014

Is it THE END OF BIG DATA? Quarta Horribilis for high-end storage

IDC has just revealed one of the worst storage quarters for a couple of years as buyers went on a high-end storage strike. There's been a quite spectacular slump in the storage business in the first 2014 quarter, according to the beancounters' Storage Tracker. Notwithstanding the digital-universe-drowning-us-in-Big-Data …
Chris Mellor, 06 Jun 2014

'Big data' predicts stock movements, boffins claim

Researchers from the Warwick University's business school reckon they can predict the next crash, by watching Google searches and Wikipedia. The supposed power of Google as a predictive tool has been popular in academia ever since The Chocolate Factory unveiled Google Flu Trends back in 2008. Its usefulness for real-world …
DDN CEO and co-founder Alex Bouzari

Alex Bouzari on his big data storage firm: First, we got rid of the VCs

DataDirect Networks is quite unusual for a storage firm. First, it operates at supercomputer and HPC levels and is neither VC-backed nor a public company, making its internal strategies a matter for its execs alone. In this respect, it’s not as predictable or understandable as either a VC-backed startup or a post-IPO business. …
Chris Mellor, 30 Jun 2014
Two teenage girls - one whispering in other's ear

Big Data is like TEENAGE SEX

The joke doing the rounds on social media compares big data to teenage sex: everyone's talking about it, only a few know how to do it, they all think everyone else is at it and so pretend they are too. And humans fumbling about in the dark, so to speak, are the weakest link in the world of analytics and data, said Steve Brazier …
Paul Kunert, 20 Feb 2014

Big data hitting the fan? Nyquist-Shannon TOOL SAMPLE can save you

Big Data's Big 5 You are working on a big data project that collects data from sensors that can be polled every 0.1 of a second. But just because you can doesn’t mean you should, so how do we decide how frequently to poll sensors? The tempting answer is to collect it all, every last ping. That way, not only is your back covered but you can also …
Mark Whitehorn, 23 May 2014
Hadoop Elephant

VMware brings big data to vSphere standard edition

Virtualisation and Hadoop are a natural fit: who wants every node to be physical when there's computing and storage resources out there that could be put to work performing Hadoopery when you need it, then freed to do other stuff at other times? VMware noticed the potential for Hadoop on vSphere ages ago and released “Big Data …
Simon Sharwood, 31 Oct 2013
Gordo: EPIC FAIL

No, Big Data firm, the UK isn't teeming with UBER-FRISKY GIGOLOS

Worstall @ the Weekend You may or may not have seen that the government has decided that GDP, the measurement of the size of the economy, should now include the activity surrounding drugs and prostitution. We can now assuage our guilt at that quick shag and a toke on the way home with the thought that we are, in fact, making the country richer as we …
Tim Worstall, 05 Oct 2014
SAP Match Insights

SAP: It was our Big Data software wot won it for Germany

When England played in Ecuador and Honduras for “warm weather training” in June ahead of the World Cup, they’d already lost the tournament – they just didn’t know it. SAP Match Insights Do the bendy data, SAP Wayne Rooney and Co took to the field in Florida to adjust to the hot and humid climate they’d face in Brazil and to …
Gavin Clarke, 22 Jul 2014
App Magnets

Remember that Big Blue Apple? Biz apps for iPads are here

The fruits of Apple and IBM’s enterprise software alliance were today plucked and displayed for the world to see: a bunch of apps ported to iOS that target corporate buyers of iPad and iPhones in specific vertical industries. In the first tranche of Big Blue developed MobileFirst “made for business” apps and “supporting” cloudy …
Paul Kunert, 10 Dec 2014
B&W film still of man with electric drill.

Is your data boring? MapR wants you to bore it back with Apache Drill

MapR has given its customers a new way to use SQL to query their Big Data stores, with the addition of Apache Drill to MapR's eponymous Hadoop distribution. Drill is an open source project developed largely by MapR that aims to create a work-alike to Google's proprietary Dremel data analytics tool, which the Chocolate Factory …
Neil McAllister, 16 Sep 2014
Tubbs from the League of Gentlemen. Illustration by Doeth Gwraig

Warning to those who covet the data of Internet of Precious Things

Data generated by devices in the "internet of things" age should be "regarded and treated as personal data", data protection authorities from across the globe have agreed. The watchdogs said it is "more likely than not" that such data can be attributed to individuals. "Internet of things’ sensor data is high in quantity, …
OUT-LAW.COM, 22 Oct 2014

Supercomputer-maker Cray offers cold storage to hungry Big Data boys

Supercomputer supplier Cray is offering archival storage for cold data with automated movement across four storage tiers. The product is a large-scale tiered storage archive solution intended for the HPC and Big Data markets. Cray's Tiered Adaptive Storage (TAS) offering uses Storage Manager archival software from Versity, in …
Chris Mellor, 06 Nov 2013
Oracle Termites

Cloudera, MongoDB go on a Big Data date, fall in love, jump in bed

MongoDB and Cloudera have announced a partnership that will link their sales, marketing, and technology assets together, posing a significant threat to incumbents like Oracle and IBM and other startups like VMware's Pivotal. The tie-up was announced on Tuesday and will see NoSQL database company MongoDB work with Hadoop firm …
Jack Clark, 29 Apr 2014
Merlin Data Center Interior

Is your data growing too big to handle?

For years we have been told that consolidation and centralisation are good things, especially in the realm of data storage. Not only do they mean fewer boxes to manage, but with the utilisation rate of direct-attached storage running at maybe 30 per cent, moving to shared storage can allow us to dramatically prune back slack …
Bryan Betts, 26 Sep 2014
australia

Cloud, virtualisation and big data added to TAFE curriculum

A new curriculum for information technology courses taught at Australia's colleges of technical and further education (TAFEs, Polytechnic for UK readers, community college in the USA) has been released. “ICA 11 2.0” emerged yesterday and describes dozens of different qualifications and hundreds of subjects taught at TAFE. The …
Simon Sharwood, 07 Nov 2013
Cirrus clouds

5 years in storage: Flash mutants, big data and (WTF is) the cloud

Over the last five years, there have certainly been a few structural changes: the wannabes and the could've-beens have mostly disappeared through acquisition or general collapse. But the big players are still the big players: EMC, HDS, HP, IBM and NetApp still pretty much dominate the industry. And the big firms core products …
StorageBod, 25 Sep 2013
Hadoop Elephant

Fruit of the Loom: Teradata ladles out free bowls of Hadoop data soup-strainer

As of Thursday, Teradata is giving out free dollops of big-data analytics for Hadoop, via the latest release of its recently purchased Loom tool. The data warehouse giant is expected to release Loom 2.3, updating the data-provenance and metadata suite it bought in July from Revelytix. Loom is used to prep data coming into BI …
Gavin Clarke, 09 Oct 2014