Articles about Big Data

Elephant

What you think is big data isn't what the bloke next to you thinks is big

America's National Institute of Standards and Technology (NIST) has added another monster document to its big data frameworks, this time covering interoperability. The seven-volume, 340-plus-page tome is designed to set the direction for America's input into international standards, the NIST says in its canned announcement. …
Boeing's CST-100 space capsule

Big Yellow brings in Boeing bods to bolster Big data bid

Symantec is acquiring 65 security engineers from Boeing as a part of a deal to beef up its expertise in Big Data, prior to a split between its security and storage divisions later this year. As part of the deal Big Yellow is also licensing technology from Boeing's Narus security division, which develops network-monitoring …
John Leyden, 13 Jan 2015

EU ministers hold Big Meeting on Big Data. But how will they get you to hand it over?

Analysis Europe’s Industry and Internal Market Ministers have been told to have a good long think about Big Data before showing up to their next meeting in Brussels on 2 March. The “theme” of the next Competitiveness council meeting is “Unlocking Europe's digital potential: faster and wider innovation through open, networked and data- …
Jennifer Baker, 18 Feb 2015
Cloud Hype Hoodie

AWS flops out massive D to vaporise big data rigs

Big data's a fine concept, but when it meets the real world of buying kit to run it on things can get nasty because the cost of the rigs required to crunch lots of data can be very considerable. Some big data vendors make a virtue of offering their own specialised servers for the job and the likes of VMware offer ways to create …
Simon Sharwood, 01 Apr 2015
Inside the CMS experiment

BIG DATA wizards: LEARN from CERN, not the F500

Big data has a problem: it is being abused. One of the biggest misconceptions is that big data is about archiving everything forever, buying the biggest, cheapest storage pool, and building a giant proverbial barn of hay in order to try to find needles. Vendor marketing has abused this. Consider marketing that advises that you …
John Nicholson, 23 Mar 2015

Big data, come to BIG DADDY: HDS gobbles upstart Pentaho

Hitachi Data Systems is snapping up Pentaho for its big data integration and predictive analysis technology. Here's a quick look at Pentaho's history: Oct 2004: Founded by Doug Moran, James Dixon (CTO), Richard Daley (chief strategy officer) and Marc Batchelor (chief engineer) 2005: $5m A-round 2006: $8m B-round 2008: $12m C …
Chris Mellor, 10 Feb 2015
EMC_Big_Data_Event

EMC pitches a total DATA LAKE immersion

Fancy monetising your Big Data assets? EMC is flagging up a Big Data event on 23 March dealing with "scaling Big Data across an enterprise", whatever that means. If you attend you will “learn to work with Big Data, monetise your Big Data assets and see a fast and flexible Big Data solution”. The invite video includes the logos …
Chris Mellor, 17 Mar 2015
Hortonworks logo

Big data = big loss for Hadoop-flinger Hortonworks

If the future of big data is Hadoop, those peddling it still have a long journey ahead of the them. Newly IPO'd Hortonworks' inaugural results show a company whose losses are growing as its business expands. Further, it’s not subscriptions to Hortonworks’ implementation of the open-source Hadoop that are growing most – it is …
Gavin Clarke, 25 Feb 2015

'Privacy is DAMAGING to PROGRESS' says Irish big data whitepaper

More than 350 Irish boffins have signed a white paper calling for nothing less than a “Magna Carta for Data”. The Insight Centre for Data Analytics says it wants to “put Europe on the road to fair and relevant legislation”, but most of the language sounds like what it really wants is to water down privacy rights in favour of Big …
Jennifer Baker, 06 Feb 2015

HP flings big data at cloud, sysadmins' faces

Your log files, the story goes, aren't just a record of every every stray packet that grazes your firewall or every temperature spike inside your servers when someone uses the microwave in the lunch room. They're really a treasure trove of hidden indicators that can tell you not just how to stop IT breaking at the worst possible …
Simon Sharwood, 07 Dec 2014
SAmba

Fujitsu’s customers come big data samba dancing

Fujitsu is helping its customers get up (and down again) on the big data dance floor and do the analytics samba with an integrated bundle of HW and SW and services called PRIMEFLEX for Hadoop (PfH - our initials) to save customers from any DIY aggro. Fujitsu's PRIMEFLEX - the company loves all-caps product names - is an …
Chris Mellor, 19 Dec 2014

Darwin, Beer and Big Data? Must be a Reg Lecture Video

Reg Events On Tuesday 25 November, Professor Mark Whitehorn kicked off the inaugural Reg Christmas Lectures, and what a night it was... We packed them in upstairs at the Craft Beer Company pub on Leather Lane, Clerkenwell. It was tight, but nobody was stirring, not even a mouse as Mark took the attendees on a whirlwind journey around the …
Joe Fay, 03 Dec 2014
Brent Spiner signed photo saying 'Big Data'

Inspired by Linux, Pivotal to open-source bulk of big data suite

Pivotal will make the majority of its big data suite open source, drawing inspiration from the Linux concept. The decision will see “core” code for HAWQ, Greenplum Database and Pivotal GemFire released to anyone who cares to footle with it, but plenty of the footling looks like it will be done by a new group calling itself the …
Simon Sharwood, 17 Feb 2015

SecureData buys into big data, grabs stake in software developer

Security integrator SecureData has coughed an undisclosed sum for a minority stake in Paterva, the developer and purveyor of big data wares. Security, mobility, social, cloud and big data are the market drivers being talked by vendors from HP and IBM to Microsoft – and now the Kent-based supplier has a footprint in two of those …
Paul Kunert, 05 Aug 2014
Billy_Connolly

Bring your spade: The BIG DATA Gold Rush has begun

The forty-niners rushed to California in search of gold. Some even found it. But most stayed poor and the only people who got reliably rich were people who made and sold the picks and shovels the miners needed. Is that the way it is with big data? Will the only people to get rich be the suppliers of big data computer software, …
Chris Mellor, 03 Oct 2014
Carpenters_workbench

Can it be true? A BIG DATA benchmark? Yes, says TPC

Up until now there hasn't been an objective or standard way of comparing different suppliers' big data systems performance. The Transaction Processing Council (TPC) is remedying that with its TPCx-HS benchmark. The TPC provides objective, vendor-neutral benchmarks for things like virtual servers and transaction processing. The …
Chris Mellor, 20 Aug 2014

€2 BILLION: Steelie Neelie wants US to pay for her Big Data splurge

Knowledge is power. That’s the message from Steelie Neelie as the EU Commission throws half a billion at “big data”. Digital Agenda Commissioner Neelie Kroes announced the EC would contribute €500m to a €2.5bn scheme to leverage the power of big data. The rest will come from industry. According to the Commission, mastering big …
Jennifer Baker, 13 Oct 2014
A boffin

Cisco, MapR first to top Big Data TPC benchmark tree

Cisco and MapR have posted the first Big Data TPCx-HS benchmark, but, of course, there's nothing to actually compare it with yet. The TPC Express HS (TPCx-HS) benchmark result was based on clustered Cisco UCS servers running Red Hat Linux and MapR Hadoop. TPC is the Transaction Processing Council, which helps produce auditable …
Chris Mellor, 05 Mar 2015
Night scene of bank station in central london

Finally, a decent use for big data: Weeding out crooked City traders

Financial institutions in London could use "big data" technology to pinpoint malpractice by City traders in future, a panel advising the Bank of England has said. The Market Practitioner Panel (MPP) said existing methods of monitoring for illegal trading practices, such as "key word surveillance", were flawed and that deploying …
OUT-LAW.COM, 24 Feb 2015
Oracle's next-gen Big Data Appliance

Oracle releases 'lite' virtual Big Data appliance

Oracle has released tool that should make it easier for developers to code applications for its Big Data Appliance. Big Data Lite, as the tool is called, bundles Oracle Linux, Cloudera software, Hadoop and plenty of Oracle's cloud connectors, just about replicating the environment available on Big Red's Big Data Appliance. The …
Simon Sharwood, 30 Jan 2014
Japanse suspension bridge

Wonderful wizard of WOS daddy DDN moves into big data

Comment HPC and supercomputer storage company Data Direct Networks (DDN) says its move into enterprise big data is providing a bridge to profits, with 100 per cent revenue growth. The stats it quotes are these: Better than 100 per cent business increase in first half of 2014 compared to first half of 2013 for its enterprise big data …
Chris Mellor, 01 Sep 2014
Mike Stonebraker

Big Data high priest Stonebraker anointed with Turing Award

Michael Stonebraker of MIT's Computer Science and Artificial Intelligence Laboratory (CSAIL) has won the Association for Computing Machinery's (ACM) Turing Award. As a professor of computer science at the University of California, Berkeley, Stonebraker helped develop the Ingres and Postgres relational databases. He has …

Big Data's being held back by little talent, says Huawei head techie

Big data projects – seen by some as the tech industry’s latest snake oil and others as a potentially valuable tool to dig up fresh information – is being held back by the lack of data scientists for hire. This is according to Ron Raffensperger, Huawei’s chief techie for the IT product line that sits within its Data Centre …
Paul Kunert, 17 Sep 2014

Tesco preps for Big Data Engine dump: Laters, Clubcard dev

Retail titan Tesco is investigating the sale of Dunnhumby, the big data and data science wrangler it took over in 2004, which had helped propel the supermarket to national dominance. Tesco, Britain’s largest food retailer, has confirmed it has appointed a team of strategic advisors to explore “strategic options” for Dunnhumby. …
Gavin Clarke, 08 Jan 2015

UK watchdog grills big biz: So HOW do you use their 'consumer data'?

The UK's main competition regulator is looking to build its knowledge of how consumer data is collected, used and traded by businesses. The Competition and Markets Authority (CMA) has asked businesses, trade bodies and other stakeholders to provide it with information about the commercial use of UK consumer data (10-page/262KB …
OUT-LAW.COM, 30 Jan 2015
The tweaked artwork of our two winners' signs

Big Data shocker: Over 6 million Americans have reached the age of 112

In an illustration of what can happen when you use Big Data uncritically, it has emerged that no less than 6.5 million living Americans have reached the ripe old age of 112. Even more amazingly, it appears that just 13 of the super-silver legions are claiming benefits - and tens of thousands of them appear to be holding down …

NetApp’s effort to feed big data beast through NFS makes no sense

Opinion I’ve just finished reading some a few articles about NetApp on the Register and Val Bercovici on NetApp’s blog and I have a question. NFS for Hadoop? Really? In this correspondent's opinion, it simply makes no sense at all. Yes, you could find corner cases – you can always find a corner case for something you love – but in this …
IBM Headquarters, Armonk, NY

If in doubt, blow $4bn: IBM says it will fatten up on cloud, mobile, Big Data cake by 2018

IBM is betting billions that it can claw its way back to growth by focusing on what it calls its "strategic imperatives," including cloud, data analytics, mobility, social networking, and security. During Big Blue's annual meeting with financial analysts on Thursday, CFO Martin Schroeter said IBM plans to shift $4bn of spending …
Neil McAllister, 26 Feb 2015
Storage disks, photo: Gavin Clarke

Like condoms, data now comes in big and HUGE sizes

If condoms were made in a range of different sizes, the old joke goes, the options would be “huge”, “gigantic” and “enormous”. We mention the joke in reference to The Linux Foundation's decision to create a new conference, called “Vault”, to “... bring together the world’s leading developers in filesystems and storage in the …
Simon Sharwood, 29 Aug 2014
Archimedes

'Urika': Cray unveils new 1,500-core big data crunching monster

Big data analytics people are constantly panning for nuggets of gold, and Cray has just the machine for them — its Urika-XA. Said to be a single-platform entity, consolidating a wide range of analytics workloads previously needing separate systems, its design has been optimised for compute- and memory-intensive and latency- …
Chris Mellor, 16 Oct 2014

SQL fights back against NoSQL's big data cred with SQL/MDA spec

With the growing popularity of big-data tools like NoSQL databases and Hadoop, it might have looked like SQL could be in line to be moved on from “venerable” tag to “obsolete”, but last week, the ISO SQL working group agreed to start work on SQL/MDA (multi-dimensional array) specs. The people behind SQL have decided it's time to …

El Reg Christmas Lectures to span space, big data and GCHQ

Reg Events What will you be doing in the run-up to Christmas? Mad dash round the shops? Crunching the end of year numbers? Warm white wine and cold sausages in a meeting room? Or will you be kicking back with other similarly bright people, sipping hand crafted beer and listening to a bona fide expert talk about space exploration; or using …
Joe Fay, 09 Oct 2014

Elasticsearch tells us all about its weighty Big Data tool

Blink and you'll miss it. Big Data analytics is a huge focus of startup activity with young and new companies getting a green light from blue-chip customers and VCs almost all the time. Well, that’s an exaggeration, but take your eye off the ball in this area and the landscape can change in fairly short order. Elasticsearch, …
Chris Mellor, 23 Dec 2014
Hadoop_elephant

Teradata gobbles up data squasher RainStor

Teradata has bought RainStor, the deduping database supplier and Hadoop convert. RainStor specializes in archiving and two years ago put its analytics engine and enterprise database on Hadoop, the Google-inspired big-data cruncher. Financial terms of the deal for the privately held RainStor were not revealed. Teradata called …
Gavin Clarke, 18 Dec 2014

Hortonworks dishes out Hadoop for HDS: Mmmm, open source with big vendor gravy

HDS will offer open-source data muncher Hadoop to the enterprise after doing a deal with Hortonworks. Hadoop distributor Hortonworks has signed an agreement with HDS to jointly promote and support the software. HDS can now deliver Hortonworks' Data Platform (HDP), Hadoop in other words, to its enterprise customers. Hortonworks …
Chris Mellor, 13 Feb 2015
Cloud security

Make sure big data doesn't land you in big trouble

Size isn't everything. Big data may be about storing terabytes or petabytes of information but it is also about complexity, and complexity often brings security challenges. Are you ready to handle them? Right now, someone in a marketing or finance role somewhere in your organisation is probably putting together a big data …
Danny Bradbury, 14 Nov 2014

SHARE your big data scientist. They're too costly and rare to keep a whole one – HP exec

Big data is on the strategic priority dashboard of every enterprise tech firm, but coughing a potentially princely sum for skilled people to talk the talk in complex projects may not be commercially viable for some in the channel. It's the age old issue of when to invest in a specific practice, one that Sue Barsamian, HP …
Paul Kunert, 15 Jul 2014
Octopus

What kind of Big Data is yours? Is it data bauxite, data aluminium ... or data Dreamliner?

Analysis Data is valuable. There, we’ve said it, do you feel better? The question is, has data as an information currency - and an entity in and of itself - become inherently more valuable? Now that we have real time transactional big data analytics to enrich our lives, does this mean that the 1s and 0s inside every binary now somehow …

Flappy Bird crosses over into cryptocurrency, big data

The Flappy Bird phenomenon is showing little sign of hitting one last, fatal, pipe as the game has now spawned at least two Bitcoin clones and a big data analysis of gamers' performance. On the cryptocurrency front, Flappycoin Pool, and the still-to-launch Flappycoin.org are battling it out for supremacy, with the latter …
Simon Sharwood, 18 Feb 2014
Broke - empty pockets

Some first-wave big data projects 'written down' says Deloitte

Consultancy outfit Deloitte reckons early big data projects have had to be written down because they failed, thanks in part to a “buy it and the benefits will come” mentality. The source of failure was sometimes difficulty making open source software work and/or integrate with other systems, Deloitte Australia's technology …
Simon Sharwood, 19 Feb 2014
Person throwing rock at tank

Big Data will shield the Apple Watch from Android onslaught

It's possible that the arrival of a firm like Apple into wearables with its watch validates the space, just as Apple validated smart phones eight years ago. Sure, smartphones existed before, but no-one thought they were much cop. Since then, everyone up to and including John the Baptist has plunged into the market and there's …
Tim Worstall, 27 Mar 2015

Speaking in Tech: Big Data and the ‘Everything In The Cloud’ obsession

Podcast speaking_in_tech Greg Knieriemen podcast enterprise This week's show is hosted by Ed Saipetch, with able support from Greg Knieriemen and Sarah Vela. We're celebrating our 3rd anniversary with some of our favorite guests, including EMC's Mark Twomey (aka "Storagezilla"), Amy Lewis from SolidFire and Geek Whisperers and Marc …
Team Register, 25 Mar 2015
Sandisk_Infiniflascard

To InfiniFlash and beyond: SanDisk wheels out Big Data box

SanDisk has announced its InfiniFlash all-flash array for Big Data, a 3U box holding up to 512TB of data, 10 times more than the ION Accelerator appliance, and capable of running the same software stack – or Ceph. Sandisk_Infiniflash_box_lid_off Video* grab showing InfiniFlash box with top lid removed There are three models …
Chris Mellor, 03 Mar 2015

50,000 women knocked up by big data, wearable tech, crowds and cloud

Big Data, cloud, wearable computing and crowdsourcing boosters now have very, very tangible evidence of the technologies' power: 50,000 new humans. So claims an outfit called Ovuline, which offers an iOS and Android app dubbed Ovia Fertility that asks users to input details about their health and menstrual cycle, and can even …
Simon Sharwood, 27 Feb 2014
Un Frog

Huawei set to spin up Big Data R&D facility in France

Huawei is ramping up its data science research operation with a facility in Paris as it pushes further up the technology stack. Renato Lombardi, Huawei’s veep of European R&D, said the effort was part of the firm’s drive to increase its focus on the I in ICT, rather than its pure comms roots. The China-based vendor has been …
Joe Fay, 12 Jun 2014
ClusterStor 1500

Seagate and SGI buddy up to flog HPC bigness to big business

Seagate has signed up SGI to resell its ClusterStor supercomputing and big data arrays. SGI will now resell the ClusterStor 1500, 6000, and 9000 products and the Secure Data Appliance (SDA) with its Kerberos network authentication protocol to enable symmetric-key cryptography. SGI competitor Cray OEMs ClusterStor arrays in its …
Chris Mellor, 18 Nov 2014
iPhone in the Lake

Pivotal and CapGemini jump into 'Big Data Lake'

EMC-spawn Pivotal has a new best friend: CapGemini. The two outfits have let it be known they've buddied up in a “ strategic partnership” that will “combine Capgemini’s expertise in business solutions for big data and analytics with Pivotal’s market leading data platform technologies to deliver solutions for today’s increasingly …
Simon Sharwood, 05 Dec 2013
The new Twitter logo. Pic: Twitter

Twitter, IBM, in deal to create brainy Big Blue Bird

IBM and Twitter have assembled their buzzwords, ranked them into a regiment, and jointly set them loose to march upon a waiting world, by announcing that the avian network will feed data galore to Big Blue's cloudy enterprise big data analytics offerings. Did El Reg add that the pair are promising to transform businesses and …
Google

Google points big data dollars at cancer

While IBM merely wants to sell stuff to the more esoteric reaches of medical research, Google has stuck a multi-million-dollar toe in the water in its own right, leading a funding round for an outfit called Flatiron Health. In the kind of phrase that only the tech industry could contemplate without a double-take, Forbes …
bug on keyboard

Infosec bods try Big Data in search for better anti-virus mousetrap

Infosec house Panda Security is looking to Big Data and application monitoring as a means to achieve better malware detection. The launch of Panda Advanced Protection Service (PAPS) is a response to the widely known shortcomings of signature-based anti-virus detection as well as a means for Panda to sell extra services. The …
John Leyden, 20 Jun 2014