Articles about Big Data

Look over here! SAP unveils big data HANA update

Teutonic enterprise resource planning provider SAP has unveiled a cloudy HANA big data update, in an effort to drum up more interest in its in-memory databases. The SAP HANA Vora product will apparently extend in-memory computing to distributed data, and allow companies to mash up their corporate and Hadoop data. HANA Vora …
Kat Hall, 02 Sep 2015
Elephant Are we talking about Big Data enough? Should we plug it more?

The UK government's Science and Technology Committee has today opened an inquiry tasked with "examining the opportunities and risks of big data." The inquiry will look at whether the government is doing enough to promote the tech to Blighty's entrepreneurs, as well as issues around data protection and privacy. Nicola …
Kat Hall, 27 Jul 2015

Intel doubles down on Big Data for population health

Chipzilla reckons urban population health is ripe for the Big Data treatment, and is setting up a lab in France to prove it. Intel has announced it will work with Teratec Consortium in the project. The lab, located in a technology park home to 80 technology and industrial companies, will focus on initiatives including …

Hortonworks bags US-gov inspired Big Data tech

Hortonworks is buying dataflow specialist Onyara, making the Hadoop-simplifying tech for use in the Internet of Things (IoT) its third corporate purchase. Financial terms of the deal were not revealed. The deal follows the Hadoop spinner’s purchase of SequenceIQ in April this year and XA Security in the Big Data security …
Gavin Clarke, 25 Aug 2015

Intel adds big data functions to math libraries

Intel is eyeing off the world of Big Data with the latest round of updates to its Parallel Studio Suite. In the latest update, Chipzilla has added a Data Analytics Acceleration Library (DAAL) to its venerable Math Kernel Library (MKL). As Intel explains here, DAAL's aim is to speed the operation of data analysis platforms …

What you think is big data isn't what the bloke next to you thinks is big

America's National Institute of Standards and Technology (NIST) has added another monster document to its big data frameworks, this time covering interoperability. The seven-volume, 340-plus-page tome is designed to set the direction for America's input into international standards, the NIST says in its canned announcement. …

Big Data investment? Tick, says MXC Capital

Channel merchant banker MXC Capital has splashed £4.8m on a minority stake in big data analytics minnow Sagacity Solutions - a price tag that matches the software firm’s turnover last year. The move comes weeks after MXC director Ian Smith told us he wants to place bets behind businesses in software development, managed …
Paul Kunert, 08 Sep 2015

Amazon flings open source Elasticsearch at Big Data's cloud

Amazon is rolling out open-source Elasticsearch for consumers of its mega cloud. The giant has launched Amazon Elasticsearch Service (Amazon ES), adding another NoSQL-based big-data analytics and query option. The idea is to let you load, process and analyse unstructured data. Elasticsearch on AWS can be deployed to Amazon …
Gavin Clarke, 02 Oct 2015
Deflated balloon elephant by CC 2.0 attribution

Forget Big Data hype, says Gartner as it cans its hype cycle

Analyst outfit Gartner has decided that Big Data hype is so last year and canned its hype cycle for Big Data. In new research titled “The Demise of Big Data, Its Lessons and the State of Things to Come” the firm says “we did it to move the big data discussion past hype and into practice” and also because “Hype Cycles consider …
Simon Sharwood, 21 Aug 2015
Data scientist image via Shutterstock

Australian Bureau of Statistics drops big data bubble-buster

Big Data, the shiny happy story goes, will let governments direct resources into programs that really do make a difference to the problems society faces, resulting in better services, less waste and grins on every face. But Australia's Bureau of Statistics (ABS) has just published a Research Paper A Statistical Framework for …
Simon Sharwood, 30 Jun 2015
Boeing's CST-100 space capsule

Big Yellow brings in Boeing bods to bolster Big data bid

Symantec is acquiring 65 security engineers from Boeing as a part of a deal to beef up its expertise in Big Data, prior to a split between its security and storage divisions later this year. As part of the deal Big Yellow is also licensing technology from Boeing's Narus security division, which develops network-monitoring …
John Leyden, 13 Jan 2015

EU ministers hold Big Meeting on Big Data. But how will they get you to hand it over?

Analysis Europe’s Industry and Internal Market Ministers have been told to have a good long think about Big Data before showing up to their next meeting in Brussels on 2 March. The “theme” of the next Competitiveness council meeting is “Unlocking Europe's digital potential: faster and wider innovation through open, networked and data- …
Jennifer Baker, 18 Feb 2015
Three cows image via Shutterstock

Hey biz types: You don't grok Big Data. But you can use Salesforce, right?

Having sidled into the cash-rich analytics party seven months back, Salesforce is now out and proud on the hype-heavy big data field. The CRM-as-a-Service provider on Thursday announced Salesforce Wave for Big Data. It also announced that the big-data trio Google, Cloudera and Hortonworks plus Informatica - plus analytics …
Gavin Clarke, 28 May 2015

There's little spending on Big Data, object storage and OpenStack

A DataCore survey has shown little spending on sexy storage products in the Big Data, public cloud, object storage, and OpenStack areas, arguing software-defined storage (SDS) gives a faster payback. DataCore asked 477 IT professionals currently using or evaluating software-defined storage technology about their 2015 spending …
Chris Mellor, 13 May 2015
Cloud Hype Hoodie

AWS flops out massive D to vaporise big data rigs

Big data's a fine concept, but when it meets the real world of buying kit to run it on things can get nasty because the cost of the rigs required to crunch lots of data can be very considerable. Some big data vendors make a virtue of offering their own specialised servers for the job and the likes of VMware offer ways to create …
Simon Sharwood, 01 Apr 2015
Angle grinder image via Shutterstock

MapR and Typesafe put Apache's Spark to work on big data

Big data and developer advocates are joining IBM promoting Apache’s cluster computing framework as a safe and consumable platform for business. MapR is bowling out Spark offerings tailored to three scenarios with its implementation of the Hadoop batch-crunching framework. MapR has announced the Real-time Security Log Analytics …
Gavin Clarke, 16 Jun 2015
Inside the CMS experiment

BIG DATA wizards: LEARN from CERN, not the F500

Big data has a problem: it is being abused. One of the biggest misconceptions is that big data is about archiving everything forever, buying the biggest, cheapest storage pool, and building a giant proverbial barn of hay in order to try to find needles. Vendor marketing has abused this. Consider marketing that advises that you …
John Nicholson, 23 Mar 2015

Big data, come to BIG DADDY: HDS gobbles upstart Pentaho

Hitachi Data Systems is snapping up Pentaho for its big data integration and predictive analysis technology. Here's a quick look at Pentaho's history: Oct 2004: Founded by Doug Moran, James Dixon (CTO), Richard Daley (chief strategy officer) and Marc Batchelor (chief engineer) 2005: $5m A-round 2006: $8m B-round 2008: $12m C …
Chris Mellor, 10 Feb 2015

Grounded: Can big data do for agri-business what it's not doing for retail?

Like fusion energy, big data has consistently promised amazing results – always at some indeterminate point in the future. We know grocers track every purchase, index them against our loyalty cards (translation: database index keys), and develop rich models of consumer behaviour that have, despite all of the millions of …
Mark Pesce, 24 Sep 2015

EMC pitches a total DATA LAKE immersion

Fancy monetising your Big Data assets? EMC is flagging up a Big Data event on 23 March dealing with "scaling Big Data across an enterprise", whatever that means. If you attend you will “learn to work with Big Data, monetise your Big Data assets and see a fast and flexible Big Data solution”. The invite video includes the logos …
Chris Mellor, 17 Mar 2015
Hortonworks logo

Big data = big loss for Hadoop-flinger Hortonworks

If the future of big data is Hadoop, those peddling it still have a long journey ahead of the them. Newly IPO'd Hortonworks' inaugural results show a company whose losses are growing as its business expands. Further, it’s not subscriptions to Hortonworks’ implementation of the open-source Hadoop that are growing most – it is …
Gavin Clarke, 25 Feb 2015

Misconfigured Big Data apps are leaking data like sieves

More than a petabyte of data lies exposed online because of weak default settings and other configuration problems involving enterprise technologies. Swiss security firm BinaryEdge found that numerous instances of Redis cache and store archives can be accessed without authentication. Data on more than 39,000 MongoDB NoSQL …
John Leyden, 13 Aug 2015
gushing fire hydrant, photo via Shutterstock

Microsoft preps Azure data lake flood gates for readiness

Microsoft will later this year release its open-source friendly lake for big-data analytics in the cloud. Azure Data Lake Store – announced at Build in April – will be released as a preview, Microsoft said Monday. The store will be built on Apache YARN for developers and data scientists, to analyse information, and will use …
Gavin Clarke, 28 Sep 2015

Three-way EU Big Data privacy wrestling match kicks off

The EU will take a big step towards finalising measures to protect its citizens' privacy today, as negotiators from member states, the European Commission, and the European Parliament will come together for the first time to thrash out an agreement on the EU’s planned data protection law. The Parliament agreed its position on …
Jennifer Baker, 24 Jun 2015

HP flings big data at cloud, sysadmins' faces

Your log files, the story goes, aren't just a record of every every stray packet that grazes your firewall or every temperature spike inside your servers when someone uses the microwave in the lunch room. They're really a treasure trove of hidden indicators that can tell you not just how to stop IT breaking at the worst possible …
Simon Sharwood, 07 Dec 2014

'Privacy is DAMAGING to PROGRESS' says Irish big data whitepaper

More than 350 Irish boffins have signed a white paper calling for nothing less than a “Magna Carta for Data”. The Insight Centre for Data Analytics says it wants to “put Europe on the road to fair and relevant legislation”, but most of the language sounds like what it really wants is to water down privacy rights in favour of Big …
Jennifer Baker, 06 Feb 2015

Fujitsu’s customers come big data samba dancing

Fujitsu is helping its customers get up (and down again) on the big data dance floor and do the analytics samba with an integrated bundle of HW and SW and services called PRIMEFLEX for Hadoop (PfH - our initials) to save customers from any DIY aggro. Fujitsu's PRIMEFLEX - the company loves all-caps product names - is an …
Chris Mellor, 19 Dec 2014

Darwin, Beer and Big Data? Must be a Reg Lecture Video

Reg Events On Tuesday 25 November, Professor Mark Whitehorn kicked off the inaugural Reg Christmas Lectures, and what a night it was... We packed them in upstairs at the Craft Beer Company pub on Leather Lane, Clerkenwell. It was tight, but nobody was stirring, not even a mouse as Mark took the attendees on a whirlwind journey around the …
Joe Fay, 03 Dec 2014

SecureData buys into big data, grabs stake in software developer

Security integrator SecureData has coughed an undisclosed sum for a minority stake in Paterva, the developer and purveyor of big data wares. Security, mobility, social, cloud and big data are the market drivers being talked by vendors from HP and IBM to Microsoft – and now the Kent-based supplier has a footprint in two of those …
Paul Kunert, 05 Aug 2014

Bring your spade: The BIG DATA Gold Rush has begun

The forty-niners rushed to California in search of gold. Some even found it. But most stayed poor and the only people who got reliably rich were people who made and sold the picks and shovels the miners needed. Is that the way it is with big data? Will the only people to get rich be the suppliers of big data computer software, …
Chris Mellor, 03 Oct 2014

Can it be true? A BIG DATA benchmark? Yes, says TPC

Up until now there hasn't been an objective or standard way of comparing different suppliers' big data systems performance. The Transaction Processing Council (TPC) is remedying that with its TPCx-HS benchmark. The TPC provides objective, vendor-neutral benchmarks for things like virtual servers and transaction processing. The …
Chris Mellor, 20 Aug 2014

Big Data, OpenStack and object storage: Size matters, people

COMMENT I’m talking about Big Data, OpenStack and object storage. In the last two days I’ve come across a couple of articles (here and here), which discuss the adoption of these technologies. Both articles start from surveys that talk about scarce adoption in the enterprise space for these technologies. When talking about them, two …
Brent Spiner signed photo saying 'Big Data'

Inspired by Linux, Pivotal to open-source bulk of big data suite

Pivotal will make the majority of its big data suite open source, drawing inspiration from the Linux concept. The decision will see “core” code for HAWQ, Greenplum Database and Pivotal GemFire released to anyone who cares to footle with it, but plenty of the footling looks like it will be done by a new group calling itself the …
Simon Sharwood, 17 Feb 2015

Apple and IBM foist fondleslabs on Japanese elders in Big Data snatch

Apple and IBM have jointly announced a scheme under which they will hand out five million iPads to elderly folks in Japan over the next five years and reap a mighty harvest of bigdata thereby. The two zaibatsu – whose combined names can be rearranged anagrammatically to "Able Pimp" – have teamed up to ensure utter market …

€2 BILLION: Steelie Neelie wants US to pay for her Big Data splurge

Knowledge is power. That’s the message from Steelie Neelie as the EU Commission throws half a billion at “big data”. Digital Agenda Commissioner Neelie Kroes announced the EC would contribute €500m to a €2.5bn scheme to leverage the power of big data. The rest will come from industry. According to the Commission, mastering big …
Jennifer Baker, 13 Oct 2014
Oracle's next-gen Big Data Appliance

Oracle releases 'lite' virtual Big Data appliance

Oracle has released tool that should make it easier for developers to code applications for its Big Data Appliance. Big Data Lite, as the tool is called, bundles Oracle Linux, Cloudera software, Hadoop and plenty of Oracle's cloud connectors, just about replicating the environment available on Big Red's Big Data Appliance. The …
Simon Sharwood, 30 Jan 2014
Noah's Ark

Tegile's new faster fatter flash box flings self at big data analytics

Tegile is, or rather was, a hybrid flash/disk array startup alongside Nimble Storage and Tintri. All three have been growing furiously, offering near-flash array speed with disk economics for bulk data. There are four products in Tegile's hybrid array line-up: T3100 with 96GB of controller memory and 26TB–170TB of raw …
Chris Mellor, 27 Aug 2015
Japanse suspension bridge

Wonderful wizard of WOS daddy DDN moves into big data

Comment HPC and supercomputer storage company Data Direct Networks (DDN) says its move into enterprise big data is providing a bridge to profits, with 100 per cent revenue growth. The stats it quotes are these: Better than 100 per cent business increase in first half of 2014 compared to first half of 2013 for its enterprise big data …
Chris Mellor, 01 Sep 2014
A boffin

Cisco, MapR first to top Big Data TPC benchmark tree

Cisco and MapR have posted the first Big Data TPCx-HS benchmark, but, of course, there's nothing to actually compare it with yet. The TPC Express HS (TPCx-HS) benchmark result was based on clustered Cisco UCS servers running Red Hat Linux and MapR Hadoop. TPC is the Transaction Processing Council, which helps produce auditable …
Chris Mellor, 05 Mar 2015
Night scene of bank station in central london

Finally, a decent use for big data: Weeding out crooked City traders

Financial institutions in London could use "big data" technology to pinpoint malpractice by City traders in future, a panel advising the Bank of England has said. The Market Practitioner Panel (MPP) said existing methods of monitoring for illegal trading practices, such as "key word surveillance", were flawed and that deploying …
OUT-LAW.COM, 24 Feb 2015
Mike Stonebraker

Big Data high priest Stonebraker anointed with Turing Award

Michael Stonebraker of MIT's Computer Science and Artificial Intelligence Laboratory (CSAIL) has won the Association for Computing Machinery's (ACM) Turing Award. As a professor of computer science at the University of California, Berkeley, Stonebraker helped develop the Ingres and Postgres relational databases. He has …

Big Data's being held back by little talent, says Huawei head techie

Big data projects – seen by some as the tech industry’s latest snake oil and others as a potentially valuable tool to dig up fresh information – is being held back by the lack of data scientists for hire. This is according to Ron Raffensperger, Huawei’s chief techie for the IT product line that sits within its Data Centre …
Paul Kunert, 17 Sep 2014

Tesco preps for Big Data Engine dump: Laters, Clubcard dev

Retail titan Tesco is investigating the sale of Dunnhumby, the big data and data science wrangler it took over in 2004, which had helped propel the supermarket to national dominance. Tesco, Britain’s largest food retailer, has confirmed it has appointed a team of strategic advisors to explore “strategic options” for Dunnhumby. …
Gavin Clarke, 08 Jan 2015

UK watchdog grills big biz: So HOW do you use their 'consumer data'?

The UK's main competition regulator is looking to build its knowledge of how consumer data is collected, used and traded by businesses. The Competition and Markets Authority (CMA) has asked businesses, trade bodies and other stakeholders to provide it with information about the commercial use of UK consumer data (10-page/262KB …
OUT-LAW.COM, 30 Jan 2015

NetApp’s effort to feed big data beast through NFS makes no sense

Opinion I’ve just finished reading some a few articles about NetApp on the Register and Val Bercovici on NetApp’s blog and I have a question. NFS for Hadoop? Really? In this correspondent's opinion, it simply makes no sense at all. Yes, you could find corner cases – you can always find a corner case for something you love – but in this …
The tweaked artwork of our two winners' signs

Big Data shocker: Over 6 million Americans have reached the age of 112

In an illustration of what can happen when you use Big Data uncritically, it has emerged that no less than 6.5 million living Americans have reached the ripe old age of 112. Even more amazingly, it appears that just 13 of the super-silver legions are claiming benefits - and tens of thousands of them appear to be holding down …
IBM Headquarters, Armonk, NY

If in doubt, blow $4bn: IBM says it will fatten up on cloud, mobile, Big Data cake by 2018

IBM is betting billions that it can claw its way back to growth by focusing on what it calls its "strategic imperatives," including cloud, data analytics, mobility, social networking, and security. During Big Blue's annual meeting with financial analysts on Thursday, CFO Martin Schroeter said IBM plans to shift $4bn of spending …
Neil McAllister, 26 Feb 2015
Storage disks, photo: Gavin Clarke

Like condoms, data now comes in big and HUGE sizes

If condoms were made in a range of different sizes, the old joke goes, the options would be “huge”, “gigantic” and “enormous”. We mention the joke in reference to The Linux Foundation's decision to create a new conference, called “Vault”, to “... bring together the world’s leading developers in filesystems and storage in the …
Simon Sharwood, 29 Aug 2014

SQL fights back against NoSQL's big data cred with SQL/MDA spec

With the growing popularity of big-data tools like NoSQL databases and Hadoop, it might have looked like SQL could be in line to be moved on from “venerable” tag to “obsolete”, but last week, the ISO SQL working group agreed to start work on SQL/MDA (multi-dimensional array) specs. The people behind SQL have decided it's time to …
management governance3

The blessing and the curse of Big Data

Sysadmin blog Companies more familiar with technology are more likely to use the reporting and analytics features of their software. This isn't something new, and it didn't start with computers. Computers make reporting and analytics easier, but every business needs hard data if they are to grow. Back in the day, "reporting and analytics" …
Trevor Pott, 01 Jul 2015