Articles about Big Data

Clone army star wars

Clone it? Sure. Beat it? Maybe. Why not build your own AWS?

You can't move without IT companies telling you about the "amazing" new technologies and features they've just launched, how you can't live without them, and what a shock it is that you've managed all these years before they were developed. And of course the bigger the company, the more new stuff they tend to pump out and the …
Dave Cartwright, 22 Feb 2017

Big data should be 'part of UK's core national infrastructure' – Civil Service chief exec

The chief executive of the Civil Service, John Manzoni, says the UK needs to begin to consider the "collection and storage of data as part of [our] core national infrastructure". In a speech delivered this morning, Manzoni articulated the Civil Service's dreams about "public service modernisation", which focused on how …
Wagyu Bull

BS Detection 101 becomes actual University subject

How could El Reg ignore this? – two University of Washington professors have assembled a course to teach students to identify bullshit. Biology professor Carl Bergstrom and assistant professor at the university's Information School Jevin West have devised the “Calling Bullshit in the Age of Big Data” course as their small …
Crystal ball. Pic: Shutterstock

The stunted physical SAN market – Dell man gives Wikibon forecasts his blessing

Analysis Current thinking among vendors with hyper-converged and converged infrastructure offerings is that physical SANs are in decline and their market is shrinking. Chad Sakac, Converged Platforms Division president at Dell EMC, is the latest high-profile prognosticator to push this view. The Wikibon consultancy first talked about …
Chris Mellor, 20 Feb 2017
Australian money at a crime scene

Errors in Australia's Centrelink debt recovery system were inevitable

Since it announced a crackdown on outstanding debt in June last year, Centrelink has sent debt recovery letters to thousands of Australian welfare recipients. Early reports indicated that around 20 per cent were issued in error, although the true number may be substantially higher. This led to the appointment last week of a …
Recreation of a scene from Star Wars A New Hope: Droids R2-D2 and C-3PO escaping the Tantive IV while under Imperial attack. Figures are 6 inch Hasbro Black Series action figures

Oracle's IoT play: Teach business apps and things to talk together

Oracle has revealed another way it thinks it can address the internet of things market, by teaching its existing business apps to talk things' language. Big Red has a colossal portfolio of business apps, among them the Oracle Supply Chain Management Cloud. The company also knows that the supply chain is full of “things” - …
Simon Sharwood, 17 Feb 2017
Sherlocks

Analyse this: IBM moves Watson machine learning to mainframes

IBM is adding the machine learning technology from Watson to its z/OS mainframe for smarter, faster analytics of transaction data. Big Data analytics is typically applied to unstructured data in the Hadoop world. By contrast, older data warehousing and business intelligence (DW/BI) products are applied to structured data in …
Chris Mellor, 16 Feb 2017
Hal

Just finished your first TensorFlow app? Might be time for a rewrite...

Tensorflow, Google’s opensource machine learning library, has toddled into whole figures, just over a year after the first release - with the proviso that version 1.0 might not be entirely backwards-compatible with early adopters’ programmes. Using just the sort of understatement which characterises the machine learning space …
Joe Fay, 16 Feb 2017
Kid on computer, photo via Shutterstock

Dirty data, flogged cores: YES, Microsoft SQL Server R Services has its positives

The R language has enjoyed a great reputation in statistical computing and graphics for decades. However, it is also known as something for statisticians. Born around the time of Java, PHP and Python, R lags behind all three by a long chalk on the TIOBE rankings. Yet Microsoft spotted an opportunity in this era of analytics …
Andrew Cobley, 16 Feb 2017
Hadoop

IBM hooks up with Hortonworks to Hadoop Big Blue products

+Comment Cognitive Watsonian and mainframer IBM is making Hortonworks available for its Elastic Storage Server (ESS) and Spectrum Scale products. ESS is an integrated bundle of POWER8 servers, storage enclosures, disks and Spectrum Scale software. The GPFS parallel file system software was renamed Elastic Storage and then rebranded …
Chris Mellor, 15 Feb 2017
Binary data/big data conceptual illustration. Illustration via Shutterstock

With nearly 1m users on its books, DigitalOcean touts load balancers

DigitalOcean on Tuesday plans to begin offering load balancers to help its customers distribute online traffic across their infrastructure, at a cost of $20 per month. Load balancers ensure that DigitalOcean servers can handle surges of online traffic and represent an essential safety mechanism for online businesses. They …
Thomas Claburn, 14 Feb 2017
Older woman with shocked expression speaks on fixed line phone... photo by Shutterstock

Cisco's Visual Networking Index: Rather optimistic traffic numbers, aren't they?

Updated One of the toughest jobs in this industry is analyzing out the latest Cisco Visual Networking Index. First you have to get your head around all those numbers which are impossible to visualise, like exabytes. And then you start to see questions in the logic, and wonder if perhaps Cisco has gone too far off in one direction or …
Faultline, 14 Feb 2017
Trophy. Image via Shutterstock

Tech Trailblazers Awards: Shortlist out - now it’s over to you

The shortlist of entries for this year’s Tech Trailblazer Awards is available for your perusal and you now have until the end of this week to choose your favourites. The Tech Trailblazer Awards have been running for six years, giving real world companies the chance to highlight their innovation efforts, and real world users …
Team Register, 13 Feb 2017
Stealth_bomber

Say a stealthy 'hi' to Gluent, Tachyum and VAST Data

Analysis Three storage startups have hoved into view: Gluent, Tachyum and VAST Data. Gluent is a data silo virtualiser, liking RDBMS to Hadoop data for easier and simpler data analysis. Tachyum aims to, it appears, defeat Moore's Law by devising a new data processing architecture, and VAST Data, the stealthiest of the three, must be …
Chris Mellor, 13 Feb 2017
Handcuffs photo via Shutterstock

Planned Espionage Act could jail journos and whistleblowers as spies

Exclusive Proposals in the UK for a swingeing new Espionage Act that could jail journalists as spies have been developed in haste by legal advisors, The Register has learned. The proposed law update is an attempt to ban reporting of future big data leaks. The British government has received recommendations for a "future-proofed" new …
Duncan Campbell, 10 Feb 2017
First XC40, photo: Met Office

OK, 2016 wasn't the best, but look for a buyer? That's Cray

+Comment A poor year for Cray was rescued by its fourth 2017 quarter’s results. Q4 2016 Q4 2015 Change Full 2016 Year Full 2015 Year Change Revenues $346,600,000 $267,500,000 29.6% $629,800,000 $724,700,000 13.1% $51,800,000 $20,300,000 155.2% $10,600,000 $27,500,000 61.5% Full 2016 year revenues went down 13 per cent …
Chris Mellor, 09 Feb 2017
Hazelnuts

It's a Flink-off: Hazelcast launches own big data munching distributed processing engine

In-memory computing hopeful Hazelcast is launching Hazelcast Jet, a distributed processing engine for the streams of big data which the business expects will be pouring into enterprises soon. Hazelcast's eponymous in-memory data grid is based on commodity hardware rather than expensive proprietary Oracle Exadata boxes, and …
indicator on car dsah. photo by shutterstock

See that flashing taillight? Micron CEO has signalled a move

Two exec moves have flashed up in the solid state world. Micron CEO Mark Durcan told analysts he was going to stop being CEO and Kaminario’s CTO has quit. Shachar Fienblit has flagged up his Kaminario CTO slot departure on his Linked webpage. His Kaminario history is VP Engineering from April 2009 to the end of 2014, and CTO …
Chris Mellor, 06 Feb 2017

Wow, what an incredible 12 months: 2017's data center year in review

Comment The data center market is hot, especially now that we are getting a raft of funky new stuff, from promising non-Intel chips and system architectures to power and cooling optimizations. Since we're all thinking several quarters ahead anyway, we're practically in 2018. So from that point of view, we may as well look back at 2017 …
Shahin Khan, 06 Feb 2017

Pure unsheathes the FlashBlade, cuts out NetApp legacy system

A 24-rack NetApp system has been replaced with a single Pure Storage FlashBlade product at a customer site. Two Pure Storage staffers have tweeted that the replaced system spanned 1,008 rack units, was fitted with 13,000 disk drives. A Pure Storage source said that the replaced system was from NetApp. FlashBlade is Pure's …
Chris Mellor, 02 Feb 2017
Cartoon of a  Weeping man Illustration by Rogistok/Shutterstock

Speaking in Tech's Greg accepts dare to moonlight as an Uber driver

Podcast speaking_in_tech Greg Knieriemen podcast enterprise Greg, Ed and Melissa are joined by Cory Minton, Dell’s Big Data man, to discuss the on-demand economy, Oracle licensing, Platform-as-a-Service and the holographic universe. The details… (00:00) Throwing down with Smallbone (00:47) Introducing Cory Minton of Dell EMC ( …
Team Register, 01 Feb 2017
Piggy bank, image via Shutterstock

Infosec industry to drive machine learning spend surge says analyst

The information security industry's rush to adopt machine learning will help businesses burn US$96 billion on big data, intelligence, and analytics by 2021, says research house ABI . The report by lead number cruncher Dimitrios Pavlakis claims User and Entity Behavior Analytics (UEBA) and "deep learning algorithm designs" will …
Darren Pauli, 31 Jan 2017
Microsoft CEO Satya Nadella

See you around, Larry: AWS is our new Oracle, says Microsoft's Nadella

Analysis Amazon's cloud service AWS has replaced Oracle and VMware as Microsoft's chief rivals, the Windows giant's CEO Satya Nadella has said. In a conference call with analysts to discuss its Q2 2017 financials, Microsoft executives said their margins were fat enough to fend off AWS and other cloud competitors. Nadella said: "Even …
Optane

Flashy Intel sees the XPoint of solid state

Intel made $816m from flash memory products in the final 2016 quarter and sees XPoint contributing 10 per cent of revenues in 2018. This is minuscule compared to the Intel’s $16.4bn revenues for the quarter but a sizeable chunk of change in the flash business. Its Non-Volatile Memory Solutions Group saw revenues up 25 per cent …
Chris Mellor, 30 Jan 2017
Ziya_Aral

Smiley techie Datacore chairman Ziya Aral: RIP

Obit Datacore co-founder and chairman Ziya Aral has passed away, aged just 64. He co-founded DataCore with CEO George Teixeira in February 1998 after a 20 year career in the software industry, including serving as chief technology officer / vice president of engineering at Encore Computer Corporation. He also designed the first …
Chris Mellor, 30 Jan 2017
Wages

UK Cybersecurity: Permanent job salaries growing faster than contractor pay rises

Demand for cyber security skills in the UK means that salaries for full time IT security jobs are increasing faster than contractor rates, according to a new survey. Annual IT security permanent salaries climbed by 5 per cent (from Q4 2015 to Q4 2016) to £57,706, compared to a 0.62 per cent increase for contractor day rates ( …
John Leyden, 30 Jan 2017

Big Blue's BigInsights has big-ish bugs

IBM has patched twin cross-site scripting (XSS) vulnerabilities in its Hadoop-probing InfoSphere BigInsights platform. The patches released last week shutter the bugs (CVE-2016-2924, CVE-2016-2992) that could compromise users of the big data analytics software. Fortinet researcher Honggang Ren quietly reported the flaws to …
Team Register, 30 Jan 2017
Ralph Wiggum as Hamlet, ready to stab

En garde! Touché! Sorry for the cliché! Pure Storage flashes its blade

Can Pure Storage keep up its booming growth as FlashBlade, its Big Data flash box, becomes generally availabile? FlashBlade is its second solid-state storage product line following the primary data-storing FlashArray. It's aimed at fast access to unstructured data for analytics and so forth, with Pure mentioning data-intensive …
Chris Mellor, 26 Jan 2017

I've got a brand new combine harvester and I'll give you the API key

Two decades ago a tractor manufacturer was fitting smart sensors to its devices. Blending the agricultural and the technological were a natural fit, John Deere’s Georg Larscheid told The Register. Agricultural IoT is one of the more obscure areas that has largely passed the rest of the industry by, chiefly because it sticks to …
Gareth Corfield, 25 Jan 2017

US Army's spun-off GPU database gets ready for more matrix operations

Kinetica, the in-memory GPU-accelerated database, is adding user-defined functions (UDFs) to contribute to more sophisticated analytic workloads. Eric Mizell, Kinetica's global solution engineering veep, told The Register that the company was keen to discourage the idea of “data science as a black box”. Although Kinetica …
Samsung 850 EVO 1TB SSD

Samsung Electronics is on fire! In a good way as profits leap

Samsung Electronics, the Chaebol's business that encompasses smartphones, monitors, memory and more, has reported a bumper fourth quarter despite its phlaming phablet fiasco. The company today reported 53.33 trillion Korean Won (US$45.5bn) in consolidated revenue and 9.22 trillion Won ($7.93bn) in operating profit for the …
Simon Sharwood, 24 Jan 2017
Watson Power7 cluster. Pic: IBM

Elementary, my dear IBM: When will Watson make money?

IBM Watson has taken heat from Wall Street for not adding to Big Blue's revenue as the company reported a 19th successive quarter of decline. The Watson brand won worldwide attention back in 2011 when the supercomputer defeated human contestants during a special series of television quiz show Jeopardy. Now the brand lives on …
Binary data/big data conceptual illustration. Illustration via Shutterstock

StorageCraft gobbles Exablox to become data management monolith

Analysis Backup SW biz StorageCraft has bought Exablox, a startup making scale-out deduping filer arrays using underlying object storage software. The OneBlox arrays feature variable-length deduplication and compression and provide both primary and secondary storage for small and medium enterprise customers. Exablox bundled …
Chris Mellor, 20 Jan 2017

Seven pet h8s: Verity is sorely vexed

Stob Peter Wayner, a tech columnist, claims to have identified the seven most vexing problems in programming. According to his subheadings, these are: multithreading, closures, "too big data", np-completeness, security, encryption and identity management. Such lists are constructed to be disputed. Game on. To start with, Mr Wayner' …
Verity Stob, 20 Jan 2017

Viral Chinese selfie app Meitu phones home with personal data

PIC The Meitu selfie horrorshow app going viral through Western audiences is a privacy nightmare, researchers say. The app harvests information about the devices on which it runs, includes invasive advertising tracking features and is just badly coded. But worst of all, the free app appears to be phoning some to share personal …
Darren Pauli, 20 Jan 2017
Terminator

What's SimpliVity CEO Doron Kempel and Arnie got in common? They'll both be back

Profile SimpliVity CEO and cofounder Doron Kempel is a two-time storage startup winner. With HPE buying his firm for $650m, what will he do next? Before becoming involved as a storage business executive, he had what seems like a classic Israeli tech entrepreneur’s experience in the Israeli Defence Forces, only more so – much more so, …
Chris Mellor, 20 Jan 2017
Hadoop

Insecure Hadoop installs next in 'net scum crosshairs

Rinse-and-repeat ransomware attacks on data services left unsecured by dozy sysadmins are now hitting Hadoop instances. Fidelis Cybersecurity reckons it's started observing the attacks, which seek out default installations of the big data darling, copy and then wipe Hadoop instances and then demand a ransom for return of …
A dozen ASKAP dishes are now dishing up science

Square Kilometre Array precursor shrinks 5TB of data to 22MB – every second!

Australia's precursor to the Square Kilometre Array has gone from sitting on the slipway to shedding champagne-bottle shards and sliding gracefully into action. The Australian Square Kilometre Array Pathfinder, ASKAP if you're thrifty with syllables, is doing its first science for a project called WALLABY, an all-sky hydrogen …
Parliament photo by Shutterstock

UK.gov departments are each clinging on to 100 terabytes of legacy data

Some Whitehall departments are saddled with more than 100 terabytes of legacy data, and are wasting time recreating old work at a cost of £500m per year, according to a Cabinet Office report. The Better Information for Better Government report [PDF] said good information governance is critical for effective government. …
Kat Hall, 18 Jan 2017
Man looks suspiciously over his shoulder while working on laptop. Photo via Shutterstock

Exclusive billionaires' investment club leads Collibra's $50m Series C

Belgian data governance business Collibra has today announced the closure of its Series C round, almost tripling its venture capital funding. Collibra was founded in 2008, but as a European company did not follow the typical Valley model of growth and was, according to CEO and co-founder Felix Van de Maele, already cash-flow …
Oracle and Sun logo

What's big and red and needs 270 security patches?

Oracle has revealed its quarterly Critical Patch Update Advisory for January 2017, which offers users a buffet of 270 fixes to apply. Big Red says that “due to the threat posed by a successful attack, Oracle strongly recommends that customers apply CPU fixes as soon as possible.” Where to start? Perhaps with the sole problem …
Simon Sharwood, 18 Jan 2017

Australia's Department of Social Services pushing ahead with data-matching plans

The Centrelink “robo-debt” debacle hasn't dimmed the Australian government's enthusiasm for data-matching as a policy tool. The Department of Social Services (DSS) has confirmed to The Register that it plans to go ahead with its own big data project conceived in the February 2015 “McClure review” (full name: A New System for …

Top tip: Boost your supercomputing powers at ISC 2017

Promo Catch up with the latest developments in high-performance computing at the five-day 2017 ISC conference and exhibition in Frankfurt June 18-22. The theme is high-performance computing, systems and networking, as well as HPC applications in scientific and commercial environments. Conference speakers will delve into topics such …
Nicole Segre, 17 Jan 2017
handshake_648

Multi-silo data-sucker Alluxio inks deal with Dell EMC

Alluxio, the multi-silo Big Data access accelerating startup which did a deal with Huawei last year, has signed a similar one with Dell EMC for its ECS product. The problem Alluxio fixes is that many separate storage schemes exist for large-scale unstructured data that needs to be accessed by many analytics-style apps. Each …
Chris Mellor, 17 Jan 2017
Still from Back to the Future II. Pic: Universal

Seagate hauls out fat form factor throwback hard drive

It's back to the future for the latest Seagate large form factor disk with a low capacity. The company has introduced a 3.5-inch 1TB and 2TB disk drive spinning at 7,200rpm with a slow 6Gbps SATA interface, and called it an Enterprise Capacity drive. Remarkably, other 3.5-inch Enterprise Capacity drives of Seagate's go up to …
Chris Mellor, 17 Jan 2017
AI

Sysadmin chatbots: We have the technology

Storage Blockhead Chatbots are flashing up in our future view as something that could improve an admin's lot. Instead of using a GUI with nested and drill-down screen forms to do their job, they'll have a new form of Command Line Interface, only this will be a Chat Line Interface to a chatbot. Array vendor Tintri is showing how this could be …
Chris Mellor, 16 Jan 2017
Thumbs up photo via Shutterstock

Hadoop hurler Hortonworks votes Tibco veteran for president

Hortonworks has named Raj Verma as its new president and chief operating officer in the latest of a string of shakeups designed to reinvigorate the Hadoop business following sliding sales. The Santa Clara-based business announced the departure of its former president, Herb Cunitz, alongside its second-quarter results last year …
Car polishing photo via Shutterstock

Qualcomm/NXP, Nvidia and Intel: The race to define the car platform

CES 2017 So the stakes are high, and many companies are already playing hard. There were important announcements from two of the most established chip suppliers in the auto sector, NXP and Nvidia – the former particularly closely watched because it will soon be part of Qualcomm. Its launches reminded the industry how strategic an …
Wireless Watch, 12 Jan 2017
Raining money

British Hadoop security startup expands to New York to land big investor

British security startup Panaseer is expanding to New York from London as it plans to land a large American investor in 2017. Panaseer will remain headquartered in London, where it develops its proprietary Security Data Lake to bring "the application of data science, advanced security intelligence and data engineering" to its …

LinkedIn, eBay founders and pals kick in $27m to bring Jesus to AI bots

LinkedIn founder Reid Hoffman and eBay founder Pierre Omidyar are among a bunch of investors bankrolling a $27m fund to further AI ethics and accountability. Specifically, the dosh will be used to bring non-engineers and people who haven't studied data science into the world of machine learning – from lawyers and economists to …
Katyanna Quach, 11 Jan 2017