Original URL: https://www.theregister.com/2013/08/14/storage_industry_unprepared_for_coming_data_needs/

Seagate: Storage industry ill-prepared for onrushing big data tsunami

At current rates, capacity will be half what's needed by 2020

By Rik Myslewski

Posted in Storage, 14th August 2013 00:59 GMT

Flash Memory Summit The world is producing such a rapidly surging amount of data that the storage industry – both solid-state drives (SSDs) and hard-disk drives (HDDs) – will be hard-pressed to keep up with demand, says one storage-industry insider.

"You can take that as a crisis; we see it as an opportunity," HDD manufacturer Seagate's SVP in charge of SSDs, Gary Gentry, told his keynote audience at the Flash Memory Summit on Tuesday in Santa Clara, California.

The global capacity needed to store data in 2020, Gentry said, will total around six zettabytes. For those of you who haven't been keeping score on the growth in capacity definitions, in decimal terms a zettabyte is a thousand exabytes, which is a thousand petabytes, which is a thousand terabytes.

That's not just a lot of personal cat videos, it's also Hollywood* and Bollywood feature films, medical and sensor data, massive amounts of business-focused big data, rapidly proliferating security cameras, automotive and aviation intelligence, and of course all that data that the NSA is slurping on a daily basis.

All types of digital storage taken together will have difficulty keeping up with that demand, Gentry said. "That's not just about flash and it's not just about hard drives – you could even throw tape drives into that. Any kind of product you can imagine is going to be needed to stay up with that demand."

And if the industry remains on its current investment path, they're not going to make it. "Based on the investment in the industry that we've looked into with experts in the flash industry and the hard-drive industry," Gentry said, "by 2020 we think the alignment, even with aggressive investment in fab capacity and hard-drive output will be somewhere approaching three zettabytes."

From Gentry's point of view, the pace of investment will almost certainly increase, but it'll need to be an industry-wide effort. "It's going to take all companies and all industries investing heavily to stay up with that big data that's in front of us," he said.

Of course, Seagate manufactures HDDs, and sources its SSD chips from Samsung and Toshiba, which Gentry said together account for about 75 per cent of the NAND-wafer output for the entire flash-memory industry. It's to his company's benefit that there will continue to be rising demand for HDDs.

"The future's not really about flash versus HDD. We hear that every day and I'm sure you do too," Genrty told his audience of flash-industry conference attendees. "The future's really about flash and HDD."

* Bootnote

Speaking of Hollywood feature films, Gentry said that his sources tell him that during the production of The Hobbit, the crew created between six and 12 terabytes of data every day during filming.