The Register® — Biting the hand that feeds IT

Feeds

Seagate: Storage industry ill-prepared for onrushing big data tsunami

At current rates, capacity will be half what's needed by 2020

Free ESG report : Seamless data management with Avere FXT

Flash Memory Summit The world is producing such a rapidly surging amount of data that the storage industry – both solid-state drives (SSDs) and hard-disk drives (HDDs) – will be hard-pressed to keep up with demand, says one storage-industry insider.

"You can take that as a crisis; we see it as an opportunity," HDD manufacturer Seagate's SVP in charge of SSDs, Gary Gentry, told his keynote audience at the Flash Memory Summit on Tuesday in Santa Clara, California.

The global capacity needed to store data in 2020, Gentry said, will total around six zettabytes. For those of you who haven't been keeping score on the growth in capacity definitions, in decimal terms a zettabyte is a thousand exabytes, which is a thousand petabytes, which is a thousand terabytes.

That's not just a lot of personal cat videos, it's also Hollywood* and Bollywood feature films, medical and sensor data, massive amounts of business-focused big data, rapidly proliferating security cameras, automotive and aviation intelligence, and of course all that data that the NSA is slurping on a daily basis.

All types of digital storage taken together will have difficulty keeping up with that demand, Gentry said. "That's not just about flash and it's not just about hard drives – you could even throw tape drives into that. Any kind of product you can imagine is going to be needed to stay up with that demand."

And if the industry remains on its current investment path, they're not going to make it. "Based on the investment in the industry that we've looked into with experts in the flash industry and the hard-drive industry," Gentry said, "by 2020 we think the alignment, even with aggressive investment in fab capacity and hard-drive output will be somewhere approaching three zettabytes."

From Gentry's point of view, the pace of investment will almost certainly increase, but it'll need to be an industry-wide effort. "It's going to take all companies and all industries investing heavily to stay up with that big data that's in front of us," he said.

Of course, Seagate manufactures HDDs, and sources its SSD chips from Samsung and Toshiba, which Gentry said together account for about 75 per cent of the NAND-wafer output for the entire flash-memory industry. It's to his company's benefit that there will continue to be rising demand for HDDs.

"The future's not really about flash versus HDD. We hear that every day and I'm sure you do too," Genrty told his audience of flash-industry conference attendees. "The future's really about flash and HDD."

* Bootnote

Speaking of Hollywood feature films, Gentry said that his sources tell him that during the production of The Hobbit, the crew created between six and 12 terabytes of data every day during filming.

5 ways to reduce advertising network latency

Whitepapers

5 ways to reduce advertising network latency
Implementing the tactics laid out in this whitepaper can help reduce your overall advertising network latency.
Supercharge your infrastructure
Fusion­‐io has developed a shared storage solution that provides new performance management capabilities required to maximize flash utilization.
Avere FXT with FlashMove and FlashMirror
This ESG Lab validation report documents hands-on testing of the Avere FXT Series Edge Filer with the AOS 3.0 operating environment.
Reg Reader Research: SaaS based Email and Office Productivity Tools
Read this Reg reader report which provides advice and guidance for SMBs towards the use of SaaS based email and Office productivity tools.
Email delivery: 4 steps to get more email to the inbox
This whitepaper lists some steps and information that will give you the best opportunity to achieve an amazing sender reputation.

More from The Register

next story
Dedupe-dedupe, dedupe-dedupe-dedupe: Flashy clients crowd around Permabit diamond
3 of the top six flash vendors are casing the OEM dedupe tech, claims analyst
Disk-pushers, get reel: Even GOOGLE relies on tape
Prepare to be beaten by your old, cheap rival
Hong Kong's data centres stay high and dry amid Typhoon Usagi
180 km/h winds kill 25 in China, but the data centres keep humming
Microsoft lures punters to hybrid storage cloud with free storage arrays
Spend on Azure, get StorSimple box at the low, low price of $0
WD unveils new MyBook line: External drives now bigger... and CHEAP
Less than £0.04/GB, but it loses the Thunderbolt speed
VMware vSAN test pilots: Don't panic but there's a chance of DATA LOSS
AHCI SATA controller won't play nice with Virtzilla's robo-storage beta
Pure poaches NetApp preacher
Stewart dumps disk array drama to fluff flash
StorNext gets revamp, Quantum claims 5x data throughput boost
Multi-threaded code, flash, metadata redesign and Infiniband support
prev story