Feeds

Storage start-ups fail to set the world on fire

How IT fell for file storage growth myths

Application security programs and practises

Four file storage problem groups

First was spin-down. Copan and Nexsan and others thought the way to make file storage less onerous was to spin down disk drives and work with a pair of supporting dynamics. One was coming power shortages in metropolitan areas, combined with environmental carbon emission-cutting thinking. The other was data centre space limitations. If you cut electricity use by spinning down disk drives and pack the drives better, then you reduce power draw and space needs simultaneously. You can store more files in less data centre floorspace and need less power. It was a triple whammy win that could not fail.

Secondly, there was file virtualisation. You interpose a special server box between application servers and the multifarious file stores and have all the files in all your file stores represented in this one box inside a global namespace. You virtualise the file stores, so it looks like there is just one file storage universe which app servers can tap into. Acopia and Rainfinity and FilesX tried this route to bring sense to the file storage horror story.

Thirdly, general archival storage boxes sprang up, with EMC's Centera being the obvious one. Others are also plugging away at this space: Caringo, Mimosa, and Waterford. Plasmon tried - and died - here too. Lots of people saw that Centera was sky high in price and as proprietary as you like, and came up with commodity hardware/open software alternatives. None of them toppled Centera from its throne because they weren't good enough, and there wasn't a sufficiently general problem to prompt widespread adoption of their products.

Instead, specific archival storage products - ones focussed on e-mail or SharePoint - have survived and are developing into general archival products, with good compliance and e-Discovery functions. There is a developing market for these products, but it's not as large or as widespread as early product developers hoped.

Fourthly, we saw the development of scale-out filers, often using some form of clustering, to solve the problem of serving very large numbers of files, often large files, to a set of servers simultaneously. The large files would be split across several filers or sub-files with parts served in parallel. Ibrix developed software for this. BlueArc developed FPGA hardware-accelerated super-NAS products. Isilon, Exanet, and ONStor developed clustered filer hardware and software. Again, there is a real problem here but customer interest turned out to be concentrated in two areas and not be general.

Digital movie effects meant that rendering scenes needed massive file delivery horsepower and that benefitted Isilon, Ibrix and BlueArc. It also benefitted some block storage suppliers, like Data Direct Networks but we'll ignore those here because this is a file-focussed story.

High-performance computing (HPC) and supercomputing also needed the same sort of massive filer bandwidth to cope with seismic, simulation and genome-type data. However general business did not.

ESG's Steve Duplessie points out that Web 2.0 companies like Amazon, Google and Yahoo also had an internal need for scale-out filers, and sometimes built their own infrastructure for this in a massively impressive way. It didn't generally benefit our scale-out NAS startups, though, and was specific to these massive-scale Internet-based service suppliers, not to everyday business.

Eight steps to building an HP BladeSystem

More from The Register

next story
Sysadmin Day 2014: Quick, there's still time to get the beers in
He walked over the broken glass, killed the thugs... and er... reconnected the cables*
Apple fanbois SCREAM as update BRICKS their Macbook Airs
Ragegasm spills over as firmware upgrade kills machines
Amazon Reveals One Weird Trick: A Loss On Almost $20bn In Sales
Investors really hate it: Share price plunge as growth SLOWS in key AWS division
SHOCK and AWS: The fall of Amazon's deflationary cloud
Just as Jeff Bezos did to books and CDs, Amazon's rivals are now doing to it
EU's top data cops to meet Google, Microsoft et al over 'right to be forgotten'
Plan to hammer out 'coherent' guidelines. Good luck chaps!
US judge: YES, cops or feds so can slurp an ENTIRE Gmail account
Crooks don't have folders labelled 'drug records', opines NY beak
Auntie remains MYSTIFIED by that weekend BBC iPlayer and website outage
Still doing 'forensics' on the caching layer – Beeb digi wonk
Manic malware Mayhem spreads through Linux, FreeBSD web servers
And how Google could cripple infection rate in a second
prev story

Whitepapers

Top three mobile application threats
Prevent sensitive data leakage over insecure channels or stolen mobile devices.
Implementing global e-invoicing with guaranteed legal certainty
Explaining the role local tax compliance plays in successful supply chain management and e-business and how leading global brands are addressing this.
Boost IT visibility and business value
How building a great service catalog relieves pressure points and demonstrates the value of IT service management.
Designing a Defense for Mobile Applications
Learn about the various considerations for defending mobile applications - from the application architecture itself to the myriad testing technologies.
Build a business case: developing custom apps
Learn how to maximize the value of custom applications by accelerating and simplifying their development.