Feeds

NetApp StorageGRID now on cloud nine: Would you put 100PBs in it?

Show us the money an actual installation

HP ProLiant Gen8: Integrated lifecycle automation

Analysis NetApp continues its slow development of its object storage capability by adding a cloud interface to it.

Version 9.0 of StorageGRID, the storage software gained by NetApp when it bought Bycast in mid-2010, sounds like a major release but the only feature NetApp emphasises is the new Cloud Data Management Interface (CDMI).

CDMI is an SNIA standard for self-provisioning, administering and accessing cloud storage. Other StorageGRID access methods include NFS, CIFS, and an API using RESTful HTTP. Object storage vendors often provide proprietary APIs, and CDMI is a more open approach.

NetApp is the only public supporter of it so far. Competing object storage suppliers Amplidata, EMC Atmos/Centera, Caringo, Dell, HDS and Scality haven't signed up yet, but momentum for more companies to support CDMI is thought to be building.

StorageGRID is twinned with NetApp's E-Series arrays to provide a distributed content repository that provides the usual impressive-sounding big data object storage stuff - it claims to scale to hundreds of petabytes in a single namespace covering billions of files across hundreds of sites.

The El Reg storage desk is cynical because no company is actually storing hundreds of petabytes of data in billions of files inside a single namespace across hundreds of data centres. Until somebody actually does this the promise of large scale object storage is just that, a theoretical promise. Yes, it may well scale, and probably is real, but the technology appears to be available well in advance of the market need.

A NetApp Data Bingo blog article states: "Traditional file systems and access methods were not designed to store hundreds of millions or billions of files in a single namespace. This leads to admins storing data in multiple file systems, multiple shares, complex directory structures – not because the data should be logically organized in that way, but simply because of limitations in file system architectures. This issue becomes even more pressing when data sits in multiple locations, maybe even across on-premise and off-premise, cloud-based storage."

That's all very well but the problems aren't big enough - yet - to prompt a general transition to object storage technologies.

NetApp mentions customer Iron Mountain in the release of StorageGRID version 9. This was a Bycast customer and NetApp hasn't been able to, or chose not to, focus on any other customer or make claims about new customers for StorageGRID.

What object storage needs is a thumping great demo, a real implementation of the billions of files, hundreds of PB, single namespace, hundreds of sites idea that blows traditional file system access away. Why doesn't one exist? It would be horribly expensive and complex to set up and, The Reg suspects, unrealistic. After all CERN chose tape to store its online Large Hadron Collider experimental data. Why not object storage? Too expensive maybe?

If object storage isn't suitable for real-world use cases involving hundreds of petabytes, seemingly ideal object storage use cases, then perhaps it's marketing its technology with the wrong message. ®

Bootnote

Comments to The Reg forum, please.

Eight steps to building an HP BladeSystem

More from The Register

next story
Apple fanbois SCREAM as update BRICKS their Macbook Airs
Ragegasm spills over as firmware upgrade kills machines
THUD! WD plonks down SIX TERABYTE 'consumer NAS' fatboy
Now that's a LOT of porn or pirated movies. Or, you know, other consumer stuff
EU's top data cops to meet Google, Microsoft et al over 'right to be forgotten'
Plan to hammer out 'coherent' guidelines. Good luck chaps!
US judge: YES, cops or feds so can slurp an ENTIRE Gmail account
Crooks don't have folders labelled 'drug records', opines NY beak
Manic malware Mayhem spreads through Linux, FreeBSD web servers
And how Google could cripple infection rate in a second
FLAPE – the next BIG THING in storage
Find cold data with flash, transmit it from tape
prev story

Whitepapers

Seven Steps to Software Security
Seven practical steps you can begin to take today to secure your applications and prevent the damages a successful cyber-attack can cause.
Consolidation: The Foundation for IT Business Transformation
In this whitepaper learn how effective consolidation of IT and business resources can enable multiple, meaningful business benefits.
Designing a Defense for Mobile Applications
Learn about the various considerations for defending mobile applications - from the application architecture itself to the myriad testing technologies.
Build a business case: developing custom apps
Learn how to maximize the value of custom applications by accelerating and simplifying their development.
Consolidation: the foundation for IT and business transformation
In this whitepaper learn how effective consolidation of IT and business resources can enable multiple, meaningful business benefits.