Did object storage come of age in 2013?
Some crossed the chasm. Some turned back...
DataDirect Networks? WOS that then?
Object storage is said to be good for data sets that will blow a file system away, so DDN announced a WOS 7000 array that can hold trillions of objects. The basic building block is a rack with 2.5PB capacity, and up to 256 of these can be clustered together. DDN said, “A cluster of 32 WOS cluster nodes can be architected into a single namespace consisting of over 32 trillion unique object IDs without slowing performance."
But that’s small potatoes in DDN-land with a 1EB federation of WOS 7000 clusters tantalisingly close, with DDN saying such a federation would store up to 983 PB and 32 trillion objects in a single WOS namespace. There’s scale and then there is SCALE.
Very few organisations today need that amount of capacity but it must be comforting to know the headroom scaling up to 32 trillion objects is there.
DDN also laid off 58 people in 2013 when a 2012 web-scale customer scaled back purchases after giving DDN a bonanza 2012.
HP's 8800 state
HP made object storage progress late in the year with its Ibrix-based StoreAll system.
In October HP CEO Meg Whitman said that the StoreAll object storage system was one of HP’s top storage priorities, after StorServe (3PAR) and StoreOnce (deduplicating backup array).
Two months later HP delivered on this with a new StoreAll system, the 8800, which replaced the previous 9320 and 9730 systems. It was powered by HP’s latest eighth generation ProLiant servers and scaled out to 16PB with 1,024 nodes. (Perhaps DataDirect would class this as a starter system.) It was certainly more powerful than the previous systems and featured extraordinarily fast search, providing an answer to what’s changed in half a billion files in 1.4 seconds compared to a trad (NetApp) filer array taking up to 40 hours. Somebody’s holding metadata in memory or flash I should think.
This 8800 supports NFS, CIFS and SMB, NDMP, HTTP and HTTPS, WebDAV, FTP and FTPS, the StoreAll REST API File Compatibility Mode and Object Mode. Native OpenStack Swift and Keystone are also supported. This file access support became fairly typical of object storage during the year - see Scality below.
Object Storage may well be better than file storage, with no need for RAID overhead and RAID rebuild times for example, but customers do not want to give up their familiar file interfaces.
HP’s 8800 will become available this quarter and we’ll see if its mix of features propel it up the object storage sales rankings.
- In June Joyent unveiled its Manta Storage Service, object storage in the cloud, with strongly consistent writes, highly available reads, no object size limits, and per-object replication policies. Joyent CTO Jason Hoffman described is as, “It's S3 with EC2 and Elastic MapReduce bolted on top of it.”
- Intel introduced its massive data, Large Object Store (LOS), asserting that "the Massive data usage model using LOS will be the foundation for all long term storage." It developed a LOS reference architecture, working with Quanta and Amplidata, and intended for use by ODMs, OEMs and ISVs. Yeah, yeah, Intel’s marketing trumpet blows hard and strong. Since then we’ve heard zip from chipzilla about object storage.
- August saw Scale Computing announce its SCRIBE project with an object-based web-scale storage architecture that assumes failures will happen. Scale Computing says it eliminates the need for any protocols.
- In November Nasuni was granted a patent for an invention which layers a filesystem onto a public cloud storage provider’s object storage systems. Once again we hear the object storage beneath a file system song being sung again.
What about Seagate, OpenStack and EVault?
What’s a disk drive-maker doing in a article about object storage? It’s a user. Seagate’s Ethernet-addressed Kinetic disk drives are accessed by applications using object style Gets and Puts and store data as objects accessed using key-value pairs. The first Kinetic drive should become available in mid-2014.
Seagate subsidiary EVault, a cloud backup vendor, introduced its Long Term Simple Storage (LTS2) service which is also object-based. This was a major initiative by EVault and stores its data on spun-down Shingled Magnetic Recording Seagate drives. (Seagate Kinetic drives may well be used in the future)
The system has an 8EB capacity objective, which EVault said was needed to achieve its pricing objectives.
The data is stored using OpenStack Swift technology; a major win for OpenStack after so much cross-industry effort has been put into it. EVault is taking on Amazon and its tape-based Glacier archive vaulting service with an offering that costs half as much again as Amazon’s ten cents per GB per month but with much faster data retrieval. LTS2 is a massive and costly bet by Seagate/EVault that it is possible to take on Amazon as a cloud storage supplier and win.
In fact to do this, to take on Amazon, EVault is saying you need object storage technology. If it does succeed then OpenStack’s Swift gets a massive boost. If it fails then Swift adoption will be slower.
As for Scality...
Scality had a great 2013:
- SGI started OEM’ing its RING product in January.
- It linked in Hadoop to the RING technology in March plus a plug-in for Cinder, the block storage layer within the OpenStack project.
- In October NFS and CIFS access protocols were added to the ring. So, like HP’s StoreOnce 8800 with its mass of interfaces, the RING had interface proliferation too, supporting block storage for OpenStack via Cinder, REST/HTTP protocols such as Amazon’s S3 API, CDMI, NFS, CIFS, AFP and FTP as well as FUSE. All data written through the REST API or file interface can be read through any of the other interfaces, and can be analysed in place using Hadoop framework.
Scality said its October “Release 4.2 offers customers the broadest range of native information access available from any object storage provider.”
SpectraLogic’s Black Pearl
Perhaps the year’s most unexpected object storage announcement was SpectraLogic’s unveiling of Black Pearl which could be loosely described as a way of backing up objects on tape using the Gets and Puts of an S3-style interface and avoiding expensive and complex backup software.
Objects age like every other piece of data and wouldn’t it be nice to put aged, low access rate objects on to cheap tape and off expensive disk? Well, yes, it would, and SpectraLogic provided a way of doing this, joining together two large scale data storage modes that had been seen as either:or alternatives for the bulk, long-term storage of data.
Black Pearl ship from Pirates of the Caribbean film.
Spectra’s Deep Simple Storage Services, DS3, are used to stick objects in buckets, and DS3 is S3 plus four more commands. Buckets are collections of data and their metadata. The Black Pearl appliance is a 2U, solid state tape library cache which turns a tape library into an object store. Spectra claimed; "Object stores don't come close to our cost/GB." Customers with Black Pearl and a Spectra tape library "can own their own [Amazon] Glacier."
We’ve already seen Verizon adopt HDS’s Content Platform (HCP) as the object storage basis for a file sharing and syncing and cloud storage service from Verizon. That potentially vaults HDS into the front rank of object storage suppliers. It provides a great reference account because HDS is the only mainstream object storage supply selected for the role in a potentially massive cloud storage service that could eventually rank alongside Azure, Amazon and Google. They have all rolled their own object storage services.
We can expect more announcements from Scality, which is probably the most determined developer of its object technology amongst all the startups. Hopefully we should hear about customers using EMC ViPR's object data services and HP might reveal a StoreOnce customer or two too.
Let's chance our arm and say while in 2013 object storage sorted crossing the chasm, in 2014 object storage will arrive as a mainstream and accepted storage technology. ®
Sponsored: Benefits from the lessons learned in HPC