Feeds

Did object storage come of age in 2013?

Some crossed the chasm. Some turned back...

Internet Security Threat Report 2014

DataDirect Networks? WOS that then?

Object storage is said to be good for data sets that will blow a file system away, so DDN announced a WOS 7000 array that can hold trillions of objects. The basic building block is a rack with 2.5PB capacity, and up to 256 of these can be clustered together. DDN said, “A cluster of 32 WOS cluster nodes can be architected into a single namespace consisting of over 32 trillion unique object IDs without slowing performance."

But that’s small potatoes in DDN-land with a 1EB federation of WOS 7000 clusters tantalisingly close, with DDN saying such a federation would store up to 983 PB and 32 trillion objects in a single WOS namespace. There’s scale and then there is SCALE.

Very few organisations today need that amount of capacity but it must be comforting to know the headroom scaling up to 32 trillion objects is there.

DDN also laid off 58 people in 2013 when a 2012 web-scale customer scaled back purchases after giving DDN a bonanza 2012.

HP's 8800 state

HP made object storage progress late in the year with its Ibrix-based StoreAll system.

In October HP CEO Meg Whitman said that the StoreAll object storage system was one of HP’s top storage priorities, after StorServe (3PAR) and StoreOnce (deduplicating backup array).

Two months later HP delivered on this with a new StoreAll system, the 8800, which replaced the previous 9320 and 9730 systems. It was powered by HP’s latest eighth generation ProLiant servers and scaled out to 16PB with 1,024 nodes. (Perhaps DataDirect would class this as a starter system.) It was certainly more powerful than the previous systems and featured extraordinarily fast search, providing an answer to what’s changed in half a billion files in 1.4 seconds compared to a trad (NetApp) filer array taking up to 40 hours. Somebody’s holding metadata in memory or flash I should think.

This 8800 supports NFS, CIFS and SMB, NDMP, HTTP and HTTPS, WebDAV, FTP and FTPS, the StoreAll REST API File Compatibility Mode and Object Mode. Native OpenStack Swift and Keystone are also supported. This file access support became fairly typical of object storage during the year - see Scality below.

Object Storage may well be better than file storage, with no need for RAID overhead and RAID rebuild times for example, but customers do not want to give up their familiar file interfaces.

HP’s 8800 will become available this quarter and we’ll see if its mix of features propel it up the object storage sales rankings.

Snippets

  • In June Joyent unveiled its Manta Storage Service, object storage in the cloud, with strongly consistent writes, highly available reads, no object size limits, and per-object replication policies. Joyent CTO Jason Hoffman described is as, “It's S3 with EC2 and Elastic MapReduce bolted on top of it.”
  • Intel introduced its massive data, Large Object Store (LOS), asserting that "the Massive data usage model using LOS will be the foundation for all long term storage." It developed a LOS reference architecture, working with Quanta and Amplidata, and intended for use by ODMs, OEMs and ISVs. Yeah, yeah, Intel’s marketing trumpet blows hard and strong. Since then we’ve heard zip from chipzilla about object storage.
  • August saw Scale Computing announce its SCRIBE project with an object-based web-scale storage architecture that assumes failures will happen. Scale Computing says it eliminates the need for any protocols.
  • In November Nasuni was granted a patent for an invention which layers a filesystem onto a public cloud storage provider’s object storage systems. Once again we hear the object storage beneath a file system song being sung again.

What about Seagate, OpenStack and EVault?

What’s a disk drive-maker doing in a article about object storage? It’s a user. Seagate’s Ethernet-addressed Kinetic disk drives are accessed by applications using object style Gets and Puts and store data as objects accessed using key-value pairs. The first Kinetic drive should become available in mid-2014.

Seagate subsidiary EVault, a cloud backup vendor, introduced its Long Term Simple Storage (LTS2) service which is also object-based. This was a major initiative by EVault and stores its data on spun-down Shingled Magnetic Recording Seagate drives. (Seagate Kinetic drives may well be used in the future)

The system has an 8EB capacity objective, which EVault said was needed to achieve its pricing objectives.

The data is stored using OpenStack Swift technology; a major win for OpenStack after so much cross-industry effort has been put into it. EVault is taking on Amazon and its tape-based Glacier archive vaulting service with an offering that costs half as much again as Amazon’s ten cents per GB per month but with much faster data retrieval. LTS2 is a massive and costly bet by Seagate/EVault that it is possible to take on Amazon as a cloud storage supplier and win.

In fact to do this, to take on Amazon, EVault is saying you need object storage technology. If it does succeed then OpenStack’s Swift gets a massive boost. If it fails then Swift adoption will be slower.

As for Scality...

Scality had a great 2013:

  • SGI started OEM’ing its RING product in January.
  • It linked in Hadoop to the RING technology in March plus a plug-in for Cinder, the block storage layer within the OpenStack project.
  • In October NFS and CIFS access protocols were added to the ring. So, like HP’s StoreOnce 8800 with its mass of interfaces, the RING had interface proliferation too, supporting block storage for OpenStack via Cinder, REST/HTTP protocols such as Amazon’s S3 API, CDMI, NFS, CIFS, AFP and FTP as well as FUSE. All data written through the REST API or file interface can be read through any of the other interfaces, and can be analysed in place using Hadoop framework.

Scality said its October “Release 4.2 offers customers the broadest range of native information access available from any object storage provider.”

SpectraLogic’s Black Pearl

Perhaps the year’s most unexpected object storage announcement was SpectraLogic’s unveiling of Black Pearl which could be loosely described as a way of backing up objects on tape using the Gets and Puts of an S3-style interface and avoiding expensive and complex backup software.

Objects age like every other piece of data and wouldn’t it be nice to put aged, low access rate objects on to cheap tape and off expensive disk? Well, yes, it would, and SpectraLogic provided a way of doing this, joining together two large scale data storage modes that had been seen as either:or alternatives for the bulk, long-term storage of data.

Black_Pearl

Black Pearl ship from Pirates of the Caribbean film.

Spectra’s Deep Simple Storage Services, DS3, are used to stick objects in buckets, and DS3 is S3 plus four more commands. Buckets are collections of data and their metadata. The Black Pearl appliance is a 2U, solid state tape library cache which turns a tape library into an object store. Spectra claimed; "Object stores don't come close to our cost/GB." Customers with Black Pearl and a Spectra tape library "can own their own [Amazon] Glacier."

So…2014?

We’ve already seen Verizon adopt HDS’s Content Platform (HCP) as the object storage basis for a file sharing and syncing and cloud storage service from Verizon. That potentially vaults HDS into the front rank of object storage suppliers. It provides a great reference account because HDS is the only mainstream object storage supply selected for the role in a potentially massive cloud storage service that could eventually rank alongside Azure, Amazon and Google. They have all rolled their own object storage services.

We can expect more announcements from Scality, which is probably the most determined developer of its object technology amongst all the startups. Hopefully we should hear about customers using EMC ViPR's object data services and HP might reveal a StoreOnce customer or two too.

Let's chance our arm and say while in 2013 object storage sorted crossing the chasm, in 2014 object storage will arrive as a mainstream and accepted storage technology. ®

Beginner's guide to SSL certificates

More from The Register

next story
Docker's app containers are coming to Windows Server, says Microsoft
MS chases app deployment speeds already enjoyed by Linux devs
'Hmm, why CAN'T I run a water pipe through that rack of media servers?'
Leaving Las Vegas for Armenia kludging and Dubai dune bashing
'Urika': Cray unveils new 1,500-core big data crunching monster
6TB of DRAM, 38TB of SSD flash and 120TB of disk storage
Facebook slurps 'paste sites' for STOLEN passwords, sprinkles on hash and salt
Zuck's ad empire DOESN'T see details in plain text. Phew!
SDI wars: WTF is software defined infrastructure?
This time we play for ALL the marbles
Windows 10: Forget Cloudobile, put Security and Privacy First
But - dammit - It would be insane to say 'don't collect, because NSA'
Oracle hires former SAP exec for cloudy push
'We know Larry said cloud was gibberish, and insane, and idiotic, but...'
Symantec backs out of Backup Exec: Plans to can appliance in Jan
Will still provide support to existing customers
prev story

Whitepapers

Forging a new future with identity relationship management
Learn about ForgeRock's next generation IRM platform and how it is designed to empower CEOS's and enterprises to engage with consumers.
Why cloud backup?
Combining the latest advancements in disk-based backup with secure, integrated, cloud technologies offer organizations fast and assured recovery of their critical enterprise data.
Win a year’s supply of chocolate
There is no techie angle to this competition so we're not going to pretend there is, but everyone loves chocolate so who cares.
High Performance for All
While HPC is not new, it has traditionally been seen as a specialist area – is it now geared up to meet more mainstream requirements?
Intelligent flash storage arrays
Tegile Intelligent Storage Arrays with IntelliFlash helps IT boost storage utilization and effciency while delivering unmatched storage savings and performance.