Feeds

Spectra unveils TOP SECRET tape-based object store Black Pearl

Boulder bods about to set sail – you heard it here first

The Essential Guide to IT Transformation

Spectra Logic is introducing a tape-based object store which uses its Deep Simple Storage Services interface and its mysterious Black Pearl appliance.

The thinking is that tape has to change from being a target for expensive and complex middleware to becoming just another storage medium. Using a flash cache with object-storing software is the way to do it.

DS3

Spectra is announcing a new interface to modernise tape library usage. Its tape libraries will be accessed via:

  • Traditional backup using files
  • Active archiving of files
  • Storing data in buckets

Bucket storage is accomplished with Spectra's Deep Simple Storage Services, DS3, which is Amazon's S3 plus four extra commands. Think of the buckets as collections of data plus metadata. Buckets are designed to optimise the use of tape, whereas sending folders to tape, with LTFS, doesn't optimise its use as most folders are smaller than a tape's capacity.

A weather model bucket might contain, for example, all the information known about Hurricane Katrina.

There is a DS3 plug-in for Hadoop, and one of Hadoop's three file copies could be written to a Spectra archive as a bucket.

Spectra says DS3 access will be added to its disk arrays over time. Molly Rector, Spectra's chief marketing officer, said DS3 is not Fibre Channel, not a historic tape access format and not proprietary - like StorNext.

DS3 is a protocol and needs software to read and write with it. That's where Black Pearl comes in.

Black Pearl

Jack Sparrow's BlackPearl

Black Pearl

The Black Pearl appliance is a solid state tape library cache which turns a tape library into an object store. It is a 2U server with software running inside a virtual machine in server. This software provides tape library management, and will look after media management, such as migrating from LTO-6 to a future format such as LTO-7.

SSDs are used to cache data and Fibre Channel inks the appliance to a back-end Spectra Logic tape library.

This appliance combines files and folders into buckets. These are flatter than existing file/folder systems with their nested folders, and buckets could hold trillions of files. A bucket is an object and can store objects within itself. An object can store a file or lots of files.

Files and/or folders are sent to Black Pearl and cached in the SSDs until a bucket is full. Then the bucket is written to tape and the cycle starts again.

Rector says that disk-based object storage suppliers could use DS3 to write their objects to tape, and points out: "Object stores don't come close to our cost/GB."

The Black Pearl appliance and DS3 change tape from being a target for specialist software and specialists to being a product for everybody. Rector said: "Nobody is getting trained to write software for tape libraries using existing interfaces."

With the BlackPearl/DS3 combination tape becomes just another storage medium: "All the tape complexity goes away into the library robot."

Tapes can offload filers and become a store for old files, for the web, for archives and objects. It can be used, Rector says, in the private cloud market.

And nTier Verde?

Where does Spectra's nTier Verde disk array fit in? Why, it can run the Black Pearl software, of course, pushing data through it and DS3 to a back-end tape object store, thus provide a spinning and reeling 2-tier archival storage system.

The nTier Verde news. from last month is now revealed for what it was, a building block helping construct a combined disk and tape archive infrastructure with tiering from disk - nearline archive - to tape - offline archive.

The nTier Verde operating system is a port of ZFS to BSD.

Rector says that customers with Black Pearl and a Spectra tape library "can own their own [Amazon] Glacier."

She says Black Pearl makes tape libraries eminently suitable for big data and Spectra has some very big customers, like Yahoo!, the Discovery Channel and Nascar.

Spectra is announcing a DS3 developers' program with a downloadable simulator. We haven't seen BlackPearl pricing and availability information yet. ®

The Essential Guide to IT Transformation

More from The Register

next story
Sysadmin Day 2014: Quick, there's still time to get the beers in
He walked over the broken glass, killed the thugs... and er... reconnected the cables*
Auntie remains MYSTIFIED by that weekend BBC iPlayer and website outage
Still doing 'forensics' on the caching layer – Beeb digi wonk
Microsoft says 'weird things' can happen during Windows Server 2003 migrations
Fix coming for bug that makes Kerberos croak when you run two domain controllers
Multipath TCP speeds up the internet so much that security breaks
Black Hat research says proposed protocol will bork network probes, flummox firewalls
Cisco says network virtualisation won't pay off everywhere
Another sign of strain in the Borg/VMware relationship?
Forrester says Australia, not China, is next boom market for cloud
It's cloudy but fine down under, analyst says
prev story

Whitepapers

Implementing global e-invoicing with guaranteed legal certainty
Explaining the role local tax compliance plays in successful supply chain management and e-business and how leading global brands are addressing this.
Boost IT visibility and business value
How building a great service catalog relieves pressure points and demonstrates the value of IT service management.
Why and how to choose the right cloud vendor
The benefits of cloud-based storage in your processes. Eliminate onsite, disk-based backup and archiving in favor of cloud-based data protection.
The Essential Guide to IT Transformation
ServiceNow discusses three IT transformations that can help CIO's automate IT services to transform IT and the enterprise.
Maximize storage efficiency across the enterprise
The HP StoreOnce backup solution offers highly flexible, centrally managed, and highly efficient data protection for any enterprise.