Feeds

Boffins ponder 100-year archive made of TOMES

A MAID to preserve culture and decency

The Essential Guide to IT Transformation

University of California at Santa Cruz (UCSC) researchers have designed Pergamum, a hundred year archive system using Ethernet-linked redundant and powered down intelligent disk drive building blocks.

The Pergamum researchers are UCSC graduate students Mark Storer and Kevin Greenan, and researcher Kaladhar Voruganti of NetApp. One problem of building a digital archive to last 50 to 100 years is that the storage medium can undergo ten or more changes in that period with the original medium no longer capable of being read. Few people now can read paper tape or punched cards.

Storer said: "There is a risk that an entire generation's cultural history could be lost if people aren't able to retrieve that data. Everyone is switching to digital cameras, but we've never demonstrated that digital data can be reliably preserved for a long time."

Pergamum was a library and settlement in Ancient Greece.

The Santa Cruz Pergamum stores information in TOMES: single disk drive units in a small case with an ARM-style processor (think iPhone), some flash memory, and an Ethernet port. TOMES link together over Ethernet to form the archive. Data is replicated on individual TOMES and across TOMES, protecting against latent sector errors on individual drives, and also against a hard drive failure.

It's easy to add more TOMES or to replace failed drives. The software doesn't care what the storage medium is and TOMES using a different storage medium could be added in the future, insulating the archive contents from media and media drive changes. This is the issue that prevents tape being used, because of its regular format changes and format extinctions.

Storer said: "In 50 years, the devices might use holographic storage. "As long as you can wrap the new storage medium in this intelligent layer that speaks the protocol, it can participate in the network."

When not in use TOMES power down almost completely. What power they do draw, about 13 watts, is delivered over Ethernet. Many operations can read and write data in flash, obviating the need to spin up the hard drive. This is a MAID-like (Massive Array of Idle Drives) aspect of Pergamum.

UCSC has other archival storage projects. Deep Store cuts the space needed to store data and POTSHARDS uses a secret splitting technique instead of encryption to secure an archive's contents.

This is an academic project and there is no indication of any commercial activity to productise Pergamum. More here.

Copyright © 2008, Blocks & Files.com

The Essential Guide to IT Transformation

More from The Register

next story
Sysadmin Day 2014: Quick, there's still time to get the beers in
He walked over the broken glass, killed the thugs... and er... reconnected the cables*
Multipath TCP speeds up the internet so much that security breaks
Black Hat research says proposed protocol will bork network probes, flummox firewalls
VMware builds product executables on 50 Mac Minis
And goes to the Genius Bar for support
Auntie remains MYSTIFIED by that weekend BBC iPlayer and website outage
Still doing 'forensics' on the caching layer – Beeb digi wonk
Microsoft says 'weird things' can happen during Windows Server 2003 migrations
Fix coming for bug that makes Kerberos croak when you run two domain controllers
Cisco says network virtualisation won't pay off everywhere
Another sign of strain in the Borg/VMware relationship?
Forrester says Australia, not China, is next boom market for cloud
It's cloudy but fine down under, analyst says
prev story

Whitepapers

Implementing global e-invoicing with guaranteed legal certainty
Explaining the role local tax compliance plays in successful supply chain management and e-business and how leading global brands are addressing this.
Boost IT visibility and business value
How building a great service catalog relieves pressure points and demonstrates the value of IT service management.
Why and how to choose the right cloud vendor
The benefits of cloud-based storage in your processes. Eliminate onsite, disk-based backup and archiving in favor of cloud-based data protection.
The Essential Guide to IT Transformation
ServiceNow discusses three IT transformations that can help CIO's automate IT services to transform IT and the enterprise.
Maximize storage efficiency across the enterprise
The HP StoreOnce backup solution offers highly flexible, centrally managed, and highly efficient data protection for any enterprise.