Feeds

EMC gets busy with dedupe, compression code-base

Team Viper has awesome name, dude

Internet Security Threat Report 2014

EMC has been developing its own deduplication and compression code-base, entrusting the effort to a team code-named Viper.

The story, as told by someone familiar with the events, starts with EMC acquiring Avamar in November 2006. In June 2009 it acquired DataDomain. At this point it had Avamar source deduplication, DataDomain target deduplication, and RecoverPoint single instancing and compression.

The Viper team's remit was to deconstruct the code base in each of these three technologies and then build a code-base, an all-EMC code-base, that could run in these products and on the hardware running them, such as CLARiiON and Celerra for RecoverPoint. It would enable a progressive reduction in data size as data moved throughout its lifecycle and from product to product.

It might be possible to have data more or less permanently stored in a reduced form until its regeneration, rehydration in dedupe industry-speak, was needed by an application or user.

If a file hit Avamar and had come from RecoverPoint then it would already be a single instance and compressed, so Avamar would have no need to compress it and could focus on the deduplication.

The Viper team was set up in 2009 and is still in operation. We understand from a second source that the team has written code as a component which is being used in Celerra for deduplication and FLARE for compression. Further, this code component can be used by any other product team in EMC which needs compression or deduplication.

All this implies that EMC would have no interest in taking embeddable deduplication source code from either Ocarina or Permabit. We understand Compellent is not taking code from these vendors either as it develops deduplication. ®

Intelligent flash storage arrays

More from The Register

next story
Just don't blame Bono! Apple iTunes music sales PLUMMET
Cupertino revenue hit by cheapo downloads, says report
The DRUGSTORES DON'T WORK, CVS makes IT WORSE ... for Apple Pay
Goog Wallet apparently also spurned in NFC lockdown
IBM, backing away from hardware? NEVER!
Don't be so sure, so-surers
Hey - who wants 4.8 TERABYTES almost AS FAST AS MEMORY?
China's Memblaze says they've got it in PCIe. Yow
Microsoft brings the CLOUD that GOES ON FOREVER
Sky's the limit with unrestricted space in the cloud
This time it's SO REAL: Overcoming the open-source orgasm myth with TODO
If the web giants need it to work, hey, maybe it'll work
'ANYTHING BUT STABLE' Netflix suffers BIG Europe-wide outage
Friday night LIVE? Nope. The only thing streaming are tears down my face
Google roolz! Nest buys Revolv, KILLS new sales of home hub
Take my temperature, I'm feeling a little bit dizzy
Storage array giants can use Azure to evacuate their back ends
Site Recovery can help to move snapshots around
prev story

Whitepapers

Why and how to choose the right cloud vendor
The benefits of cloud-based storage in your processes. Eliminate onsite, disk-based backup and archiving in favor of cloud-based data protection.
Forging a new future with identity relationship management
Learn about ForgeRock's next generation IRM platform and how it is designed to empower CEOS's and enterprises to engage with consumers.
Reg Reader Research: SaaS based Email and Office Productivity Tools
Read this Reg reader report which provides advice and guidance for SMBs towards the use of SaaS based email and Office productivity tools.
Saudi Petroleum chooses Tegile storage solution
A storage solution that addresses company growth and performance for business-critical applications of caseware archive and search along with other key operational systems.
Protecting users from Firesheep and other Sidejacking attacks with SSL
Discussing the vulnerabilities inherent in Wi-Fi networks, and how using TLS/SSL for your entire site will assure security.