Does anyone really want to embed dedupe code?
Ocarina and Permabit's prospects limited
Comment Which storage OEMs will embed Ocarina or Permabit deduplication code in their products?
Deduplication, or data reduction as it's becoming known, involves scanning data, whether in block or file, and replacing repeated block groups or chunks with pointers.
Typically this is done with backed up file data, where there is lots of repeated data, by specific appliances such as Virtual Tape Libraries or straight disk-to-disk backup systems. NetApp has developed its A-SIS technology and this works below the file level and has proven to be terrific when removing redundant data from masses of Virtual Desktop Infrastructure images.
That means dedupe can be used for primary data. A new data reduction ethos is emerging which says data could be, even should be, stored in a reduced form throughout its lifecycle, regenerated only when needed by an application. Ocarina and Permabit have each developed embeddable deduplication software which can be integrated in a storage OEM's storage array controlling software and so reduce the amount of data held in the arrays without impacting array performance.
Both say they are talking seriously to major storage OEMs, with Ocarina's recent announcement including a supportive quote from Dell.
However, The Register has heard that Permabit's possible OEM deals for its Albireo deduplication software may be slightly more advanced than Ocarina's.
Permabit's marketing VP, Mike Ivanov, said: "We can confirm multiple design wins and signed partners now in implementation. Based upon partners' product plans, we are told the first Albireo-enabled products will be introduced later in 2010. They will run circles around any solution currently available in the market."
He added, with reference to Ocarina's dedupe announcement: "There has been a lot of reactive activity this week, It's easy to put a out a press release making claims, but our technology is mature and being delivered today and the partners, the analysts, and our third-party performance validation are real."
Who are the prospective OEMs for Ocarina and Permabit?
We can rule out NetApp, and also EMC - it has a Viper team developing its own data reduction technology.
HP is not a prospect for Ocarina or Permabit neither. We have been told by a knowledgeable person that HP had a reselling deal with Avamar in 2003, and apparently an OEM deal in 2005. This was abruptly cancelled when HP decided to develop its own deduplication product. Avamar told HP it was a very difficult technology to develop, but nevertheless HP went ahead. In the following years HP would talk to other deduplication and compression suppliers about deduplication and compression technology but the talks never achieved anything, the thought being that HP was perhaps trying to validate its own efforts.
Now HP has announced its StoreOnce second-generation data reduction technology. An HP Labs spokesperson said: "The whole of the dedupe code is developed by HP in Bristol and … we do not license any third party code to perform the functionality of dedupe in the StoreOnce products."
A source close to Compellent said its deduplication plans did not include Ocarina or Permabit software.
HDS has just signed a deal to resell FalconStore deduplication products and although it is an Ocarina reseller, as is HP, it has said nothing about developing data reduction code for its own AMS and USP storage arrays.
IBM is rumoured be buying Storwize, a data compression vendor. There's no confirmation of this from a source close to Storwize, but that doesn't mean it isn't happening. IBM also has its acquired Diligent ProtecTIER deduplication and this code could be moved to its DSX000 storage array products, the SAN Volume Controller, SONAS and so forth.
NEC has its existing HYDRAstore technology. Oracle has Sun's ZFS, which deduplicates data at the file system level but it doesn't have block-level dedupe outside ZFS. Quantum has its own DXi technology. Xiotech does not seem a good prospect because its strategy is to push storage controller functions "up the stack" from its ISE storage enclosures.
The three disk subsystem suppliers Dot Hill, LSI and Xyratex are unlikely as their products are developed in agreement with their main OEM partners, the players above. LSI Engenio does sell its own branded storage so that's a possible target.
That means the main storage OEM prospects for Ocarina and Permabit are likely to be 3PAR, BlueArc, DataDirect, IBM, Isilon, Fujitsu, LSI Engenio, Oracle, Panasas, Pillar Data and Xyratex. There are also other players such as Data Robotics, Infortrend and Overland Storage. The biggest fish Ocarina and Permabit could land are IBM and Oracle. 3PAR, BlueArc, Isilon and Pillar would be good wins but after that the prospects seem dimmer. HDS could still be an outside chance though, and would be a huge win.
Once this round of industry development is over then dedupe will truly be a feature, not a product. That will put increased pressure on stand-alone players like Sepaton and Exagrid to find and keep sustainable dedupe market niches in which they are the best of breed products. ®