Original URL: http://www.theregister.co.uk/2013/05/08/isilon_deduplication/

Isilon OneFS snorts dedupe magic

Mavericks successor embraces OpenStack

By Jack Clark

Posted in Storage, 8th May 2013 00:10 GMT

EMC World 2013 EMC is preparing the next version of its Isilon OneFS NAS operating system, and is giving the technology a deduplication capability and support for object storage.

The next version of Isilon will integrate with EMC's ambitious software-defined storage ViPR technology, along with support for APIs from Amazon S3 and Atmos, Hadoop HDFS 2.0 native integration, and native dedupe.

The as-yet-unnamed version of Isilon follows the Mavericks release, which debuted in November. The next version will see the filer integrate with technology from VMware and new spin-off Pivotal.

It will support HDFS 2.0 and, by association, EMC's special Hadoop distribution PivotalHD along with Cloudera's CDH4 distro. This means Isilon OneFS supports both Hadoop 1.0 and 2.0, so can sit in diverse environments.

EMC's Dropbox clone file sharing technology Syncplicity is joining in the action as well, and can also now talk with the filer.

The NAS is also embracing the fashionable cloud control freak OpenStack via support to the Swift and Cinder storage technologies. Going hand in hand with this is the creation of a REST Object Access to Namespace interface to make it possible for admins to provision and manage object storage.

"What we're doing is applying out scale-out platform, ease of use [and] efficiency, into the future set of apps," Sam Grocott a product management veep for EMC's NAS division, told The Register.

Isilon is also gaining a post-process deduplication capability, so files and objects will go in at full size and then be rendered down after a background process runs. The feature will let administrators configure a 8k block-level deduplication that goes down to the detail level of individual directories. This should yield a capacity saving of around 30 per cent, we understand.

It will also integrate with the EMC Common Event Enabler which lets industry audit software keep track of file access over SMB/CIFS protocols to let organizations keep up with regulation like Sarbanes-Oxley and HIPAA.

The HDFS and Syncplicity on Isilon features were made available on Tuesday. The rest will come in the next version of Isilon which should be available by the end of 2013, EMC said. Dedupe will cost extra and require a separate licensing fee, but the specific price was not disclosed. ®