Articles about Deduplication

Dedupe, dedupe... dedupe, dedupe, dedupe: Oracle polishes ZFS diamond

Oracle's ZFS is widely lauded as a great file system even though several suppliers that use it for their own products have replaced its deduplication code with their own. One such was GreenBytes, a startup which developed an all-flash array for virtualised servers and focused on VDI. It switched to a software-only model after …
Chris Mellor, 11 Dec 2014
cable

Is HP pulling a fast one on deduplication?

Is HP pulling the deduplication wool over our eyes by claiming its dedupe box can run at 100TB/hour while EMC's best rate is 31TB/hour? Should a 4-pool dedupe system realistically be compared to single pool design? Yesterday at the HP Discover event in Las Vegas, the company announced its Store Once Catalyst software and B6200 …
Chris Mellor, 05 Jun 2012
The HP 3PAR StorServ 7000 series arrays

What's that you say? HP's going to do WHAT to 3PAR StoreServs?

Blocks and Files Rumours circulating today suggest HP is going to add full data deduplication to its StoreServ (3PAR) storage arrays. Deduplication identifies and removes duplicated blocks to prevent space being taken up by repetitive content. With a flash array, this also helps to reduce the amount of data written to the silicon which prolongs …
Chris Mellor, 30 May 2014
Stradivarius violin reproduction

Violin Memory FINALLY writes dedupe and compression into its latest Concerto

Violin Memory has fixed a gaping hole in its data management feature set by adding deduplication and compression to its Concerto memory array controller product. This will cut its effective cost/GB figures to new lows, and strengthens its competitive hand against other all-flash array vendors – such as EMX XtremIO, IBM …
Chris Mellor, 19 Aug 2014
SANblox

Permabit builds shrink-your-SAN dedupe box

Permabit has built a front-end SAN box to dedupe and compress SAN data so it needs less disk capacity. The company produces Albireo deduplication and compression software, which it sells on an OEM basis. The idea is to enable disk array vendors to improve the cost/GB of their storage so that they can retain a cost advantage over …
Chris Mellor, 16 Sep 2014

Deduplication: a power-hungry way to streamline storage

Windows Server 8 is coming, and it is bringing storage enhancements with it. Data deduplication in particular has caught my eye: it is something I have wanted on my Windows file servers for a long time. This technology is nothing new; ZFS has had deduplication for a while now, and this technology is (experimentally) available …
Trevor Pott, 06 Oct 2011
Lightning

HP gives StoreServ a speed boost with flashy cachey spit'n'polish

HP is beautifying hybrid flash/disk StoreServ (3Par) arrays by adding deduplication, flash cacheing and faster writes. Deduplication, branded Thin Deduplication, was added to its all-flash 7450 StoreServ array in June. Now it's been extended to all hybrid flash/disk StoreServ 7000 and 10000 arrays, helping get rid of duplicated …
Chris Mellor, 06 Nov 2014
VNX-F with 120-slot DAE

EMC upgrading all-flash VNX with bigger SSD and drive box

Comment EMC's VNX-F range of all-flash VNX arrays will soon scale up to 172TB of usable capacity, with a less than $5/GB cost, using a new drive enclosure and higher-capacity drives. A data sheet (pdf) on EMC's website talks about the new SSDs and drive enclosure. These are block storage arrays, accessed by 1/10GbitE iSCSI, FCoE or …
Chris Mellor, 25 Nov 2014
fingers pointing at man

NetApp duplicates deduplication

Comment By buying Engenio, NetApp gets engineers working with Permabit's Albireo deduplication technology to increase the effective capacity of Engenio's arrays. Trouble is it looks better than NetApp's in-house A-SIS dedupe. Oops. What does NetApp do now? A-SIS works with Data ONTAP, the software driving NetApp's FAS arrays, and is …
Chris Mellor, 04 May 2011
channel

Compellent has a rethink over deduplication

Comment Prior to its acquisition by Dell in February, Compellent was developing its own deduplication technology and had two NAS heads, providing file access to its arrays. Now that it's in the Dell sphere, both areas face change. Conversations with a source "familiar with the situation" indicate that Dell's own technologies could take …
Chris Mellor, 08 Apr 2011
Road leading to the factory

Is this storage kit the best? It DEPENDS. Why is your face turning red?

Storagebod Storage marketing is one of maddest and craziest parts of the technology industry: there are so many claims that don’t necessarily stand up to scrutiny and pretty much all of them require the caveat: "It depends…" It is very important to understand that it really does depend on a number of factors. For example, when your flash …
StorageBod, 12 Jun 2014
Cygnus constellation position

Permabit: Our flashy dedupe is everywhere, heh heh. Thanks Pure!

It's been a long haul but Permabit, which licenses its Albireo deduplication technology to storage-related suppliers, is finally seeing its fortunes rise. Wayne Salpietro, Permabit's marketing director, said: "We are seeing significant upswing in our activities, particularly with Tier 1 customers and prospects. We believe this …
Chris Mellor, 22 May 2014
Crystal ball via http://www.manoftaste.de/

Gartner mages throw deduping backup appliance bones, claim EMC's in lead

Gartner has released its first deduplication target backup appliance Magic Quadrant, confirming EMC's Data Domain in the lead but placing HP in a distinct second place, Quantum as a challenger and Exagrid as a visionary – surprise all round. The MQ is a (the) classic 4-box diagram, placing suppliers in a 2D space defined by " …
Chris Mellor, 12 Aug 2014
channel

IBM demonstrates dedication to deduplication replication

IBM is adding replication to its ProtecTIER deduplication product, which it acquired by buying Diligent in April 2008. ProtecTIER products will be able to replicate deduplicated data to a remote site and thus reduce any needs customers might have to ship tapes to a remote site for disaster recovery. Transmitting deduplicated …
Chris Mellor, 30 Jul 2009
big red wheelie bin and pallet full of rubbish in London street

BOFH: Stop your tiers – when it comes to storage, LESS is MORE

Episode 10 "You'll never guess who I just saw in here!" the PFY blurts, entering Mission Control with a mainstream IT mag in hand. "One of the Royal Family using a tablet?" "No." "A movie star or football player with a new bendy iPhone?" "No." "A vendor-sponsored review of new technology with a shameless suckup review of their …
Simon Travaglia, 01 Nov 2014
One Windows: Windows 10 will be delivered on multiple device types

Roll up, roll up, Microsoft's rolled up dozens of OS fixes

Microsoft's just released its November rollup of product fixes to address issues that go back to April 2014. The new dump includes patches galore for Windows RT 8.1, Windows 8.1, and Windows Server 2012 R2. The latter gets some handy fixes, such as one that includes “performance and reliability improvements in the cluster, file …
Simon Sharwood, 21 Nov 2014

Symantec offers BIGGER, FASTER NetBackup appliance

Symantec is refreshing its NetBackup 5000 series appliance line with a new model that operates faster and holds more data. The firm's 5000 Series Purpose-Built Backup Appliance (PBBA) range has expandable storage and end-to-end (both client and target sides) deduplication for physical and virtual environments. The existing 5230 …
Chris Mellor, 03 Oct 2014
Permabit Albireo SANBlox

Permabit: Wham, bam, box of data shrink SAN... for NetApp E-Series only

Permabit has made its SAN data shrink box available to NetApp users. But don't get your hopes up - it's for the E-Series arrays. The Albireo SANblox appliance sits in front of a Fibre Channel-connected SAN array and dedupes and compresses the data flowing into it and, we hope, rehydrates the data on the way out. Permabit said …
Chris Mellor, 04 Dec 2014
Bones, Kirk and Spock prepare to transport in Star Trek

TELEPORTABLE storage? Atlantis Computing's PR bods jump the shark

Altantis Computing has come up with a rather neat marketing hook for its new USX device. Fancy getting your hands on teleport-enabled storage? In Atlantis' latest vision of the storage world you would teleport your VM storage between DAS, NAS, SAN and the cloud, with VVOL support covering all storage. With Atlantis USX you …
Chris Mellor, 21 Aug 2014
Clouds_and_sun

Biz data botherer CommVault slips out fresh do-it-all bundle

CommVault has added additional AWS and Azure support and reveals easier, more targeted ways to buy its all-singing, all-dancing backup/archive/data management product Simpana 10. The AWS and Azure facilities include cloud reporting, end-user self-service provisioning, recovery, software snapshots and virtual machine resource …
Chris Mellor, 22 Aug 2014
channel

BlueArc goes for deduplication

Fast filer supplier BlueArc is going to embed Permabit's Albireo deduplication software into its products, enabling more data to be stored in the same disk capacity. BlueArc's Titan and Mercury filers use hardware acceleration to deliver faster access to data. Permabit has developed its Albireo software to deduplicate data …
Chris Mellor, 31 Aug 2010

Oracle buys desktop software virtualiser GreenBytes

Oracle is buying desktop software virtualiser GreenBytes, which uses ZFS technology, for an undisclosed sum. GreenBytes VDI software is based on ZFS and includes its own, highly rated deduplication engine and replication. It can run on flash hardware and, originally, GreenBytes sold a VDI flash appliance but got out if hardware …
Chris Mellor, 16 May 2014
StoreServ_7450

HP unveils enlarged 460TB 7450 all-flash array

HP has added deduplication to its 3PAR 7450 all-flash arrays. That means Hewlett-Packard – keen to not waste a byte, and provide deduplication for 3PAR file operations – is now at last able to reclaim duplicated bytes of information from chunks of 3PAR block storage. It calls this Thin Deduplication. Dedupe is just for the all- …
Chris Mellor, 09 Jun 2014
cloud

HP challenges Data Domain in deduplication

HP is expanding is aiming to take on Data Domain in the deduplication market, and developing SQL and Exchange appliances in the Exadata mould. Garry Veale, HP's StorageWorks VP for EMEA, talking at HP's Technology@Work event in Frankfurt, said the company will complement its VLS Sepaton-sourced enterprise deduplicating disk …
Chris Mellor, 27 Apr 2010
server room

Data Domain is working on global deduplication

Data Domain has been working on global deduplication across its DDX arrays for a couple of years, but the technology is not yet ready. The DDX arrays are collections of 4, 8 or 16-controller Data Domain deduplication systems which dedupe independently of each other. If they were to use a global deduplication map or index across …
Chris Mellor, 28 Oct 2009
ProtecTIER

IBM handing pink slips to Israel-based Diligent devs - reports

Israeli media outlets are reporting that IBM is laying off product developers at its Diligent operation but leaving support staff roles untouched. According to Israeli biz news site Calcalist, Diligent, XIV, and Storwize – all three Israeli companies acquired by Big Blue – were housed by the firm in the R&D division of its …
Chris Mellor, 14 Feb 2014
Flape HW costs

Flash data storage: Knocking TAPE off the archiving top spot

It was a bombshell when Facebook's Jason Taylor said he would like to use flash solid-state storage as an archive medium, but his reasons made perfect sense. Facebook users had lots of photos stored in their albums and rarely accessed them. But when they did want to look at them they wanted them to come up straight away, whether …
Chris Mellor, 10 Sep 2014

Dedupe-dedupe, dedupe-dedupe-dedupe: Flashy clients crowd around Permabit diamond

Putative OEM deduplication technology supplier Permabit could be about to land some clients, if a recent analyst's note is anything to go by. Stifel Nicolaus analyst Aaron Rakers sent a note around about private talks with Permabit CEO Tom Cook and what's happening with its Albireo deduplication technology - background here. HDS …
Chris Mellor, 24 Sep 2013
Cliffs_of_Moher_Ireland

Nexenta reckons it has Edge in squeezing your object storage BLOB

Nexenta says its latest NexentaEdge software product delivers petabyte-scale block and object storage with inline deduplication. NexentaStor, the existing product, is a ZFS-based software SAN product which Nexenta partners and customers can install on commodity storage array hardware – a mainstream SAN/filer replacement product …
Chris Mellor, 19 Aug 2014

Permabit squeezes its Albireo dedupe fruit, offers juice to vendors

Permabit is still aiming to strike OEM gold from its dedupe technology and has added compression to its Albireo deduper, aiming to help disk array vendors compete better against the all-flash and hybrid array startups. The idea is to enable disk array vendors to offer reduction of primary data, generally unavailable currently, …
Chris Mellor, 27 Jun 2014
Maxta Index Logo

All-singing-all-dancing hyperconverged Maxta gets Cisco's blessing

Maxta has announced the launch of its MxSP, the first Cisco-certified hyper-converged system to run on UCS C-Series servers and support metro-distance clusters. But how can a storage software company supply a hyperconverged server/storage/networking/software system when all it does is create the storage software component? …
Chris Mellor, 19 Nov 2014
Stradivarius violin reproduction

Violin's arrays play in Concerto - but they can't hit the dedupe notes yet

In a major architectural extension Violin Memory has revealed its new Concerto 7000 array. This uses Violin's existing 6200 hardware and gives it a separate high-availability controller front end, with software to provide business continuity, data management and protection features - but not deduplication. Let’s just recap …
Chris Mellor, 24 Jun 2014
Cloud Storage arrays

What you need to know about keeping your cloud data safe

The first reaction many corporate users – even those who are quite technically aware – have when considering a migration to cloud computing is to worry about data security. It is a fairly natural emotional response of course; you are effectively surrendering a kind of ownership of your data over to a third party. So what if a …
Gemini X-series

Hey, Nimbus Data. What you doin' with those 4TB flash slabs? Making a 96TB box? We KNEW it!

Nimbus Data has announced a 10-node clustered all-flash array that can store up to 96TB in a single box. The Gemini X-series all-flash arrays build on the current Gemini F-series arrays, which come in F610/F620 variants with 56/40/20 Gbit/s InfiniBand and 40/10/1 Gbit/s Ethernet, and the F410/F420 which lack InfiniBand and use …
Chris Mellor, 04 Mar 2014
graph up

Quantum downsizes DXi deduplication boxes

Quantum has downsized its enterprise DXi7500 deduplication product to the mid-range DXi6500, and given it Nehalem processing power and solid state storage. The DXi7500 is a high-end deduplication product offering both in-line deduplication as data lands on the device or post-process deduplication after data has landed. The …
Chris Mellor, 21 Oct 2009
Fujitsu_CS200c

There's a lot more to backup than you thought

If backup is too often an afterthought, have you considered its even poorer relation, archive. You haven’t? What a surprise. The fact is, businesses and their infrastructure depend upon common services for general efficiency, management focus and cost control. All organisations do, and it would be a nightmare if they didn't. …
Chris Mellor, 23 Oct 2014
FalconStor CEO Gary Quinn

'Member when we were running out of cash? Whew... thank goodness that's over – FalconStor

Comment FalconStor is moving on from its near-death experience last year, when, according to CEO Gary Quinn, it had just six months of cash left. The new chief now plans to build on its recovery by returning the firm to its roots with a unified software product. He also spoke of the firm taking on EMC's VPlex and IBM's SVC with its …
Chris Mellor, 04 Jun 2014
D'Artagnan and the three musketeers

Fujitsu fattens its all-in-one data protection box by 300 per cent

Like the three musketeers and their “one for all, all for one” motto, Fujitsu has its “all for one, one for all” CS8000 data protection appliance for mainframes and servers. It's just been strengthened with a 300 per cent capacity increase to 15PB online and a 50 per cent throughput increase. The CS8000 abstracts different …
Chris Mellor, 06 Nov 2013

Backup dedupe bods ExaGrid: We're 'cash-positive' this is our year

Deduplicating backup-to-disk startup ExaGrid is now cash-positive and thinks this could be its breakout year. ExaGrid is one of several suppliers trailing along behind EMC's Data Domain unit in the deduplicating backup-to-disk system market. Even with what they claim is arguably superior technology, they fail to grow faster than …
Chris Mellor, 09 Jan 2014
globalisation

Quantum extends deduplication to the sticks

Quantum claims to have rendered tape obsolete in branch and remote offices with a new smaller deduplication and replication appliance. The DXi2500-D is a branch office implementation of Quantum's DXi technology. It deduplicates backup files at remote and branch offices before replicating them, in encrypted form, to a central …
Chris Mellor, 01 Jun 2009
Kaminario K-Blocks

Kaminario shovels RAM, shiny new processors onto K2's peaks

Kaminario has updated its K2 all-flash array with new processors, more RAM, higher capacity SSDs and data reduction technology, claiming K2 is more efficient, scalable and cost-effective than either EMC's XtremIO or Pure Storage's FA-400 all-flash arrays. The fourth generation K2 product topped the SPC-1 random IO and SPC-2 …
Chris Mellor, 20 May 2014
Pigeon crapping on statue

Hyper-converged flash appliances are COMING. Here's one I dreamed up earlier...

Hyper-converged server/storage/networking systems use disks for storage. This is a temporary situation and all-flash hyper-converged appliances will come soon. We had a Vulture-ponder about how they might look and dreamed up a new Nutanix box, a high-end one in performance terms which, for the sake of convenience we'll call the …
Chris Mellor, 29 Aug 2014
channel

What happens to Dell's deduplication now?

Comment Dell has a three-way deduplication strategy that uses CommVault, EMC/Quantum and Symantec technologies. EMC has bought Data Domain, putting the Quantum technology at risk of replacement. What will Dell do? Back in November Dell said it would develop a single Quantum (DXi)-based de-duplication architecture across its PowerVault, …
Chris Mellor, 13 Jul 2009

Seagate cloud bod on EVault's EBA: Why of course we do dedupe

Comment EVault took exception to some points made in a report on some recent Seagate product news, in particular the Backup and Recovery appliance (EBA). Unmesh Kulkarni, senior product management director in the EVault-containing Seagate Cloud Systems and Solutions business, contacted The Reg to provide a comment. We'll do this …
Chris Mellor, 25 Sep 2014
channel_teaser_exit

Symantec backs out of Backup Exec: Plans to can appliance in Jan

Symantec is exiting the Backup Exec appliance market as it strengthens its NetBackup appliance. Backup Exec 3600 Backup Exec 3600 appliance with up to 5.5TB of usable capacity Backup Exec has had a challenging recent history. Backup Exec 2012 caused controversy with its changes, and Symantec admitted it had stubbed its toe …
Chris Mellor, 13 Oct 2014
Exagrid product table

Exagrid... heave: Storage troops push out range-topping dedupe box

There is a new range-topper for Exagrid's deduplicating backup to disk arrays, the EX21000E. Backup data keeps on growing so backup to disk systems have to grow their capacity and speed so as to able to deal with the amount of backup data in the time window available. Exagrid arrays can be pooled in a grid of 10 machines with …
Chris Mellor, 22 Oct 2013

Dive in, penguins: Upstart builds Linux virtual SAN

Three Bulgarian engineers who co-founded a firm called StorPool – which builds a virtual SAN using the aggregated storage of Linux KVM servers – are aiming to expand the reach of their three-year-old project. Boyan Ivanov, CEO, Boyan Krosnov, chief product officer, and Yanko Yankulov, the chief tech officer, started the firm in …
Chris Mellor, 24 Jul 2014
Violin_to Q2_Fy2015

All-flash array shipper Violin plays concerto after re-stringing

+Comment Violin CEO Kevin DeNuccio has cut the flash array shipper's losses to a fraction of what they were in their previous results, and grown revenue over the previous quarter. It’s still lower than a year ago, but a landmark for all that. Violin is no longer on the road to perdition. Growth should also accelerate as the new products …
Chris Mellor, 28 Aug 2014

NetApp's running with the big dogs: All-flash FlashRay hits the street

NetApp’s all-new FlashRay solid state array has been launched with limited availability and is not yet ready for prime time, having only a single controller, and lacking scale-out features and some ONTAP integration. These will come with future product upgrades, allowing NetApp to harden and fine-tune the product with this …
Chris Mellor, 17 Sep 2014
The HP 3PAR StorServ 7000 series arrays

What's that rumbling sound? It's HP preparing to deliver truckload of storage products

Attendees at HP’s Discover event in Barcelona this week are getting a bumper crop of StoreServ hardware and software announcements, expanding the HW range and adding object access and better data protection. They'll hear about: Enhanced 7200, 7400 and 7450 StoreServ arrays New 7440c array Expanded data import sources …
Chris Mellor, 01 Dec 2014