Articles about Compression

Stradivarius violin reproduction

Violin Memory FINALLY writes dedupe and compression into its latest Concerto

Violin Memory has fixed a gaping hole in its data management feature set by adding deduplication and compression to its Concerto memory array controller product. This will cut its effective cost/GB figures to new lows, and strengthens its competitive hand against other all-flash array vendors – such as EMX XtremIO, IBM …
Chris Mellor, 19 Aug 2014

Intel demos real-time code compression for die shrinkage, power saving

Research@Intel Intel researchers have developed a way to make the increasingly tiny processors needed to power the impending "Internet of Things" even tinier: compress the code running on them. "We compress the code, make it smaller, and save area and power of integrated on-die memory," Intel Labs senior reseacher Sergey Kochuguev from ZAO …
Rik Myslewski, 25 Jun 2013

Google open sources very slow compression algorithm

Google has open sourced a new compression algorithm called Zopfli that it says is a slower-but-stronger data squasher than the likes of zlib. The product of Googler Lode Vandevenne's 20 per cent time, the day a week Google allows its staff to work on side projects, Zopfli is said to reduce files to sizes 3.7–8.3 per cent smaller …
Simon Sharwood, 01 Mar 2013
Computer with dead bug, Stacy Brunner CC2 license

SAP crypto offers customers choice of remote code execution or denial of service

Yet another proprietary implementation of a popular protocol has turned up unexpected vulnerabilities, with SAP's data compression software open to remote code execution and denial-of-service exploits. The implementation in question is SAP's code running the popular LZC and LZH compression algorithms. As outlined over at Full …

IETF updates TLS/SSL best practice guidance

Do: start rolling TLS 1.3, support TLS 1.2, and DTLS 1.2. Don't: negotiate sessions using TLS 1, TLS 1.1, SSL 2 or SSL 3. Those are the Internet Engineering Task Force's latest recommendations, set out in RFC 7525, Recommendations for Secure Use of Transport Layer Security (TLS) and Datagram Transport Layer Security (DTLS). The …
PernixData FCP

PernixData RAMs in yet more speed to FVP

PernixData, the clusterable VMware IO cacher, has added compression to its RAM caching, meaning more effective data in RAM and more caching with its FVP software. V2.5 FVP has Distributed Fault-Tolerant Memory with LZ4 compression algorithms (DFTM-Z). These algorithms are fast and lossless and DFTM-Z checks data to see if it …
Chris Mellor, 25 Feb 2015
Fujitsu TR800

Diamonds are forever, Fujitsu Eternus now for VDI

Fujitsu has added a bunch of new variants to its Eternus TR storage arrays, targeting large scale desktop virtualisation environments. The models are the Eternus TR820, TR850 and TR880, with the last in the list claiming the ability to connect 3,500 VMs, which the company says is nearly double the scale of its previous models. …
Team Register, 20 Jan 2015
DRagon

Permabit OEM deal de-stealths Chinese all-flash array maker

Permabit says it has a new Albireo dedupe software OEM, and in so doing has revealed a brand new all-flash array vendor, this one from China. Sihua Technologies is an iCDN content delivery and NeuStor cloud storage product provider to the Chinese market. It is based in Shanghai and Hangzhou, with an office in Cupertino. Sihua …
Chris Mellor, 02 Apr 2015
Exablox node stack

Exablox is pretty sweet - but not great for restore applications

Comment One of the best places to find business storage products reviewed is Storage Review, which has just reviewed the Exablox NAS-headed object storage system for small and medium businesses. We wrote about Exablox and its RAID-less, deduping, highly scalable OneBlox technology here, saying the product looks like an Isilon cluster on …
Chris Mellor, 13 Feb 2015
channel

Dell bulks up storage line – with compression product

Dell is launching its first Ocarina data compression product, an adjunct to its DX6000 object storage product line. The DX6000 products twin Dell hardware with OEM'd Caringo object storage software. The DX6000G server is a clusterable storage compression node that works with DX6000 storage. It uses software from Ocarina, a …
Chris Mellor, 12 Oct 2011
channel

Google open sources MapReduce compression

Google has open sourced the compression library used across its backend infrastructure, including MapReduce, its distributed number-crunching platform, and BigTable, its distributed database. Available at Google Code under an Apache 2.0 license, the library is called Snappy, but Google says this is the same library that was …
Cade Metz, 24 Mar 2011
hands waving dollar bills in the air

Teradata adds hardware compression to data warehouses

Teradata invented the data warehousing market and is not about to let Larry Ellison take it over without a fight. At this week's Partners Conference in San Diego, which is where Teradata Labs does the development of some of the hardware and software that goes into its various data warehousing appliances, the company is …

50 shades of grey can turn Adobe Reader into a hot mess

Hackers can duck antivirus programs and execute malware in Adobe Reader by using greyscale images, says Danish security boffin Dénes Óvári. Lossy compression is thought to be susceptible to the DCTDecode filter, which should nuke malware woven into images and blunt this form of attack. However new intelligence published in the …
Darren Pauli, 03 Mar 2015
Nexenta_logos

Nexenta flies over the Edge into the object storage bearpit

Nexenta's hypercale block and object storage software has hit the streets, pitting Nexenta competitively against all the other object storage suppliers. NexentaEdge was introduced last August and now it's generally available, two quarters later than its then-schedule. We're having it described as "the first software-only scale …
Chris Mellor, 20 May 2015

IBM furtles all-flash biz bruiser FlashSystem

IBM has upped its all-flash array FlashSystem capacity to an effective 1.6PB by baking in SVC/Storwize features – including real-time compression. The FlashSystem V840 release 1.2 is built from three 2U rackmount boxes: an AE1 storage enclosure (as used in the 840) and two active-active AC1 control enclosures. The storage box …
Chris Mellor, 05 Aug 2014
BPG compression demo

QEMU, FFMPEG guru unleashes JPEG-slaying graphics compressor

Noted software wizard Fabrice Bellard has devised a new raster image format that he says offers superior quality to JPEG at similar file sizes. Bellard – who is known for creating the QEMU virtualization hypervisor and the FFMPEG multimedia libraries, among other achievements – says the new format, called Better Portable …
Neil McAllister, 12 Dec 2014
PS6610

Drama in the dingly Dell as it embiggens its data centre range

Dell has dug a deeper bottom level for its SC Compellent arrays and piled up a new peak for its PS series EqualLogic arrays, expanding and enhancing both product ranges while still having an overall convergence strategy. SCv2000 SCv2000 In your mental landscape, place Dell SC (Compellent) arrays as the enterprise multi- …
Chris Mellor, 08 May 2015

Boffins find Jackie Chan's SUPERCOP is good for something

Blu-Ray might not be setting the world afire, but boffins have turned up a surprising upside of the technology that can be applied to solar PV manufacture. It turns out the pit-and-peak pattern that encodes a movie on the disk helps improve light absorption if reproduced on the surface of a solar cell. Published in Nature …
Fusion-io ioSgale 3.2TB card

MySQL daddy Monty talks up Fusion-io's data-stuffed flash

Fusion-io can cram more data into its ioMemory flash storage without cramping performance – at least that’s what it’s claiming about its NVM Compression technology. We are told NVM Compression is “a flash-aware interface that can double the useable capacity of ioMemory flash while eliminating the performance impact associated …
Chris Mellor, 02 Apr 2014
channel

HDS coy about future compression tech

Hitachi Data Systems doesn't have its own compression/deduplication technology but looks set to get it. Dell is buying Ocarina for such technology and HDS is the array supplier holdout, as competitors EMC, HP, IBM and NetApp each have their own technology for data reduction. What is HDS going to do? Senior executives are being …
Chris Mellor, 23 Jul 2010
XtremIO upgrade video

No biggie: EMC's XtremIO firmware upgrade 'will wipe data'

There's a rumor that upgrading EMC's XtremIO firmware to v3.0 will wipe all user data from the flash array. It's mentioned here. It seems going from firmware version 2.4.x to version 3.0, expected by early October, will cause data to be lost – and customers will need to back everything up before the upgrade and restore it …
Chris Mellor, 15 Sep 2014
channel

EMC gets busy with dedupe, compression code-base

EMC has been developing its own deduplication and compression code-base, entrusting the effort to a team code-named Viper. The story, as told by someone familiar with the events, starts with EMC acquiring Avamar in November 2006. In June 2009 it acquired DataDomain. At this point it had Avamar source deduplication, DataDomain …
Chris Mellor, 25 Jun 2010
gavel_judgment_channel

Adobe and software pals haul Forever 21 to court over piracy allegations

A trio of software firms is taking a large US-based fashion retailer to court for allegedly pirating their software. Adobe, Autodesk and Corel claim that clothes bazaar Forever 21 infringed their copyright by illegally copying a raft of well-known software tools and not paying license fees. Forever 21 is a $3.8bn retailer with …
Gavin Clarke, 02 Feb 2015
Road leading to the factory

Is this storage kit the best? It DEPENDS. Why is your face turning red?

Storagebod Storage marketing is one of maddest and craziest parts of the technology industry: there are so many claims that don’t necessarily stand up to scrutiny and pretty much all of them require the caveat: "It depends…" It is very important to understand that it really does depend on a number of factors. For example, when your flash …
StorageBod, 12 Jun 2014

It's Friday. The pub is looming. IDC tells us 'bottoms up'. We'll drink to that headline

IDC has released a flash-based array study saying it's used a (and we quote) "bottoms-up approach." We'll raise a glass to that notion. The study, Worldwide All-Flash Array and Hybrid Flash Array 2014–2018 Forecast and 1H14 Vendor Shares, looks at revenues and raw terabytes shipped with flash-based arrays - all-flash arrays ( …
Chris Mellor, 16 Jan 2015

SimpliVity opens its doors to KVM, OpenStack

Hyper-converged infrastructure company SimpliVity has announced it now supports the KVM hypervisor and OpenStack. SimpliVity's schtick is that everything below the hypervisor – especially data compression and de-duplication for back-up, networking and cloud-tiering storage – should be handled by a hyper-converged appliance. It …
Simon Sharwood, 20 May 2015

Mozilla and Facebook snip a further five per cent from all JPEGs

Just four months after loosing the mozjpeg encoder on a waiting world, Mozilla has updated it to version 2.0, at the same time announcing that Facebook is testing the new iteration. The Social NetworkTM has also slung Mozilla $US60,000 towards the development effort in anticipation of mozjpeg 3.0. Mozjpeg, first released in …
udp_7000_648

Arcserve boxes clever, takes back-up appliance down a price division

CA spin-out Arcserve has an updated back-up appliance for the mid-market that should be faster, easier, better-priced and more capable. It says the UDP 7000 Appliance is for small, medium and mid-market customers, and is a simple yet powerful all-in-one product. UDP stands for Unified Data Protection and the appliance features …
Chris Mellor, 20 May 2015
HTTP/2 flow diagram

HTTP/2 spec gets green light: Faster web or needless complexity?

The Internet Engineering Steering Group (IESG) has approved the specifications for HTTP/2 and HPACK (a compression format for HTTP/2 header fields), says working group chair Mark Nottingham. HTTP/2 is based on SPDY, a Google-developed protocol designed to speed up web page loading by compressing the content and reducing the …
Tim Anderson, 18 Feb 2015
SANblox

Permabit builds shrink-your-SAN dedupe box

Permabit has built a front-end SAN box to dedupe and compress SAN data so it needs less disk capacity. The company produces Albireo deduplication and compression software, which it sells on an OEM basis. The idea is to enable disk array vendors to improve the cost/GB of their storage so that they can retain a cost advantage over …
Chris Mellor, 16 Sep 2014
Micron 128-gigabit multi-level cell NAND Flash memory device

Let's talk about the (real) price of flash and spinning disks

Comment Lately I have been writing a lot about the role of flash memory and disk drives in the future of storage infrastructure (here and here are a couple of examples). And it's clear flash will be used for primary workloads, and object storage and disks for the rest. The reality is that flash memory is quickly becoming already a no- …
bear_cub_with_salmon

Coho Data spawns all-flash MicroArray with fresh funding help

Storage service array startup Coho Data has nearly doubled its funding and got itself a new product to boot. A nice thirty million dollars has been injected into the company in a C-round led by March Capital Partners, along with Intel Capital, HP, Andreessen Horowitz and Ignition Partners. It's interesting that both Intel and HP …
Chris Mellor, 21 May 2015

Permabit squeezes its Albireo dedupe fruit, offers juice to vendors

Permabit is still aiming to strike OEM gold from its dedupe technology and has added compression to its Albireo deduper, aiming to help disk array vendors compete better against the all-flash and hybrid array startups. The idea is to enable disk array vendors to offer reduction of primary data, generally unavailable currently, …
Chris Mellor, 27 Jun 2014

Linux 3.19 released for your computing pleasure

Version 3.19 of the Linux kernel has been signed off by Linus Torvalds. News of the release emerged in a typically economical Sunday evening post to the Linux Kernel Mailing List, in which Torvalds noted there are still a couple of bugs in this release but they were pretty obscure so “... while I was tempted a couple of times to …
Simon Sharwood, 09 Feb 2015

Pre-IPO Tegile looking at flash tiering, scale-out and the cloud

+Comment Hybrid and all-flash array startup Tegile has got itself an interesting roadmap to extend its hybrid array tech and expand sideways into adjacent storage markets. Tegile is one of three busily growing companies touting built-from-the-ground-up hybrid array software. Nimble Storage has made the IPO jump into being a self- …
Chris Mellor, 26 May 2015
Close-up of a YouTube logo as viewed on a computer screen in close up...

Choc Factory's king codec serves 25 BEELLION Tube hours

Users have watched 25 billion hours of YouTube videos encoded with Google's VP9 codec, which the company says brings the net closer to instant high-quality bufferless video. The Choc Factory's open source VP9 is designed as a replacement for the popular patented H.264 and HEVC codecs and is particularly valuable for mobile user …
Darren Pauli, 07 Apr 2015
Intel sign by StockMonkeys.com

Intel's new chips are from 'Purley' – know what I mean? Know what I mean? Say no more

A presentation given at a conference on high-performance computing (HPC) in Poland earlier this month appears to have yielded new insight into Intel's Xeon server chip roadmap. A set of slides spotted by our sister site The Platform indicates that Chipzilla is moving toward a new server platform called "Purley" that will debut …
Neil McAllister, 27 May 2015
Larry Ellison, photo by Oracle Corporate Communications

Explained: How LSI and Oracle cooked up magical flash-embiggening sauce

Oracle and LSI have magicked up a way for LSI’s Nytro server flash cards to hold more data than they’re seemingly physically capable of holding and called it Dynamic Logical Capacity (DLC). How does it work? We thought it might be a paging mechanism – but we were dead wrong. The card compresses the data it is sent and can reach …
Chris Mellor, 15 Jan 2014
Nyancoin logo

Exploit emerges for LZO algo hole

Security Mouse security researcher Don A Bailey has showcased an exploit of the Lempel-Ziv-Oberhumer (LZ0) compression algorithm running in the Mplayer2 media player and says it could leave some Linuxes vulnerable to attack. The LZO data compression algorithm was created by Markus Oberhumer in 1994 and was discovered to be …
Darren Pauli, 11 Jul 2014
One Windows: Windows 10 will be delivered on multiple device types

Honey, I shrunk the Windows footprint

One of the challenges Microsoft has given itself with its goal of making Windows 10 run on almost anything is that lots of devices have rather less storage than PCs, which means Redmond can't assume users will have hard disk space to burn. If Windows takes up most of a cheaposlab's 32GB solid state disk, that's not going to make …
Simon Sharwood, 17 Mar 2015
Flash Gordon

It pays to fake it: Test your flash SAN with a good simulation

It is pretty obvious that storage systems vary. You could reply, with some justification: “No shit, Sherlock!” What is less obvious and more useful to know, however, is how and why they vary and how the variation – not just between all-disk, hybrid and all-flash arrays but even between different arrays of the same class – can …
Bryan Betts, 21 May 2015
Syneto_Storage_OS

Syneto: Behold, blockheads – an all-flash array... based on ZFS

A ZFS-based all-flash array? There's a thing to note in this block-focused all-flash array world. Europe-based Syneto has developed the product and it has updated its SMB-focused, ZFS-using Extreme 220 product. The Extreme 220 is a 2U x 24 hot-swap slot box with from 2TB to 144TB of SATA or SAS SSDs. That means 6TB SSDs are used …
Chris Mellor, 26 Feb 2015
Hadoop_elephant

Teradata gobbles up data squasher RainStor

Teradata has bought RainStor, the deduping database supplier and Hadoop convert. RainStor specializes in archiving and two years ago put its analytics engine and enterprise database on Hadoop, the Google-inspired big-data cruncher. Financial terms of the deal for the privately held RainStor were not revealed. Teradata called …
Gavin Clarke, 18 Dec 2014
Broom

QLogic escapes HBA flat trap with Ethernet and add-on services

QLogic, a storage networking adaptor vendor, is escaping the sagging Fibre Channel host bus adapter (HBA) revenue trap by focussing on fast Ethernet and adding in-line data reduction, availability and encryption services. Analyst haus Stifel Nicolaus' MD, Aaron Rakers, sees QLogic ramping up its 10GbitE products, with 25/50/ …
Chris Mellor, 19 May 2015

Facebook hopes devs will 'Like' how mobile SDKs, Graph API have scrubbed up

F8 2015 Facebook has used the occasion of its F8 developer conference in San Francisco this year to roll out a major update to its software development kits for Android and iOS, in addition to a new version of the API for accessing its social graph data. "This is our first major update to the iOS and Android SDKs in more than two years …
Neil McAllister, 26 Mar 2015
Rows of washing machines in shop aisle

Dell inserts Hyper-V smarts into its DL backup boxen

Dell has added two new back-up appliances to its range, top-and-tailing its existing DL1000 product and adding neat features such as virtual standby VMs. The DL series range is for small and medium businesses and are PowerEdge servers running AppAssure software. The 1U DL1000, with 2TB-3TB of capacity, was announced in July 2014 …
Chris Mellor, 21 May 2015
MIPS Creator CI20 development board

MIPS quietly bares its processor architecture to universities

The MIPS processor architecture behind many graphics cards and the PlayStation 2 is being laid bare by its licensee Imagination Technologies. While ARM and Intel dominate the chip market, the MIPS third option is still a significant player in the industry – but what goes on inside processors is a closely guarded secret. …
Simon Rockman, 27 Apr 2015

Let Google's tentacles fondle your mobile's web downloads and Chrome will put the data on a diet

The latest version of Google's Chrome browser for handheld devices includes a data-compression feature that's designed to save customers money on their mobile bills, among other new bells and whistles. The compression comes disabled by default on Android and iOS, but can be activated by flipping a single switch in the browser's …
Neil McAllister, 16 Jan 2014
Cisco and Veeam's UCS backup scheme

Veeam lobs backup bombs, with Cisco lighting the fuse

Veeam's making waves again, with two new initiatives sure to get backup software rivals – and tin-makers – a little riled. Software rivals have to figure out how to contend with the new free endpoint backup tool the company flagged last October and released today. The tool's pitched at anyone who wants to back up a Windows PC, …
Simon Sharwood, 15 Apr 2015

VMware: Storage data functions can and WILL migrate to flash media

Comment VMware's CTO has revealed his belief that array and VSAN-level storage data service functions can, and will, move into flash media. He made the point on a recent blog that it is logical for physical block addressing to be dynamic rather than static. A disk drive's firmware maps logical block addresses (LBAs) to physical block …
Chris Mellor, 05 Jan 2015