Articles about Compression

Google's new squeeze: Brotli compression open-sourced

Google wants to bring to life the HBO series Silicon Valley: it's pitching a new open source compression algorithm into the world, with the hope that it can eventually end-of-life the venerable Deflate. Brotli (“small bread” in Swiss German, apparently) follows on from Zopfli (“little braid,” also bread-themed), but with …
Stradivarius violin reproduction

Violin Memory FINALLY writes dedupe and compression into its latest Concerto

Violin Memory has fixed a gaping hole in its data management feature set by adding deduplication and compression to its Concerto memory array controller product. This will cut its effective cost/GB figures to new lows, and strengthens its competitive hand against other all-flash array vendors – such as EMX XtremIO, IBM …
Chris Mellor, 19 Aug 2014

Intel demos real-time code compression for die shrinkage, power saving

Research@Intel Intel researchers have developed a way to make the increasingly tiny processors needed to power the impending "Internet of Things" even tinier: compress the code running on them. "We compress the code, make it smaller, and save area and power of integrated on-die memory," Intel Labs senior reseacher Sergey Kochuguev from ZAO …
Rik Myslewski, 25 Jun 2013

Google open sources very slow compression algorithm

Google has open sourced a new compression algorithm called Zopfli that it says is a slower-but-stronger data squasher than the likes of zlib. The product of Googler Lode Vandevenne's 20 per cent time, the day a week Google allows its staff to work on side projects, Zopfli is said to reduce files to sizes 3.7–8.3 per cent smaller …
Simon Sharwood, 01 Mar 2013

Does Linux need a new file system? Ex-Google engineer thinks so

Former Googler Kent Overstreet has announced that a long-term project to craft a new Linux file system is at a point where he'd like other developers to pitch in. Since you're already asking why bother with a new file system, the answer Overstreet provides in this post to the kernel mailing list is that he wants to “match ext4 …
Computer with dead bug, Stacy Brunner CC2 license

SAP crypto offers customers choice of remote code execution or denial of service

Yet another proprietary implementation of a popular protocol has turned up unexpected vulnerabilities, with SAP's data compression software open to remote code execution and denial-of-service exploits. The implementation in question is SAP's code running the popular LZC and LZH compression algorithms. As outlined over at Full …

IETF updates TLS/SSL best practice guidance

Do: start rolling TLS 1.3, support TLS 1.2, and DTLS 1.2. Don't: negotiate sessions using TLS 1, TLS 1.1, SSL 2 or SSL 3. Those are the Internet Engineering Task Force's latest recommendations, set out in RFC 7525, Recommendations for Secure Use of Transport Layer Security (TLS) and Datagram Transport Layer Security (DTLS). The …

SolidFire pulls off gloves for unholy storage ding-dong. Ding-ding!

Punchy all-flash array startup SolidFire has taken the gloves off in its competition with EMC, NetApp and Pure Storage by releasing competitive architectural comparisons singling out weaknesses in their products. You can get comparison docs vs NetApp all-flash FAS, EMC’s XtremIO and Pure Storage’s FlashArray by filling in …
Chris Mellor, 06 Jul 2015
PernixData FCP

PernixData RAMs in yet more speed to FVP

PernixData, the clusterable VMware IO cacher, has added compression to its RAM caching, meaning more effective data in RAM and more caching with its FVP software. V2.5 FVP has Distributed Fault-Tolerant Memory with LZ4 compression algorithms (DFTM-Z). These algorithms are fast and lossless and DFTM-Z checks data to see if it …
Chris Mellor, 25 Feb 2015

Dell bulks up storage line – with compression product

Dell is launching its first Ocarina data compression product, an adjunct to its DX6000 object storage product line. The DX6000 products twin Dell hardware with OEM'd Caringo object storage software. The DX6000G server is a clusterable storage compression node that works with DX6000 storage. It uses software from Ocarina, a …
Chris Mellor, 12 Oct 2011
Fujitsu TR800

Diamonds are forever, Fujitsu Eternus now for VDI

Fujitsu has added a bunch of new variants to its Eternus TR storage arrays, targeting large scale desktop virtualisation environments. The models are the Eternus TR820, TR850 and TR880, with the last in the list claiming the ability to connect 3,500 VMs, which the company says is nearly double the scale of its previous models. …
Team Register, 20 Jan 2015

Google open sources MapReduce compression

Google has open sourced the compression library used across its backend infrastructure, including MapReduce, its distributed number-crunching platform, and BigTable, its distributed database. Available at Google Code under an Apache 2.0 license, the library is called Snappy, but Google says this is the same library that was …
Cade Metz, 24 Mar 2011
A Handful of Giant Weta by Mike Locke

Linux Foundation serves up a tasty dish of BUGS

The Linux Foundation's Core Infrastructure Initiative has completed its first-pass survey of the Linux toolset, and is highlighting which tools are most at risk. While there's lots of attention on high-profile packages like crypto tools, web servers and mail agents, there's also a lot of packages that everyone uses and nobody …

Delphix gets a pat on the back in Gartner's latest tea leaves reading

Data virtualiser Delphix has had a Gartner boost by appearing in the leaders’ box of its Magic Quadrant report for Structured Data Archiving and Application Retirement. Delphix_MQ_chart Fellow data virtualiser Actifio was also placed in the MQ, as a niche player. The other four leaders are IBM, HP, Informatica and Solis …
Chris Mellor, 24 Jun 2015
hands waving dollar bills in the air

Teradata adds hardware compression to data warehouses

Teradata invented the data warehousing market and is not about to let Larry Ellison take it over without a fight. At this week's Partners Conference in San Diego, which is where Teradata Labs does the development of some of the hardware and software that goes into its various data warehousing appliances, the company is …
Exablox node stack

Exablox is pretty sweet - but not great for restore applications

Comment One of the best places to find business storage products reviewed is Storage Review, which has just reviewed the Exablox NAS-headed object storage system for small and medium businesses. We wrote about Exablox and its RAID-less, deduping, highly scalable OneBlox technology here, saying the product looks like an Isilon cluster on …
Chris Mellor, 13 Feb 2015

Permabit OEM deal de-stealths Chinese all-flash array maker

Permabit says it has a new Albireo dedupe software OEM, and in so doing has revealed a brand new all-flash array vendor, this one from China. Sihua Technologies is an iCDN content delivery and NeuStor cloud storage product provider to the Chinese market. It is based in Shanghai and Hangzhou, with an office in Cupertino. Sihua …
Chris Mellor, 02 Apr 2015
(c) Metro-Goldwyn-Mayer Studios Inc. TM Danjaq, LLC. All Rights Reserved

Atlantis: The DSSD, data centre disk killer rising from the deep

Interview Atlantis, the VM-accelerating DRAM cacher that’s moved into hyperconverged storage, has its eye on CrossPoint memory – the 3D XPoint stuff 1,000 times faster than NAND – as a way of cementing disk into a data centre coffin. It also aims to use it to pre-empt DSSD. CrossPoint memory was announced by Intel and Micron in July as …
Chris Mellor, 10 Sep 2015

50 shades of grey can turn Adobe Reader into a hot mess

Hackers can duck antivirus programs and execute malware in Adobe Reader by using greyscale images, says Danish security boffin Dénes Óvári. Lossy compression is thought to be susceptible to the DCTDecode filter, which should nuke malware woven into images and blunt this form of attack. However new intelligence published in the …
Darren Pauli, 03 Mar 2015
Jet boat on sydney harbour

Join The Reg and SimpiVity for high-speed HYPER-LUNCH

Video Hyperconverged server vendor SimpliVity does the “lots of VMs, spun up fast, in a single box, with impressive scaling” thing. But the company also packs all of the infrastructure and functions below the hypervisor into its wares. So you also get WAN optimisation, data compression and de-duplication, a cloud gateway and more …

Nexenta flies over the Edge into the object storage bearpit

Nexenta's hypercale block and object storage software has hit the streets, pitting Nexenta competitively against all the other object storage suppliers. NexentaEdge was introduced last August and now it's generally available, two quarters later than its then-schedule. We're having it described as "the first software-only scale …
Chris Mellor, 20 May 2015

Smuggle mischievous JavaScript into WinRAR archives? Sure, why not

The popular WinRAR compression software can be abused to produce self-extracting archives that execute smuggled-in JavaScript code when decompressed. A proof-of-concept exploit to pull off the trick has been published, and its creator reckons it works on all versions of WinRAR. It's not quite the end of the world, though: …
Darren Pauli, 30 Sep 2015

HDS coy about future compression tech

Hitachi Data Systems doesn't have its own compression/deduplication technology but looks set to get it. Dell is buying Ocarina for such technology and HDS is the array supplier holdout, as competitors EMC, HP, IBM and NetApp each have their own technology for data reduction. What is HDS going to do? Senior executives are being …
Chris Mellor, 23 Jul 2010

EMC gets busy with dedupe, compression code-base

EMC has been developing its own deduplication and compression code-base, entrusting the effort to a team code-named Viper. The story, as told by someone familiar with the events, starts with EMC acquiring Avamar in November 2006. In June 2009 it acquired DataDomain. At this point it had Avamar source deduplication, DataDomain …
Chris Mellor, 25 Jun 2010
CN72/73xx Block Diagram

Cavium adds 4/16 core SoCs

Cavium is filling out a scale gap in its Octeon III system-on-a-chip (SoC) range with he four-to-sixteen core CN72xx and CN73xx variants that are pin-compatible with the rest of the range. The MIPS64-based SoCs are low-power network processors pitched between the one-to-four core CN71xx and the 24-48 CN78xx range. The chips can …
Google Photo

Google spins up 'FREE, unlimited' cloud photo storage 4 years before ad giant nixes it

Google I/O Google has wheeled out a cloud-hosted photo storage service that, it hopes, will mean that embarrassing images from your past can be organized by computers so you don't have to. Youtube video The photo album software, available on Android and iOS from Thursday, slurps up all the photos on your mobile, and uploads them to a …
Iain Thomson, 29 May 2015

IBM furtles all-flash biz bruiser FlashSystem

IBM has upped its all-flash array FlashSystem capacity to an effective 1.6PB by baking in SVC/Storwize features – including real-time compression. The FlashSystem V840 release 1.2 is built from three 2U rackmount boxes: an AE1 storage enclosure (as used in the 840) and two active-active AC1 control enclosures. The storage box …
Chris Mellor, 05 Aug 2014
Wedding cake. Pic: Tracy Hunter

Like a wedding cake: Avere unveils three-tier AWS cloud NAS

Avere is punting a three tier filer in the AWS cloud using its virtual FXT filer accelerator software. The general idea is that you have compute instances running in the AWS cloud and they use file data, so you need a NAS in the cloud. You have choices about where to put the file data: EC2 RAM for the fastest access; EBS …
Chris Mellor, 07 Oct 2015
BPG compression demo

QEMU, FFMPEG guru unleashes JPEG-slaying graphics compressor

Noted software wizard Fabrice Bellard has devised a new raster image format that he says offers superior quality to JPEG at similar file sizes. Bellard – who is known for creating the QEMU virtualization hypervisor and the FFMPEG multimedia libraries, among other achievements – says the new format, called Better Portable …
Neil McAllister, 12 Dec 2014

Unhinged Linux backdoor still poses a nuisance, if not a threat

Internet Igors have stitched together a new Linux backdoor. Fortunately for internet hygiene the botnet agent – which packs a variety of powerful features – is faulty and only partially functional. The backdoor, dubbed Dklkt-1 was designed to be a cross-platform nasty capable of infecting both Windows and Linux machines. …
John Leyden, 27 Jul 2015

Silicon Valley, episode 8: Larping, mogging and losing its way

Recap The first season of HBO's sharp, satirical Silicon Valley had just eight episodes. By the measure of last night's show, they should have stuck to that for season two rather than try to punch in an extra two episodes. White Hat/Black Hat felt like the episode pulled together from rejected ideas. And there weren't that many, so we …
Kieren McCarthy, 01 Jun 2015

Nexenta catches micro-services bug, slings its Edge into containers

Nexenta is supporting containerised servers by having its NexentaEdge product nodes run as microservices along with application microservices on any scale-out Linux server cluster. NexentaEdge is scale-out block and object storage. Containers are a more efficient form of server virtualisation, having thinner "wrappers" than …
Chris Mellor, 16 Sep 2015
Fritz Pfleumer with his magnetic tape recorder

LTO issues mighty seventh-generation 15TB tape format

LTO, the world’s most popular tape format, has a 15TB generation-7 Ultrium specification available for drive and media manufacturers. Linear Tape Open (LTO) represents a trio of technology provider companies: HP, IBM and Quantum. It works with them and tape suppliers like Fujifilm to develop tape media and drive specifications …
Chris Mellor, 16 Sep 2015
Fusion-io ioSgale 3.2TB card

MySQL daddy Monty talks up Fusion-io's data-stuffed flash

Fusion-io can cram more data into its ioMemory flash storage without cramping performance – at least that’s what it’s claiming about its NVM Compression technology. We are told NVM Compression is “a flash-aware interface that can double the useable capacity of ioMemory flash while eliminating the performance impact associated …
Chris Mellor, 02 Apr 2014

Boffins find Jackie Chan's SUPERCOP is good for something

Blu-Ray might not be setting the world afire, but boffins have turned up a surprising upside of the technology that can be applied to solar PV manufacture. It turns out the pit-and-peak pattern that encodes a movie on the disk helps improve light absorption if reproduced on the surface of a solar cell. Published in Nature …

Drama in the dingly Dell as it embiggens its data centre range

Dell has dug a deeper bottom level for its SC Compellent arrays and piled up a new peak for its PS series EqualLogic arrays, expanding and enhancing both product ranges while still having an overall convergence strategy. SCv2000 SCv2000 In your mental landscape, place Dell SC (Compellent) arrays as the enterprise multi- …
Chris Mellor, 08 May 2015
A hammer and bent screw

Cisco hands license-busting troll-hammer to THOR

Cisco is sick of the state of patent licensing for video codecs, so has decided to set a royalty-free of its own loose on the world. The Borg's problem is twofold: on the one hand, the licensing pools for H.264 fail to represent many of the participants in the industry; on the other, the successor, H.265, can be vastly more …
XtremIO upgrade video

No biggie: EMC's XtremIO firmware upgrade 'will wipe data'

There's a rumor that upgrading EMC's XtremIO firmware to v3.0 will wipe all user data from the flash array. It's mentioned here. It seems going from firmware version 2.4.x to version 3.0, expected by early October, will cause data to be lost – and customers will need to back everything up before the upgrade and restore it …
Chris Mellor, 15 Sep 2014
Railway line split. Pic: Ian Sane

VMware doubles the VM count for EVO: RAIL systems

VMware has pumped up the power of its hyper-converged EVO: RAIL nodes with more memory and storage, so they can run twice as many VMs. As detailed in a VMware blog, the latest node options look like this: Dual 6, 8, 10 or 12 core Intel Haswell or Ivy Bridge CPUs per node 128GB to 512GB of memory per node, up from 192GB VMware …
Chris Mellor, 17 Jun 2015
server room

Snap out of the snapshot habit, says mutant upstart Reduxio

Surprise! Freshly uncloaked hybrid flash/disk array startup Reduxio says backup snapshots are a problem and its BackDating technology solves that problem. Admit it; you are surprised, aren't you? Reduxio is an Israeli startup, in the sense that its research and development is based there, although it is headquartered in …
Chris Mellor, 01 Sep 2015

NetApp slims down latest controller, beefs up channel efforts

NetApp has announced a slimmed down top-end array, cutting the controller box size in half. It is a 6U-sized version of the AFF8080 EX, NetApp's most powerful AFF8000 system. The 8000 series product line previously started with the 3U AFF8020, passed through the 6U 8040 and 8060, and peaked with the 12U (2 enclosures) AFF8080 …
Chris Mellor, 28 Sep 2015
Road leading to the factory

Is this storage kit the best? It DEPENDS. Why is your face turning red?

Storagebod Storage marketing is one of maddest and craziest parts of the technology industry: there are so many claims that don’t necessarily stand up to scrutiny and pretty much all of them require the caveat: "It depends…" It is very important to understand that it really does depend on a number of factors. For example, when your flash …
StorageBod, 12 Jun 2014

Adobe and software pals haul Forever 21 to court over piracy allegations

A trio of software firms is taking a large US-based fashion retailer to court for allegedly pirating their software. Adobe, Autodesk and Corel claim that clothes bazaar Forever 21 infringed their copyright by illegally copying a raft of well-known software tools and not paying license fees. Forever 21 is a $3.8bn retailer with …
Gavin Clarke, 02 Feb 2015

Mozilla and Facebook snip a further five per cent from all JPEGs

Just four months after loosing the mozjpeg encoder on a waiting world, Mozilla has updated it to version 2.0, at the same time announcing that Facebook is testing the new iteration. The Social NetworkTM has also slung Mozilla $US60,000 towards the development effort in anticipation of mozjpeg 3.0. Mozjpeg, first released in …
Datacore CEO George Teixeira and chairman Ziya Aral

DataCore conducts its SANsymphony a little more... allegro

DataCore has updated its virtual SAN SANsymphony product, adding OpenStack and Veeam support and making it go faster. The PSP1 update to v10 SANsymphony was introduced last November. Six months later, a PSP2 update introduces: Support for OpenStack Cinder (block storage server) New Virtual Desktop Services – highly available/ …
Chris Mellor, 29 May 2015

Kaminario gets triple vision with 3D 3-layer flash

Kaminario is joining Dell in the all-flash array (AFA) war with a capacity-rising and price-dropping K2 array using the same Samsung 3D TLC flash drives. The new, sixth generation – as we see it – K2, actually v5.5, offers an average price of under $1/GB usable, half that of the gen-5 product introduced in May 2014. Dell’s SC …
Chris Mellor, 20 Aug 2015

It's Friday. The pub is looming. IDC tells us 'bottoms up'. We'll drink to that headline

IDC has released a flash-based array study saying it's used a (and we quote) "bottoms-up approach." We'll raise a glass to that notion. The study, Worldwide All-Flash Array and Hybrid Flash Array 2014–2018 Forecast and 1H14 Vendor Shares, looks at revenues and raw terabytes shipped with flash-based arrays - all-flash arrays ( …
Chris Mellor, 16 Jan 2015

Google hits TurboFan button on Chrome's JavaScript engine

Google says its new optimizing compiler tech is gradually speeding up JavaScript execution in its Chrome browser – and it one day hopes it can rip out all the old compiler code and replace it with something better. The new optimizing compiler is known as TurboFan, and it has been shipping as a component of the V8 JavaScript …
Neil McAllister, 07 Jul 2015

Seagate pumps up EVault capabilities to enterprise level

Seagate has improved the punch and capacity of its EVault hybrid backup products, with 4X speed boost and 5X capacity enlargement. EVault hybrid backup uses on-premises appliances storing some data locally and sending the rest to a public cloud service; Seagate’s own or Azure in the USA with national service providers in EMEA …
Chris Mellor, 20 Jul 2015

Permabit builds shrink-your-SAN dedupe box

Permabit has built a front-end SAN box to dedupe and compress SAN data so it needs less disk capacity. The company produces Albireo deduplication and compression software, which it sells on an OEM basis. The idea is to enable disk array vendors to improve the cost/GB of their storage so that they can retain a cost advantage over …
Chris Mellor, 16 Sep 2014