Articles about Compression

Stradivarius violin reproduction

Violin Memory FINALLY writes dedupe and compression into its latest Concerto

Violin Memory has fixed a gaping hole in its data management feature set by adding deduplication and compression to its Concerto memory array controller product. This will cut its effective cost/GB figures to new lows, and strengthens its competitive hand against other all-flash array vendors – such as EMX XtremIO, IBM …
Chris Mellor, 19 Aug 2014

Intel demos real-time code compression for die shrinkage, power saving

Research@Intel Intel researchers have developed a way to make the increasingly tiny processors needed to power the impending "Internet of Things" even tinier: compress the code running on them. "We compress the code, make it smaller, and save area and power of integrated on-die memory," Intel Labs senior reseacher Sergey Kochuguev from ZAO …
Rik Myslewski, 25 Jun 2013

Google open sources very slow compression algorithm

Google has open sourced a new compression algorithm called Zopfli that it says is a slower-but-stronger data squasher than the likes of zlib. The product of Googler Lode Vandevenne's 20 per cent time, the day a week Google allows its staff to work on side projects, Zopfli is said to reduce files to sizes 3.7–8.3 per cent smaller …
Simon Sharwood, 01 Mar 2013
linux_tux_cloud_648

Does Linux need a new file system? Ex-Google engineer thinks so

Former Googler Kent Overstreet has announced that a long-term project to craft a new Linux file system is at a point where he'd like other developers to pitch in. Since you're already asking why bother with a new file system, the answer Overstreet provides in this post to the kernel mailing list is that he wants to “match ext4 …
Computer with dead bug, Stacy Brunner CC2 license

SAP crypto offers customers choice of remote code execution or denial of service

Yet another proprietary implementation of a popular protocol has turned up unexpected vulnerabilities, with SAP's data compression software open to remote code execution and denial-of-service exploits. The implementation in question is SAP's code running the popular LZC and LZH compression algorithms. As outlined over at Full …

IETF updates TLS/SSL best practice guidance

Do: start rolling TLS 1.3, support TLS 1.2, and DTLS 1.2. Don't: negotiate sessions using TLS 1, TLS 1.1, SSL 2 or SSL 3. Those are the Internet Engineering Task Force's latest recommendations, set out in RFC 7525, Recommendations for Secure Use of Transport Layer Security (TLS) and Datagram Transport Layer Security (DTLS). The …
Boxing_gloves

SolidFire pulls off gloves for unholy storage ding-dong. Ding-ding!

Punchy all-flash array startup SolidFire has taken the gloves off in its competition with EMC, NetApp and Pure Storage by releasing competitive architectural comparisons singling out weaknesses in their products. You can get comparison docs vs NetApp all-flash FAS, EMC’s XtremIO and Pure Storage’s FlashArray by filling in …
Chris Mellor, 06 Jul 2015
PernixData FCP

PernixData RAMs in yet more speed to FVP

PernixData, the clusterable VMware IO cacher, has added compression to its RAM caching, meaning more effective data in RAM and more caching with its FVP software. V2.5 FVP has Distributed Fault-Tolerant Memory with LZ4 compression algorithms (DFTM-Z). These algorithms are fast and lossless and DFTM-Z checks data to see if it …
Chris Mellor, 25 Feb 2015
channel

Dell bulks up storage line – with compression product

Dell is launching its first Ocarina data compression product, an adjunct to its DX6000 object storage product line. The DX6000 products twin Dell hardware with OEM'd Caringo object storage software. The DX6000G server is a clusterable storage compression node that works with DX6000 storage. It uses software from Ocarina, a …
Chris Mellor, 12 Oct 2011
A Handful of Giant Weta by Mike Locke

Linux Foundation serves up a tasty dish of BUGS

The Linux Foundation's Core Infrastructure Initiative has completed its first-pass survey of the Linux toolset, and is highlighting which tools are most at risk. While there's lots of attention on high-profile packages like crypto tools, web servers and mail agents, there's also a lot of packages that everyone uses and nobody …
Fujitsu TR800

Diamonds are forever, Fujitsu Eternus now for VDI

Fujitsu has added a bunch of new variants to its Eternus TR storage arrays, targeting large scale desktop virtualisation environments. The models are the Eternus TR820, TR850 and TR880, with the last in the list claiming the ability to connect 3,500 VMs, which the company says is nearly double the scale of its previous models. …
Team Register, 20 Jan 2015
Spinning_tops

Delphix gets a pat on the back in Gartner's latest tea leaves reading

Data virtualiser Delphix has had a Gartner boost by appearing in the leaders’ box of its Magic Quadrant report for Structured Data Archiving and Application Retirement. Delphix_MQ_chart Fellow data virtualiser Actifio was also placed in the MQ, as a niche player. The other four leaders are IBM, HP, Informatica and Solis …
Chris Mellor, 24 Jun 2015
channel

Google open sources MapReduce compression

Google has open sourced the compression library used across its backend infrastructure, including MapReduce, its distributed number-crunching platform, and BigTable, its distributed database. Available at Google Code under an Apache 2.0 license, the library is called Snappy, but Google says this is the same library that was …
Cade Metz, 24 Mar 2011
Exablox node stack

Exablox is pretty sweet - but not great for restore applications

Comment One of the best places to find business storage products reviewed is Storage Review, which has just reviewed the Exablox NAS-headed object storage system for small and medium businesses. We wrote about Exablox and its RAID-less, deduping, highly scalable OneBlox technology here, saying the product looks like an Isilon cluster on …
Chris Mellor, 13 Feb 2015
DRagon

Permabit OEM deal de-stealths Chinese all-flash array maker

Permabit says it has a new Albireo dedupe software OEM, and in so doing has revealed a brand new all-flash array vendor, this one from China. Sihua Technologies is an iCDN content delivery and NeuStor cloud storage product provider to the Chinese market. It is based in Shanghai and Hangzhou, with an office in Cupertino. Sihua …
Chris Mellor, 02 Apr 2015
hands waving dollar bills in the air

Teradata adds hardware compression to data warehouses

Teradata invented the data warehousing market and is not about to let Larry Ellison take it over without a fight. At this week's Partners Conference in San Diego, which is where Teradata Labs does the development of some of the hardware and software that goes into its various data warehousing appliances, the company is …

50 shades of grey can turn Adobe Reader into a hot mess

Hackers can duck antivirus programs and execute malware in Adobe Reader by using greyscale images, says Danish security boffin Dénes Óvári. Lossy compression is thought to be susceptible to the DCTDecode filter, which should nuke malware woven into images and blunt this form of attack. However new intelligence published in the …
Darren Pauli, 03 Mar 2015
Jet boat on sydney harbour

Join The Reg and SimpiVity for high-speed HYPER-LUNCH

Video Hyperconverged server vendor SimpliVity does the “lots of VMs, spun up fast, in a single box, with impressive scaling” thing. But the company also packs all of the infrastructure and functions below the hypervisor into its wares. So you also get WAN optimisation, data compression and de-duplication, a cloud gateway and more …
Nexenta_logos

Nexenta flies over the Edge into the object storage bearpit

Nexenta's hypercale block and object storage software has hit the streets, pitting Nexenta competitively against all the other object storage suppliers. NexentaEdge was introduced last August and now it's generally available, two quarters later than its then-schedule. We're having it described as "the first software-only scale …
Chris Mellor, 20 May 2015
CN72/73xx Block Diagram

Cavium adds 4/16 core SoCs

Cavium is filling out a scale gap in its Octeon III system-on-a-chip (SoC) range with he four-to-sixteen core CN72xx and CN73xx variants that are pin-compatible with the rest of the range. The MIPS64-based SoCs are low-power network processors pitched between the one-to-four core CN71xx and the 24-48 CN78xx range. The chips can …
Google Photo

Google spins up 'FREE, unlimited' cloud photo storage 4 years before ad giant nixes it

Google I/O Google has wheeled out a cloud-hosted photo storage service that, it hopes, will mean that embarrassing images from your past can be organized by computers so you don't have to. Youtube video The photo album software, available on Android and iOS from Thursday, slurps up all the photos on your mobile, and uploads them to a …
Iain Thomson, 29 May 2015

IBM furtles all-flash biz bruiser FlashSystem

IBM has upped its all-flash array FlashSystem capacity to an effective 1.6PB by baking in SVC/Storwize features – including real-time compression. The FlashSystem V840 release 1.2 is built from three 2U rackmount boxes: an AE1 storage enclosure (as used in the 840) and two active-active AC1 control enclosures. The storage box …
Chris Mellor, 05 Aug 2014
channel

HDS coy about future compression tech

Hitachi Data Systems doesn't have its own compression/deduplication technology but looks set to get it. Dell is buying Ocarina for such technology and HDS is the array supplier holdout, as competitors EMC, HP, IBM and NetApp each have their own technology for data reduction. What is HDS going to do? Senior executives are being …
Chris Mellor, 23 Jul 2010
backdoor_648

Unhinged Linux backdoor still poses a nuisance, if not a threat

Internet Igors have stitched together a new Linux backdoor. Fortunately for internet hygiene the botnet agent – which packs a variety of powerful features – is faulty and only partially functional. The backdoor, dubbed Dklkt-1 was designed to be a cross-platform nasty capable of infecting both Windows and Linux machines. …
John Leyden, 27 Jul 2015

Silicon Valley, episode 8: Larping, mogging and losing its way

Recap The first season of HBO's sharp, satirical Silicon Valley had just eight episodes. By the measure of last night's show, they should have stuck to that for season two rather than try to punch in an extra two episodes. White Hat/Black Hat felt like the episode pulled together from rejected ideas. And there weren't that many, so we …
Kieren McCarthy, 01 Jun 2015
BPG compression demo

QEMU, FFMPEG guru unleashes JPEG-slaying graphics compressor

Noted software wizard Fabrice Bellard has devised a new raster image format that he says offers superior quality to JPEG at similar file sizes. Bellard – who is known for creating the QEMU virtualization hypervisor and the FFMPEG multimedia libraries, among other achievements – says the new format, called Better Portable …
Neil McAllister, 12 Dec 2014
channel

EMC gets busy with dedupe, compression code-base

EMC has been developing its own deduplication and compression code-base, entrusting the effort to a team code-named Viper. The story, as told by someone familiar with the events, starts with EMC acquiring Avamar in November 2006. In June 2009 it acquired DataDomain. At this point it had Avamar source deduplication, DataDomain …
Chris Mellor, 25 Jun 2010
PS6610

Drama in the dingly Dell as it embiggens its data centre range

Dell has dug a deeper bottom level for its SC Compellent arrays and piled up a new peak for its PS series EqualLogic arrays, expanding and enhancing both product ranges while still having an overall convergence strategy. SCv2000 SCv2000 In your mental landscape, place Dell SC (Compellent) arrays as the enterprise multi- …
Chris Mellor, 08 May 2015

Boffins find Jackie Chan's SUPERCOP is good for something

Blu-Ray might not be setting the world afire, but boffins have turned up a surprising upside of the technology that can be applied to solar PV manufacture. It turns out the pit-and-peak pattern that encodes a movie on the disk helps improve light absorption if reproduced on the surface of a solar cell. Published in Nature …
Fusion-io ioSgale 3.2TB card

MySQL daddy Monty talks up Fusion-io's data-stuffed flash

Fusion-io can cram more data into its ioMemory flash storage without cramping performance – at least that’s what it’s claiming about its NVM Compression technology. We are told NVM Compression is “a flash-aware interface that can double the useable capacity of ioMemory flash while eliminating the performance impact associated …
Chris Mellor, 02 Apr 2014
A hammer and bent screw

Cisco hands license-busting troll-hammer to THOR

Cisco is sick of the state of patent licensing for video codecs, so has decided to set a royalty-free of its own loose on the world. The Borg's problem is twofold: on the one hand, the licensing pools for H.264 fail to represent many of the participants in the industry; on the other, the successor, H.265, can be vastly more …
XtremIO upgrade video

No biggie: EMC's XtremIO firmware upgrade 'will wipe data'

There's a rumor that upgrading EMC's XtremIO firmware to v3.0 will wipe all user data from the flash array. It's mentioned here. It seems going from firmware version 2.4.x to version 3.0, expected by early October, will cause data to be lost – and customers will need to back everything up before the upgrade and restore it …
Chris Mellor, 15 Sep 2014
Railway line split. Pic: Ian Sane

VMware doubles the VM count for EVO: RAIL systems

VMware has pumped up the power of its hyper-converged EVO: RAIL nodes with more memory and storage, so they can run twice as many VMs. As detailed in a VMware blog, the latest node options look like this: Dual 6, 8, 10 or 12 core Intel Haswell or Ivy Bridge CPUs per node 128GB to 512GB of memory per node, up from 192GB VMware …
Chris Mellor, 17 Jun 2015
gavel_judgment_channel

Adobe and software pals haul Forever 21 to court over piracy allegations

A trio of software firms is taking a large US-based fashion retailer to court for allegedly pirating their software. Adobe, Autodesk and Corel claim that clothes bazaar Forever 21 infringed their copyright by illegally copying a raft of well-known software tools and not paying license fees. Forever 21 is a $3.8bn retailer with …
Gavin Clarke, 02 Feb 2015
Road leading to the factory

Is this storage kit the best? It DEPENDS. Why is your face turning red?

Storagebod Storage marketing is one of maddest and craziest parts of the technology industry: there are so many claims that don’t necessarily stand up to scrutiny and pretty much all of them require the caveat: "It depends…" It is very important to understand that it really does depend on a number of factors. For example, when your flash …
StorageBod, 12 Jun 2014
Datacore CEO George Teixeira and chairman Ziya Aral

DataCore conducts its SANsymphony a little more... allegro

DataCore has updated its virtual SAN SANsymphony product, adding OpenStack and Veeam support and making it go faster. The PSP1 update to v10 SANsymphony was introduced last November. Six months later, a PSP2 update introduces: Support for OpenStack Cinder (block storage server) New Virtual Desktop Services – highly available/ …
Chris Mellor, 29 May 2015
K2s

Kaminario gets triple vision with 3D 3-layer flash

Kaminario is joining Dell in the all-flash array (AFA) war with a capacity-rising and price-dropping K2 array using the same Samsung 3D TLC flash drives. The new, sixth generation – as we see it – K2, actually v5.5, offers an average price of under $1/GB usable, half that of the gen-5 product introduced in May 2014. Dell’s SC …
Chris Mellor, 20 Aug 2015

Mozilla and Facebook snip a further five per cent from all JPEGs

Just four months after loosing the mozjpeg encoder on a waiting world, Mozilla has updated it to version 2.0, at the same time announcing that Facebook is testing the new iteration. The Social NetworkTM has also slung Mozilla $US60,000 towards the development effort in anticipation of mozjpeg 3.0. Mozjpeg, first released in …

Google hits TurboFan button on Chrome's JavaScript engine

Google says its new optimizing compiler tech is gradually speeding up JavaScript execution in its Chrome browser – and it one day hopes it can rip out all the old compiler code and replace it with something better. The new optimizing compiler is known as TurboFan, and it has been shipping as a component of the V8 JavaScript …
Neil McAllister, 07 Jul 2015
Racecar

Seagate pumps up EVault capabilities to enterprise level

Seagate has improved the punch and capacity of its EVault hybrid backup products, with 4X speed boost and 5X capacity enlargement. EVault hybrid backup uses on-premises appliances storing some data locally and sending the rest to a public cloud service; Seagate’s own or Azure in the USA with national service providers in EMEA …
Chris Mellor, 20 Jul 2015

It's Friday. The pub is looming. IDC tells us 'bottoms up'. We'll drink to that headline

IDC has released a flash-based array study saying it's used a (and we quote) "bottoms-up approach." We'll raise a glass to that notion. The study, Worldwide All-Flash Array and Hybrid Flash Array 2014–2018 Forecast and 1H14 Vendor Shares, looks at revenues and raw terabytes shipped with flash-based arrays - all-flash arrays ( …
Chris Mellor, 16 Jan 2015
HTTP/2 flow diagram

HTTP/2 spec gets green light: Faster web or needless complexity?

The Internet Engineering Steering Group (IESG) has approved the specifications for HTTP/2 and HPACK (a compression format for HTTP/2 header fields), says working group chair Mark Nottingham. HTTP/2 is based on SPDY, a Google-developed protocol designed to speed up web page loading by compressing the content and reducing the …
Tim Anderson, 18 Feb 2015
iglu_blaze

X-IO erects its iglu over the data management market

X-IO, the supplier of just-won't-fail ISE storage boxes, has added a data management services head unit which can support up to 11 ISE blocks, calling it an iglu. ISE, the Integrated Storage Elements, come in disk (100 and 200), all-flash (800) and hybrid flash/disk (700) variants, have a five-year sealed box warranty and …
Chris Mellor, 28 Jul 2015
SANblox

Permabit builds shrink-your-SAN dedupe box

Permabit has built a front-end SAN box to dedupe and compress SAN data so it needs less disk capacity. The company produces Albireo deduplication and compression software, which it sells on an OEM basis. The idea is to enable disk array vendors to improve the cost/GB of their storage so that they can retain a cost advantage over …
Chris Mellor, 16 Sep 2014

SimpliVity opens its doors to KVM, OpenStack

Hyper-converged infrastructure company SimpliVity has announced it now supports the KVM hypervisor and OpenStack. SimpliVity's schtick is that everything below the hypervisor – especially data compression and de-duplication for back-up, networking and cloud-tiering storage – should be handled by a hyper-converged appliance. It …
Simon Sharwood, 20 May 2015

NetApp cackles as cheaper FlashRay lurches out of the door

FlashRay lives! All-flash FAS is now a price/performance beast – which now comes with a substantial price cut. NetApp is doubling down on its 3-product all-flash arrays; the EF Series, All-Flash FAS (AFF) and FlashRay with its Mars operating system. Yes, FlashRay lives and has not been gobbled up and absorbed into the FAS …
Chris Mellor, 23 Jun 2015
udp_7000_648

Arcserve boxes clever, takes back-up appliance down a price division

CA spin-out Arcserve has an updated back-up appliance for the mid-market that should be faster, easier, better-priced and more capable. It says the UDP 7000 Appliance is for small, medium and mid-market customers, and is a simple yet powerful all-in-one product. UDP stands for Unified Data Protection and the appliance features …
Chris Mellor, 20 May 2015
road_narrows_648

Lenovo and SimpliVity cozy up for a hyperconverged push

SimpliVity has announced a partnership with Lenovo, adding yet another tier-1 vendor online who can supply hyperconverged server nodes with SimpliVity's hardware-accelerated deduplication and compression secret sauce. Since acquiring IBM's server business, Lenovo has been going from strength to strength, building a portfolio …
Trevor Pott, 19 Aug 2015

Permabit squeezes its Albireo dedupe fruit, offers juice to vendors

Permabit is still aiming to strike OEM gold from its dedupe technology and has added compression to its Albireo deduper, aiming to help disk array vendors compete better against the all-flash and hybrid array startups. The idea is to enable disk array vendors to offer reduction of primary data, generally unavailable currently, …
Chris Mellor, 27 Jun 2014
Micron 128-gigabit multi-level cell NAND Flash memory device

Let's talk about the (real) price of flash and spinning disks

Comment Lately I have been writing a lot about the role of flash memory and disk drives in the future of storage infrastructure (here and here are a couple of examples). And it's clear flash will be used for primary workloads, and object storage and disks for the rest. The reality is that flash memory is quickly becoming already a no- …