Articles about Compression

Stradivarius violin reproduction

Violin Memory FINALLY writes dedupe and compression into its latest Concerto

Violin Memory has fixed a gaping hole in its data management feature set by adding deduplication and compression to its Concerto memory array controller product. This will cut its effective cost/GB figures to new lows, and strengthens its competitive hand against other all-flash array vendors – such as EMX XtremIO, IBM …
Chris Mellor, 19 Aug 2014

Intel demos real-time code compression for die shrinkage, power saving

Research@Intel Intel researchers have developed a way to make the increasingly tiny processors needed to power the impending "Internet of Things" even tinier: compress the code running on them. "We compress the code, make it smaller, and save area and power of integrated on-die memory," Intel Labs senior reseacher Sergey Kochuguev from ZAO …
Rik Myslewski, 25 Jun 2013

Google open sources very slow compression algorithm

Google has open sourced a new compression algorithm called Zopfli that it says is a slower-but-stronger data squasher than the likes of zlib. The product of Googler Lode Vandevenne's 20 per cent time, the day a week Google allows its staff to work on side projects, Zopfli is said to reduce files to sizes 3.7–8.3 per cent smaller …
Simon Sharwood, 01 Mar 2013
channel

Dell bulks up storage line – with compression product

Dell is launching its first Ocarina data compression product, an adjunct to its DX6000 object storage product line. The DX6000 products twin Dell hardware with OEM'd Caringo object storage software. The DX6000G server is a clusterable storage compression node that works with DX6000 storage. It uses software from Ocarina, a …
Chris Mellor, 12 Oct 2011
BPG compression demo

QEMU, FFMPEG guru unleashes JPEG-slaying graphics compressor

Noted software wizard Fabrice Bellard has devised a new raster image format that he says offers superior quality to JPEG at similar file sizes. Bellard – who is known for creating the QEMU virtualization hypervisor and the FFMPEG multimedia libraries, among other achievements – says the new format, called Better Portable …
Neil McAllister, 12 Dec 2014

IBM furtles all-flash biz bruiser FlashSystem

IBM has upped its all-flash array FlashSystem capacity to an effective 1.6PB by baking in SVC/Storwize features – including real-time compression. The FlashSystem V840 release 1.2 is built from three 2U rackmount boxes: an AE1 storage enclosure (as used in the 840) and two active-active AC1 control enclosures. The storage box …
Chris Mellor, 05 Aug 2014

Boffins find Jackie Chan's SUPERCOP is good for something

Blu-Ray might not be setting the world afire, but boffins have turned up a surprising upside of the technology that can be applied to solar PV manufacture. It turns out the pit-and-peak pattern that encodes a movie on the disk helps improve light absorption if reproduced on the surface of a solar cell. Published in Nature …
channel

Google open sources MapReduce compression

Google has open sourced the compression library used across its backend infrastructure, including MapReduce, its distributed number-crunching platform, and BigTable, its distributed database. Available at Google Code under an Apache 2.0 license, the library is called Snappy, but Google says this is the same library that was …
Cade Metz, 24 Mar 2011
hands waving dollar bills in the air

Teradata adds hardware compression to data warehouses

Teradata invented the data warehousing market and is not about to let Larry Ellison take it over without a fight. At this week's Partners Conference in San Diego, which is where Teradata Labs does the development of some of the hardware and software that goes into its various data warehousing appliances, the company is …
Fusion-io ioSgale 3.2TB card

MySQL daddy Monty talks up Fusion-io's data-stuffed flash

Fusion-io can cram more data into its ioMemory flash storage without cramping performance – at least that’s what it’s claiming about its NVM Compression technology. We are told NVM Compression is “a flash-aware interface that can double the useable capacity of ioMemory flash while eliminating the performance impact associated …
Chris Mellor, 02 Apr 2014
XtremIO upgrade video

No biggie: EMC's XtremIO firmware upgrade 'will wipe data'

There's a rumor that upgrading EMC's XtremIO firmware to v3.0 will wipe all user data from the flash array. It's mentioned here. It seems going from firmware version 2.4.x to version 3.0, expected by early October, will cause data to be lost – and customers will need to back everything up before the upgrade and restore it …
Chris Mellor, 15 Sep 2014
Road leading to the factory

Is this storage kit the best? It DEPENDS. Why is your face turning red?

Storagebod Storage marketing is one of maddest and craziest parts of the technology industry: there are so many claims that don’t necessarily stand up to scrutiny and pretty much all of them require the caveat: "It depends…" It is very important to understand that it really does depend on a number of factors. For example, when your flash …
StorageBod, 12 Jun 2014

Mozilla and Facebook snip a further five per cent from all JPEGs

Just four months after loosing the mozjpeg encoder on a waiting world, Mozilla has updated it to version 2.0, at the same time announcing that Facebook is testing the new iteration. The Social NetworkTM has also slung Mozilla $US60,000 towards the development effort in anticipation of mozjpeg 3.0. Mozjpeg, first released in …
SANblox

Permabit builds shrink-your-SAN dedupe box

Permabit has built a front-end SAN box to dedupe and compress SAN data so it needs less disk capacity. The company produces Albireo deduplication and compression software, which it sells on an OEM basis. The idea is to enable disk array vendors to improve the cost/GB of their storage so that they can retain a cost advantage over …
Chris Mellor, 16 Sep 2014

Permabit squeezes its Albireo dedupe fruit, offers juice to vendors

Permabit is still aiming to strike OEM gold from its dedupe technology and has added compression to its Albireo deduper, aiming to help disk array vendors compete better against the all-flash and hybrid array startups. The idea is to enable disk array vendors to offer reduction of primary data, generally unavailable currently, …
Chris Mellor, 27 Jun 2014
channel

HDS coy about future compression tech

Hitachi Data Systems doesn't have its own compression/deduplication technology but looks set to get it. Dell is buying Ocarina for such technology and HDS is the array supplier holdout, as competitors EMC, HP, IBM and NetApp each have their own technology for data reduction. What is HDS going to do? Senior executives are being …
Chris Mellor, 23 Jul 2010
Hadoop_elephant

Teradata gobbles up data squasher RainStor

Teradata has bought RainStor, the deduping database supplier and Hadoop convert. RainStor specializes in archiving and two years ago put its analytics engine and enterprise database on Hadoop, the Google-inspired big-data cruncher. Financial terms of the deal for the privately held RainStor were not revealed. Teradata called …
Gavin Clarke, 18 Dec 2014
Nyancoin logo

Exploit emerges for LZO algo hole

Security Mouse security researcher Don A Bailey has showcased an exploit of the Lempel-Ziv-Oberhumer (LZ0) compression algorithm running in the Mplayer2 media player and says it could leave some Linuxes vulnerable to attack. The LZO data compression algorithm was created by Markus Oberhumer in 1994 and was discovered to be …
Darren Pauli, 11 Jul 2014
channel

EMC gets busy with dedupe, compression code-base

EMC has been developing its own deduplication and compression code-base, entrusting the effort to a team code-named Viper. The story, as told by someone familiar with the events, starts with EMC acquiring Avamar in November 2006. In June 2009 it acquired DataDomain. At this point it had Avamar source deduplication, DataDomain …
Chris Mellor, 25 Jun 2010
Larry Ellison, photo by Oracle Corporate Communications

Explained: How LSI and Oracle cooked up magical flash-embiggening sauce

Oracle and LSI have magicked up a way for LSI’s Nytro server flash cards to hold more data than they’re seemingly physically capable of holding and called it Dynamic Logical Capacity (DLC). How does it work? We thought it might be a paging mechanism – but we were dead wrong. The card compresses the data it is sent and can reach …
Chris Mellor, 15 Jan 2014

Let Google's tentacles fondle your mobile's web downloads and Chrome will put the data on a diet

The latest version of Google's Chrome browser for handheld devices includes a data-compression feature that's designed to save customers money on their mobile bills, among other new bells and whistles. The compression comes disabled by default on Android and iOS, but can be activated by flipping a single switch in the browser's …
Neil McAllister, 16 Jan 2014
Larry Ellison

Ellison: Sparc M7 is Oracle's most important silicon EVER

OpenWorld During his OpenWorld keynote on Sunday, Oracle CEO CTO Larry Ellison took time out from talking up his company's cloud strategy to remind the audience that the database giant is in the hardware business, too – all the way down to the silicon. Many of Oracle's "engineered systems" are powered by Intel processors – and Intel …
Neil McAllister, 29 Sep 2014
EVO: RAIL

What the Dell? Big Mike and co join Nexenta for EVO: RAIL file access

Dell is using Nexenta's software to bring file access to VMware's EVO: RAIL virtual SAN. It is shipping NexentaConnect and NexentaStor software with its EVO: RAIL kit, its pre-configured, fully integrated, hyper-converged appliance. NexentaStor is Nexenta's ZFS-based storage software which runs on certified server/storage …
Chris Mellor, 15 Oct 2014
XtremIO array and 4 X-Brick nodes

EMC huffs, gives XtremIO a polish, shows off shiny data services

EMC's XtremIO all-flash array will benefit from new data services and models as the company spools up to take on Pure Storage, IBM and other flash array competitors. There is a new 5TB Starter X-Brick, lowering starter costs, and X-Brick clusters can scale out to six nodes with 12 active controllers. The Starter X-Brick can …
Chris Mellor, 08 Jul 2014
Gartner SSA CC Overall Scores

Gartner ranks upstart trio ahead of EMC, HP and IBM in battle for flash array dominance

Gartner’s thrilling solid-state appliance critical capabilities report ranks three startups ahead of EMC, HP and IBM: SolidFire, Pure Storage and Kaminario. This assessment is not reflected in Gartner's Magic Quadrant for solid-state arrays. While the MQ looks at a company’s overall ability to execute, and its vision, the …
Chris Mellor, 13 Sep 2014
IBM's Hursley partner centre: A shop window for datacentres

IBM keeps it real with Storwize V7000

Storagebod It has been very gratifying to see the IBM Storwize V7000 and SVC getting some real love from IBM over the past couple of years. The latest bunch of announcements are good: it'll be bigger and faster, says IBM, yet it presents this news with some realism. IBM's in-house storage blogger Barry Whyte is not one to try and pull the …
StorageBod, 14 May 2014

NetApp's running with the big dogs: All-flash FlashRay hits the street

NetApp’s all-new FlashRay solid state array has been launched with limited availability and is not yet ready for prime time, having only a single controller, and lacking scale-out features and some ONTAP integration. These will come with future product upgrades, allowing NetApp to harden and fine-tune the product with this …
Chris Mellor, 17 Sep 2014

Rejoice, Windows fans: Stable 64-bit Chromium drops for Win 7 and 8

Smoother video is on the way for fans of Google's Chrome browser on Windows 7 and 8. The Chromium development team has claimed delivery of a stable release of 64-bit Chrome for Microsoft’s platform. The news, announced on the Chromium blog, marks the successful of testing started in the Chrome dev and canary channels in June …
Gavin Clarke, 28 Aug 2014
Curiosity

NASA's Curiosity rover brought Earth BUG to Mars

A 20 year old bug has been discovered in an algorithm so pervasive it's used in the Mars Curiosity rover, cars, aircraft, Android phones and a string of popular open source wares. The bug can be found in the Lempel-Ziv-Oberhumer (LZO) data compression algorithm created by Markus Oberhumer, who on Wednesday posted a new version 2 …
Darren Pauli, 27 Jun 2014
Baseball

Would you rip'n'replace your IT for Simplivity kit? Upstart reckons so

Blocks and Files Simplivity makes scale-out converged server-storage Omnicubes, and you have to rip-and-replace your IT infrastructure to make the best use of them. This sounds like a hard sell, but many of its customers are doing just that as the startup heads towards a $200m run-rate. The company was founded in September 2009, and it spent …
Chris Mellor, 11 Aug 2014
IBM RTP Data Center

IBM leaps aboard the software-defined stuff bandwagon

IBM storage is getting software-defined, with IBM seeing that concept as a way of better integrating its storage hardware and software assets. Big Blue's Storage and Software-defined Systems general manager Jamie Thomas outlined a new storage deal at IBM's Enterprise event in Las Vegas, claiming the "new model will provide …
Chris Mellor, 09 Oct 2014
Bored girl

Hey, marketing drone, what's with the FUD - nothing GOOD to say about your own kit?

Storagebod Are we drifting into another round of the storage wars where FUD starts to fly? It always makes for good copy. The little guy complaining about the big guy, who in turn is complaining about the little guy: David with his sling versus Goliath with his rocket launcher. The thing with FUD is that it doesn’t really work unless there …
StorageBod, 01 May 2014
Hawk hits drone

SkyHawk array swoops down, 136TB claws extended

All-flash array startup and packing density expert Skyera has got itself a new version of its skyHawk array, encompassing a threefold increase in capacity. The first generation skyHawk was a 1U rack enclosure with 44TB of usable flash capacity inside it. Gen 2 skyHawk FS has 136TB (raw) and also delivers increases in data …
Chris Mellor, 30 Oct 2014

Tell it to me straight, vendors: Are you cheap and easy?

Is it easy? Is is cheap? These are pretty much the only two questions which interest me when talking to a vendor these days – after years of worrying about technology. Of course, if I was to produce an RFP document with simply those two questions, I’d probably be out of a job fairly swiftly. But those two questions are not …
StorageBod, 02 Apr 2014
DeLorean from Back to the Future 3

Your move, sucker! Microsoft tests cloud gaming system that cuts through network lag

Microsoft researchers have developed software that, they say, cuts through network delay issues in cloud gaming systems. The tech, dubbed "DeLorean", speculates what a gamer will do next, renders those frames and then pushes them out to the client "one entire RTT [round-trip delay time] ahead of time". Redmond's researchers …
Kelly Fiveash, 24 Aug 2014
The CUDOS silicon waveguide

Soliton makes its way across silicon in CUDOS experiment

On-chip photonic interconnects are a step closer, with a successful demonstration of soliton compression in silicon from Australia's CUDOS research centre. In a Nature Communications report, a team from CUDOS demonstrates that solitons can be both observed and harnessed in silicon-based photonic systems. Solitons in fibre optic …
Whitewater

NetApp buys SteelStore from Riverbed

NetApp has extricated Riverbed from some nasty Whitewater rapids that threatened to drag it under and pummel it on the rocks below. The big blue staple rode to the rescue by buying its SteelStore product line for U$80 million in cash. SteelStore is Riverbed's re-branded Whitewater cloud storage backup appliance technology. It …
Chris Mellor, 27 Oct 2014
FlashRay slide 1

NetApp FlashRay's OS is 'based on SANtricity' – analyst

A financial analyst suggests that NetApp's coming FlashRay all-flash array will not have a ground-up design operating system but will use the existing SANtricity O/S found in NetApp's EF540 and EF550 flash arrays. NetApp says he's completely wrong. FlashRay is a completely new all-flash design from NetApp designed to compete …
Chris Mellor, 13 Feb 2014
RFID_snail_trio

Tiny steps: HTTP 2.0 WG looks for consensus

The long-awaited HTTP 2.0 protocol has inched a step further towards completion, with the IETF issuing a last call on the two key documents of the spec, with comments to end on 1 September. The two drafts in question are the core HTTP 2.0 document, and the HPACK header compression format. It's been a long road to get to HTTP 2. …

Golden age of invention or hyped-up age of overblown marketing?

Storagebod blog Barely a day passes without receiving an announcement from some vendor or another. Every one is "revolutionary" and a massive step forward for the industry – or so they keep telling me. It would seem that we are living in a golden age of invention. Yet many conversations with peer end users generally end up with us feeling …
StorageBod, 13 Aug 2014
4 racks of V7000 boxes

Storwize embiggened: Nearly 4PB of raw capacity, croons IBM's Barry Whyte

IBM has substantially refreshed its SVC (SAN Volume Controller) and Storwize storage array products, providing doubled processing power, boosting compression power as well as increasing Storwize capacity to around 4PB, it claims. There are two detailed blogs about the new hardware and software: one from Master Inventor Barry …
Chris Mellor, 12 May 2014
Kaminario K-Blocks

Kaminario shovels RAM, shiny new processors onto K2's peaks

Kaminario has updated its K2 all-flash array with new processors, more RAM, higher capacity SSDs and data reduction technology, claiming K2 is more efficient, scalable and cost-effective than either EMC's XtremIO or Pure Storage's FA-400 all-flash arrays. The fourth generation K2 product topped the SPC-1 random IO and SPC-2 …
Chris Mellor, 20 May 2014
The Register breaking news

Google to buy video compression technology outfit On2

Google confirmed today that it plans to buy digital video compression outfit On2 Technologies in an all-stock agreement, valued at $106.5m. Mountain View said On2 shareholders will be handed 60 cents worth of Google class A common shares for each outstanding share they hold in the company. Clifton Park, New Jersey-based On2 …
Kelly Fiveash, 05 Aug 2009
cloud

Out of stealth, Saisei pitches IP flow controller

Year-old startup Saisei is putting forward an SDN management framework it reckons can free up as much as half of the network performance that now gets sucked up by various overheads. The outfit's FlowCommand network performance enforcement (NPE) software is designed to take IP packet queuing and scheduling out of the performance …
Storage disks, photo: Gavin Clarke

Like condoms, data now comes in big and HUGE sizes

If condoms were made in a range of different sizes, the old joke goes, the options would be “huge”, “gigantic” and “enormous”. We mention the joke in reference to The Linux Foundation's decision to create a new conference, called “Vault”, to “... bring together the world’s leading developers in filesystems and storage in the …
Simon Sharwood, 29 Aug 2014
The Register breaking news

Now your iPhone apps can be FAT losers: Apple gobbles data diet upstart

Apple has picked up AlgoTrim, a Swedish upstart that knocks together tools for quickly decompressing apps, photos, videos and other stuff on mobile phones. As well as image squeezing, AlgoTrim touts a code compression library that crams software into the flash memory of ARM-powered devices, possibly reducing the size of programs …
Tegile_all_flash_array

Array with you: Hybrid upstart Tegile kicks out new flashers

Tegile has continued encroaching into all-flash array territory with two new products, and is attacking Pure Storage's FA-450 product directly in its market positioning. The T3600 and T3700 models fit above and below the existing T3400, with all three below the T3800. Overall the T3000s function as performance-focused …
Chris Mellor, 07 Nov 2014
CS400

Nimble is as Nimble does: Mutant runs 'just like flash-only' gear

Nimble has boosted the performance of its hybrid flash and disk arrays with a CS700 model and all-flash expansion shelf. Nimble’s arrays provide disk-based capacity with flash used as a cache to accelerate data access. It claims that it now “provides the performance of flash-only arrays and the capacity of hybrid arrays” because …
Chris Mellor, 12 Jun 2014
Oracle FS1

Oracle crashes all-flash bash: Behold, our hybrid FS1 arrays

Welcome back to SAN array land, Oracle. Larry Ellison's company has reinvented its Pillar Axiom 600 SAN array as a hybrid flash/disk array, the FS1-2, with auto-tiering and noisy neighbours sorted. It is a general-purpose hybrid array but tuned for Oracle software. Calling its new storage box the Flash Storage System (FS1), the …
Chris Mellor, 30 Sep 2014
LTO Generations

No TKO for LTO: Tape format spawns another 2 generations, sports 120TB bigness

The LTO consortium has added two more generations to its tape format roadmap, extending it out to LTO-10 and a 120TB compressed capacity. The roadmap used to finish at LTO-8, and that version of the LTO tape format future was announced in April 2010. Now, four-and-a-half years later, it has been extended again. LTO Generations …
Chris Mellor, 11 Sep 2014