Feeds

Articles about Compression

Stradivarius violin reproduction

Violin Memory FINALLY writes dedupe and compression into its latest Concerto

Violin Memory has fixed a gaping hole in its data management feature set by adding deduplication and compression to its Concerto memory array controller product. This will cut its effective cost/GB figures to new lows, and strengthens its competitive hand against other all-flash array vendors – such as EMX XtremIO, IBM …
Chris Mellor, 19 Aug 2014

Intel demos real-time code compression for die shrinkage, power saving

Intel researchers have developed a way to make the increasingly tiny processors needed to power the impending "Internet of Things" even tinier: compress the code running on them. "We compress the code, make it smaller, and save area and power of integrated on-die memory," Intel Labs senior reseacher Sergey Kochuguev from ZAO …
Rik Myslewski, 25 Jun 2013

Google open sources very slow compression algorithm

Google has open sourced a new compression algorithm called Zopfli that it says is a slower-but-stronger data squasher than the likes of zlib. The product of Googler Lode Vandevenne's 20 per cent time, the day a week Google allows its staff to work on side projects, Zopfli is said to reduce files to sizes 3.7–8.3 per cent smaller …
Simon Sharwood, 01 Mar 2013

IBM furtles all-flash biz bruiser FlashSystem

IBM has upped its all-flash array FlashSystem capacity to an effective 1.6PB by baking in SVC/Storwize features – including real-time compression. The FlashSystem V840 release 1.2 is built from three 2U rackmount boxes: an AE1 storage enclosure (as used in the 840) and two active-active AC1 control enclosures. The storage box …
Chris Mellor, 05 Aug 2014
channel

Dell bulks up storage line – with compression product

Dell is launching its first Ocarina data compression product, an adjunct to its DX6000 object storage product line. The DX6000 products twin Dell hardware with OEM'd Caringo object storage software. The DX6000G server is a clusterable storage compression node that works with DX6000 storage. It uses software from Ocarina, a …
Chris Mellor, 12 Oct 2011
XtremIO upgrade video

No biggie: EMC's XtremIO firmware upgrade 'will wipe data'

There's a rumor that upgrading EMC's XtremIO firmware to v3.0 will wipe all user data from the flash array. It's mentioned here. It seems going from firmware version 2.4.x to version 3.0, expected by early October, will cause data to be lost – and customers will need to back everything up before the upgrade and restore it …
Chris Mellor, 15 Sep 2014
Fusion-io ioSgale 3.2TB card

MySQL daddy Monty talks up Fusion-io's data-stuffed flash

Fusion-io can cram more data into its ioMemory flash storage without cramping performance – at least that’s what it’s claiming about its NVM Compression technology. We are told NVM Compression is “a flash-aware interface that can double the useable capacity of ioMemory flash while eliminating the performance impact associated …
Chris Mellor, 02 Apr 2014
hands waving dollar bills in the air

Teradata adds hardware compression to data warehouses

Teradata invented the data warehousing market and is not about to let Larry Ellison take it over without a fight. At this week's Partners Conference in San Diego, which is where Teradata Labs does the development of some of the hardware and software that goes into its various data warehousing appliances, the company is …
channel

Google open sources MapReduce compression

Google has open sourced the compression library used across its backend infrastructure, including MapReduce, its distributed number-crunching platform, and BigTable, its distributed database. Available at Google Code under an Apache 2.0 license, the library is called Snappy, but Google says this is the same library that was …
Cade Metz, 24 Mar 2011

Mozilla and Facebook snip a further five per cent from all JPEGs

Just four months after loosing the mozjpeg encoder on a waiting world, Mozilla has updated it to version 2.0, at the same time announcing that Facebook is testing the new iteration. The Social NetworkTM has also slung Mozilla $US60,000 towards the development effort in anticipation of mozjpeg 3.0. Mozjpeg, first released in …
Road leading to the factory

Is this storage kit the best? It DEPENDS. Why is your face turning red?

Storage marketing is one of maddest and craziest parts of the technology industry: there are so many claims that don’t necessarily stand up to scrutiny and pretty much all of them require the caveat: "It depends…" It is very important to understand that it really does depend on a number of factors. For example, when your flash …
StorageBod, 12 Jun 2014
SANblox

Permabit builds shrink-your-SAN dedupe box

Permabit has built a front-end SAN box to dedupe and compress SAN data so it needs less disk capacity. The company produces Albireo deduplication and compression software, which it sells on an OEM basis. The idea is to enable disk array vendors to improve the cost/GB of their storage so that they can retain a cost advantage over …
Chris Mellor, 16 Sep 2014

Permabit squeezes its Albireo dedupe fruit, offers juice to vendors

Permabit is still aiming to strike OEM gold from its dedupe technology and has added compression to its Albireo deduper, aiming to help disk array vendors compete better against the all-flash and hybrid array startups. The idea is to enable disk array vendors to offer reduction of primary data, generally unavailable currently, …
Chris Mellor, 27 Jun 2014
Nyancoin logo

Exploit emerges for LZO algo hole

Security Mouse security researcher Don A Bailey has showcased an exploit of the Lempel-Ziv-Oberhumer (LZ0) compression algorithm running in the Mplayer2 media player and says it could leave some Linuxes vulnerable to attack. The LZO data compression algorithm was created by Markus Oberhumer in 1994 and was discovered to be …
Darren Pauli, 11 Jul 2014
Larry Ellison, photo by Oracle Corporate Communications

Explained: How LSI and Oracle cooked up magical flash-embiggening sauce

Oracle and LSI have magicked up a way for LSI’s Nytro server flash cards to hold more data than they’re seemingly physically capable of holding and called it Dynamic Logical Capacity (DLC). How does it work? We thought it might be a paging mechanism – but we were dead wrong. The card compresses the data it is sent and can reach …
Chris Mellor, 15 Jan 2014
channel

HDS coy about future compression tech

Hitachi Data Systems doesn't have its own compression/deduplication technology but looks set to get it. Dell is buying Ocarina for such technology and HDS is the array supplier holdout, as competitors EMC, HP, IBM and NetApp each have their own technology for data reduction. What is HDS going to do? Senior executives are being …
Chris Mellor, 23 Jul 2010
channel

EMC gets busy with dedupe, compression code-base

EMC has been developing its own deduplication and compression code-base, entrusting the effort to a team code-named Viper. The story, as told by someone familiar with the events, starts with EMC acquiring Avamar in November 2006. In June 2009 it acquired DataDomain. At this point it had Avamar source deduplication, DataDomain …
Chris Mellor, 25 Jun 2010

Let Google's tentacles fondle your mobile's web downloads and Chrome will put the data on a diet

The latest version of Google's Chrome browser for handheld devices includes a data-compression feature that's designed to save customers money on their mobile bills, among other new bells and whistles. The compression comes disabled by default on Android and iOS, but can be activated by flipping a single switch in the browser's …
Neil McAllister, 16 Jan 2014
XtremIO array and 4 X-Brick nodes

EMC huffs, gives XtremIO a polish, shows off shiny data services

EMC's XtremIO all-flash array will benefit from new data services and models as the company spools up to take on Pure Storage, IBM and other flash array competitors. There is a new 5TB Starter X-Brick, lowering starter costs, and X-Brick clusters can scale out to six nodes with 12 active controllers. The Starter X-Brick can …
Chris Mellor, 08 Jul 2014
Gartner SSA CC Overall Scores

Gartner ranks upstart trio ahead of EMC, HP and IBM in battle for flash array dominance

Gartner’s thrilling solid-state appliance critical capabilities report ranks three startups ahead of EMC, HP and IBM: SolidFire, Pure Storage and Kaminario. This assessment is not reflected in Gartner's Magic Quadrant for solid-state arrays. While the MQ looks at a company’s overall ability to execute, and its vision, the …
Chris Mellor, 13 Sep 2014
IBM's Hursley partner centre: A shop window for datacentres

IBM keeps it real with Storwize V7000

It has been very gratifying to see the IBM Storwize V7000 and SVC getting some real love from IBM over the past couple of years. The latest bunch of announcements are good: it'll be bigger and faster, says IBM, yet it presents this news with some realism. IBM's in-house storage blogger Barry Whyte is not one to try and pull the …
StorageBod, 14 May 2014

NetApp's running with the big dogs: All-flash FlashRay hits the street

NetApp’s all-new FlashRay solid state array has been launched with limited availability and is not yet ready for prime time, having only a single controller, and lacking scale-out features and some ONTAP integration. These will come with future product upgrades and NetApp can harden the and fine-tune the product with this …
Chris Mellor, 17 Sep 2014

Rejoice, Windows fans: Stable 64-bit Chromium drops for Win 7 and 8

Smoother video is on the way for fans of Google's Chrome browser on Windows 7 and 8. The Chromium development team has claimed delivery of a stable release of 64-bit Chrome for Microsoft’s platform. The news, announced on the Chromium blog, marks the successful of testing started in the Chrome dev and canary channels in June …
Gavin Clarke, 28 Aug 2014
Curiosity

NASA's Curiosity rover brought Earth BUG to Mars

A 20 year old bug has been discovered in an algorithm so pervasive it's used in the Mars Curiosity rover, cars, aircraft, Android phones and a string of popular open source wares. The bug can be found in the Lempel-Ziv-Oberhumer (LZO) data compression algorithm created by Markus Oberhumer, who on Wednesday posted a new version 2 …
Darren Pauli, 27 Jun 2014
Baseball

Would you rip'n'replace your IT for Simplivity kit? Upstart reckons so

Simplivity makes scale-out converged server-storage Omnicubes, and you have to rip-and-replace your IT infrastructure to make the best use of them. This sounds like a hard sell, but many of its customers are doing just that as the startup heads towards a $200m run-rate. The company was founded in September 2009, and it spent …
Chris Mellor, 11 Aug 2014
Bored girl

Hey, marketing drone, what's with the FUD - nothing GOOD to say about your own kit?

Are we drifting into another round of the storage wars where FUD starts to fly? It always makes for good copy. The little guy complaining about the big guy, who in turn is complaining about the little guy: David with his sling versus Goliath with his rocket launcher. The thing with FUD is that it doesn’t really work unless there …
StorageBod, 01 May 2014
DeLorean from Back to the Future 3

Your move, sucker! Microsoft tests cloud gaming system that cuts through network lag

Microsoft researchers have developed software that, they say, cuts through network delay issues in cloud gaming systems. The tech, dubbed "DeLorean", speculates what a gamer will do next, renders those frames and then pushes them out to the client "one entire RTT [round-trip delay time] ahead of time". Redmond's researchers …
Kelly Fiveash, 24 Aug 2014

Tell it to me straight, vendors: Are you cheap and easy?

Is it easy? Is is cheap? These are pretty much the only two questions which interest me when talking to a vendor these days – after years of worrying about technology. Of course, if I was to produce an RFP document with simply those two questions, I’d probably be out of a job fairly swiftly. But those two questions are not …
StorageBod, 02 Apr 2014
The CUDOS silicon waveguide

Soliton makes its way across silicon in CUDOS experiment

On-chip photonic interconnects are a step closer, with a successful demonstration of soliton compression in silicon from Australia's CUDOS research centre. In a Nature Communications report, a team from CUDOS demonstrates that solitons can be both observed and harnessed in silicon-based photonic systems. Solitons in fibre optic …
RFID_snail_trio

Tiny steps: HTTP 2.0 WG looks for consensus

The long-awaited HTTP 2.0 protocol has inched a step further towards completion, with the IETF issuing a last call on the two key documents of the spec, with comments to end on 1 September. The two drafts in question are the core HTTP 2.0 document, and the HPACK header compression format. It's been a long road to get to HTTP 2. …
FlashRay slide 1

NetApp FlashRay's OS is 'based on SANtricity' – analyst

A financial analyst suggests that NetApp's coming FlashRay all-flash array will not have a ground-up design operating system but will use the existing SANtricity O/S found in NetApp's EF540 and EF550 flash arrays. NetApp says he's completely wrong. FlashRay is a completely new all-flash design from NetApp designed to compete …
Chris Mellor, 13 Feb 2014

Golden age of invention or hyped-up age of overblown marketing?

Barely a day passes without receiving an announcement from some vendor or another. Every one is "revolutionary" and a massive step forward for the industry – or so they keep telling me. It would seem that we are living in a golden age of invention. Yet many conversations with peer end users generally end up with us feeling …
StorageBod, 13 Aug 2014
4 racks of V7000 boxes

Storwize embiggened: Nearly 4PB of raw capacity, croons IBM's Barry Whyte

IBM has substantially refreshed its SVC (SAN Volume Controller) and Storwize storage array products, providing doubled processing power, boosting compression power as well as increasing Storwize capacity to around 4PB, it claims. There are two detailed blogs about the new hardware and software: one from Master Inventor Barry …
Chris Mellor, 12 May 2014
Kaminario K-Blocks

Kaminario shovels RAM, shiny new processors onto K2's peaks

Kaminario has updated its K2 all-flash array with new processors, more RAM, higher capacity SSDs and data reduction technology, claiming K2 is more efficient, scalable and cost-effective than either EMC's XtremIO or Pure Storage's FA-400 all-flash arrays. The fourth generation K2 product topped the SPC-1 random IO and SPC-2 …
Chris Mellor, 20 May 2014
Storage disks, photo: Gavin Clarke

Like condoms, data now comes in big and HUGE sizes

If condoms were made in a range of different sizes, the old joke goes, the options would be “huge”, “gigantic” and “enormous”. We mention the joke in reference to The Linux Foundation's decision to create a new conference, called “Vault”, to “... bring together the world’s leading developers in filesystems and storage in the …
Simon Sharwood, 29 Aug 2014
LTO Generations

No TKO for LTO: Tape format spawns another 2 generations, sports 120TB bigness

The LTO consortium has added two more generations to its tape format roadmap, extending it out to LTO-10 and a 120TB compressed capacity. The roadmap used to finish at LTO-8, and that version of the LTO tape format future was announced in April 2010. Now, four-and-a-half years later, it has been extended again. LTO Generations …
Chris Mellor, 11 Sep 2014
CS400

Nimble is as Nimble does: Mutant runs 'just like flash-only' gear

Nimble has boosted the performance of its hybrid flash and disk arrays with a CS700 model and all-flash expansion shelf. Nimble’s arrays provide disk-based capacity with flash used as a cache to accelerate data access. It claims that it now “provides the performance of flash-only arrays and the capacity of hybrid arrays” because …
Chris Mellor, 12 Jun 2014
The Register breaking news

Now your iPhone apps can be FAT losers: Apple gobbles data diet upstart

Apple has picked up AlgoTrim, a Swedish upstart that knocks together tools for quickly decompressing apps, photos, videos and other stuff on mobile phones. As well as image squeezing, AlgoTrim touts a code compression library that crams software into the flash memory of ARM-powered devices, possibly reducing the size of programs …
The HP 3PAR StorServ 7000 series arrays

What's that you say? HP's going to do WHAT to 3PAR StoreServs?

Rumours circulating today suggest HP is going to add full data deduplication to its StoreServ (3PAR) storage arrays. Deduplication identifies and removes duplicated blocks to prevent space being taken up by repetitive content. With a flash array, this also helps to reduce the amount of data written to the silicon which prolongs …
Chris Mellor, 30 May 2014
The World's Smallest Camera

Picture this: Data-wrangling boffins say they have made JPEGs OBSOLETE

Boffins have devised a new way of squishing data which could herald the end of the trusty JPEG picture format. A team at the University of California, Los Angeles, claim their new compression technique is much more efficient than the olden-days ways. As well as being useful for crushing images or streaming video, the new …
Jasper Hamill, 20 Dec 2013
Pure Storage F320

HDDs? Array with them... All-flash pusher Pure on its plans for 2014

All-flash array startup Pure Storage claims it is now IPO-sized in revenue terms and boasts of a coming fourfold increase in array capacity. Stifel Nicolaus MD Aaron Rakers hosted a call with Scott Dietzen, Pure's CEO, and circulated the following nuggets about Pure's position in the array market. The Pure Storage roadmap …
Chris Mellor, 23 Dec 2013
The Register breaking news

Google to buy video compression technology outfit On2

Google confirmed today that it plans to buy digital video compression outfit On2 Technologies in an all-stock agreement, valued at $106.5m. Mountain View said On2 shareholders will be handed 60 cents worth of Google class A common shares for each outstanding share they hold in the company. Clifton Park, New Jersey-based On2 …
Kelly Fiveash, 05 Aug 2009
Facebook data center - interior

Is the all-flash data centre just a tantalising dream?

An all-flash data centre? It’s an intriguing idea. The hardware and software components may be there, but what about the business case, including the overall price/performance and total cost of ownership? Yes, such a data centre will be free of power-gobbling and rack space-consuming spinning disk enclosures, bringing consequent …
Chris Mellor, 08 Sep 2014

AMD dangles 64-bit ARM code developer kit over, well ... developers

AMD has been promising shipments of its 64-bit ARM-based server chips, code-named "Seattle", for the end of the year but now you can get hold of one with the firm's latest developer kit release. From Wednesday those with the cash can hand over $2,999 to AMD and in return get the AMD Opteron A1100-series developer kit …
Iain Thomson, 30 Jul 2014

Dive in, penguins: Upstart builds Linux virtual SAN

Three Bulgarian engineers who co-founded a firm called StorPool – which builds a virtual SAN using the aggregated storage of Linux KVM servers – are aiming to expand the reach of their three-year-old project. Boyan Ivanov, CEO, Boyan Krosnov, chief product officer, and Yanko Yankulov, the chief tech officer, started the firm in …
Chris Mellor, 24 Jul 2014
Old computer

Researcher sat on critical IE bugs for THREE YEARS

Security outlet VUPEN has revealed it held onto a critical Internet Explorer vulnerability for three years before disclosing it at the March Pwn2Own hacker competition. The company wrote in a disclosure last week it discovered the vulnerability (CVE-2014-2777) on 12 February 2011 which was patched by Microsoft on 17 June (MS14- …
Darren Pauli, 24 Jul 2014
Xerox WorkCentre 7535

Xerox copier flaw changes numbers in scanned docs

A German PhD student has found a flaw in some Xerox Workcentres that fudges the numbers on some scans thanks to poor data compression. Last Wednesday, computer science student David Kriesel was scanning in some building plans on a Xerox WorkCentre, and when checking the copies he found some of the dimensions of the plans had …
Iain Thomson, 06 Aug 2013
ION USB turntable

Vinyl-fetish hipsters might just have a point

Hipsters. They're this decade's yuppies, but with worse facial hair. And an annoying predilection for pointless retro-technology fetishm that manifests itself in a love for vinyl records. Actually, scratch that complaint (pardon the pun). Or at least scratch it for the new 'ULTRA LP' format that Jack White, formerly of The White …
Simon Sharwood, 09 May 2014
Gemini X-series

Hey, Nimbus Data. What you doin' with those 4TB flash slabs? Making a 96TB box? We KNEW it!

Nimbus Data has announced a 10-node clustered all-flash array that can store up to 96TB in a single box. The Gemini X-series all-flash arrays build on the current Gemini F-series arrays, which come in F610/F620 variants with 56/40/20 Gbit/s InfiniBand and 40/10/1 Gbit/s Ethernet, and the F410/F420 which lack InfiniBand and use …
Chris Mellor, 04 Mar 2014
A person measuring her waistline

Your 'funny' cat pics are weighing down the web, so here's a better JPEG encoder from Mozilla

Mozilla has announced a new open-source JPEG encoding library, which it says could significantly reduce the amount of network traffic used by the web. Dubbed "mozjpeg," the library incorporates image-shrinking algorithms from the public domain JPEG-optimizing utility jpgcrush into the encoder itself, resulting in images that are …
Neil McAllister, 05 Mar 2014