Articles about Compression

Stradivarius violin reproduction

Violin Memory FINALLY writes dedupe and compression into its latest Concerto

Violin Memory has fixed a gaping hole in its data management feature set by adding deduplication and compression to its Concerto memory array controller product. This will cut its effective cost/GB figures to new lows, and strengthens its competitive hand against other all-flash array vendors – such as EMX XtremIO, IBM …
Chris Mellor, 19 Aug 2014

Intel demos real-time code compression for die shrinkage, power saving

Research@Intel Intel researchers have developed a way to make the increasingly tiny processors needed to power the impending "Internet of Things" even tinier: compress the code running on them. "We compress the code, make it smaller, and save area and power of integrated on-die memory," Intel Labs senior reseacher Sergey Kochuguev from ZAO …
Rik Myslewski, 25 Jun 2013

Google open sources very slow compression algorithm

Google has open sourced a new compression algorithm called Zopfli that it says is a slower-but-stronger data squasher than the likes of zlib. The product of Googler Lode Vandevenne's 20 per cent time, the day a week Google allows its staff to work on side projects, Zopfli is said to reduce files to sizes 3.7–8.3 per cent smaller …
Simon Sharwood, 01 Mar 2013
Fujitsu TR800

Diamonds are forever, Fujitsu Eternus now for VDI

Fujitsu has added a bunch of new variants to its Eternus TR storage arrays, targeting large scale desktop virtualisation environments. The models are the Eternus TR820, TR850 and TR880, with the last in the list claiming the ability to connect 3,500 VMs, which the company says is nearly double the scale of its previous models. …
Team Register, 20 Jan 2015
channel

Dell bulks up storage line – with compression product

Dell is launching its first Ocarina data compression product, an adjunct to its DX6000 object storage product line. The DX6000 products twin Dell hardware with OEM'd Caringo object storage software. The DX6000G server is a clusterable storage compression node that works with DX6000 storage. It uses software from Ocarina, a …
Chris Mellor, 12 Oct 2011
BPG compression demo

QEMU, FFMPEG guru unleashes JPEG-slaying graphics compressor

Noted software wizard Fabrice Bellard has devised a new raster image format that he says offers superior quality to JPEG at similar file sizes. Bellard – who is known for creating the QEMU virtualization hypervisor and the FFMPEG multimedia libraries, among other achievements – says the new format, called Better Portable …
Neil McAllister, 12 Dec 2014

IBM furtles all-flash biz bruiser FlashSystem

IBM has upped its all-flash array FlashSystem capacity to an effective 1.6PB by baking in SVC/Storwize features – including real-time compression. The FlashSystem V840 release 1.2 is built from three 2U rackmount boxes: an AE1 storage enclosure (as used in the 840) and two active-active AC1 control enclosures. The storage box …
Chris Mellor, 05 Aug 2014
channel

Google open sources MapReduce compression

Google has open sourced the compression library used across its backend infrastructure, including MapReduce, its distributed number-crunching platform, and BigTable, its distributed database. Available at Google Code under an Apache 2.0 license, the library is called Snappy, but Google says this is the same library that was …
Cade Metz, 24 Mar 2011
hands waving dollar bills in the air

Teradata adds hardware compression to data warehouses

Teradata invented the data warehousing market and is not about to let Larry Ellison take it over without a fight. At this week's Partners Conference in San Diego, which is where Teradata Labs does the development of some of the hardware and software that goes into its various data warehousing appliances, the company is …

Boffins find Jackie Chan's SUPERCOP is good for something

Blu-Ray might not be setting the world afire, but boffins have turned up a surprising upside of the technology that can be applied to solar PV manufacture. It turns out the pit-and-peak pattern that encodes a movie on the disk helps improve light absorption if reproduced on the surface of a solar cell. Published in Nature …
Fusion-io ioSgale 3.2TB card

MySQL daddy Monty talks up Fusion-io's data-stuffed flash

Fusion-io can cram more data into its ioMemory flash storage without cramping performance – at least that’s what it’s claiming about its NVM Compression technology. We are told NVM Compression is “a flash-aware interface that can double the useable capacity of ioMemory flash while eliminating the performance impact associated …
Chris Mellor, 02 Apr 2014
XtremIO upgrade video

No biggie: EMC's XtremIO firmware upgrade 'will wipe data'

There's a rumor that upgrading EMC's XtremIO firmware to v3.0 will wipe all user data from the flash array. It's mentioned here. It seems going from firmware version 2.4.x to version 3.0, expected by early October, will cause data to be lost – and customers will need to back everything up before the upgrade and restore it …
Chris Mellor, 15 Sep 2014

It's Friday. The pub is looming. IDC tells us 'bottoms up'. We'll drink to that headline

IDC has released a flash-based array study saying it's used a (and we quote) "bottoms-up approach." We'll raise a glass to that notion. The study, Worldwide All-Flash Array and Hybrid Flash Array 2014–2018 Forecast and 1H14 Vendor Shares, looks at revenues and raw terabytes shipped with flash-based arrays - all-flash arrays ( …
Chris Mellor, 16 Jan 2015
Road leading to the factory

Is this storage kit the best? It DEPENDS. Why is your face turning red?

Storagebod Storage marketing is one of maddest and craziest parts of the technology industry: there are so many claims that don’t necessarily stand up to scrutiny and pretty much all of them require the caveat: "It depends…" It is very important to understand that it really does depend on a number of factors. For example, when your flash …
StorageBod, 12 Jun 2014

Mozilla and Facebook snip a further five per cent from all JPEGs

Just four months after loosing the mozjpeg encoder on a waiting world, Mozilla has updated it to version 2.0, at the same time announcing that Facebook is testing the new iteration. The Social NetworkTM has also slung Mozilla $US60,000 towards the development effort in anticipation of mozjpeg 3.0. Mozjpeg, first released in …
SANblox

Permabit builds shrink-your-SAN dedupe box

Permabit has built a front-end SAN box to dedupe and compress SAN data so it needs less disk capacity. The company produces Albireo deduplication and compression software, which it sells on an OEM basis. The idea is to enable disk array vendors to improve the cost/GB of their storage so that they can retain a cost advantage over …
Chris Mellor, 16 Sep 2014

Permabit squeezes its Albireo dedupe fruit, offers juice to vendors

Permabit is still aiming to strike OEM gold from its dedupe technology and has added compression to its Albireo deduper, aiming to help disk array vendors compete better against the all-flash and hybrid array startups. The idea is to enable disk array vendors to offer reduction of primary data, generally unavailable currently, …
Chris Mellor, 27 Jun 2014
channel

HDS coy about future compression tech

Hitachi Data Systems doesn't have its own compression/deduplication technology but looks set to get it. Dell is buying Ocarina for such technology and HDS is the array supplier holdout, as competitors EMC, HP, IBM and NetApp each have their own technology for data reduction. What is HDS going to do? Senior executives are being …
Chris Mellor, 23 Jul 2010
channel

EMC gets busy with dedupe, compression code-base

EMC has been developing its own deduplication and compression code-base, entrusting the effort to a team code-named Viper. The story, as told by someone familiar with the events, starts with EMC acquiring Avamar in November 2006. In June 2009 it acquired DataDomain. At this point it had Avamar source deduplication, DataDomain …
Chris Mellor, 25 Jun 2010
Nyancoin logo

Exploit emerges for LZO algo hole

Security Mouse security researcher Don A Bailey has showcased an exploit of the Lempel-Ziv-Oberhumer (LZ0) compression algorithm running in the Mplayer2 media player and says it could leave some Linuxes vulnerable to attack. The LZO data compression algorithm was created by Markus Oberhumer in 1994 and was discovered to be …
Darren Pauli, 11 Jul 2014
Hadoop_elephant

Teradata gobbles up data squasher RainStor

Teradata has bought RainStor, the deduping database supplier and Hadoop convert. RainStor specializes in archiving and two years ago put its analytics engine and enterprise database on Hadoop, the Google-inspired big-data cruncher. Financial terms of the deal for the privately held RainStor were not revealed. Teradata called …
Gavin Clarke, 18 Dec 2014
Larry Ellison, photo by Oracle Corporate Communications

Explained: How LSI and Oracle cooked up magical flash-embiggening sauce

Oracle and LSI have magicked up a way for LSI’s Nytro server flash cards to hold more data than they’re seemingly physically capable of holding and called it Dynamic Logical Capacity (DLC). How does it work? We thought it might be a paging mechanism – but we were dead wrong. The card compresses the data it is sent and can reach …
Chris Mellor, 15 Jan 2014

VMware: Storage data functions can and WILL migrate to flash media

Comment VMware's CTO has revealed his belief that array and VSAN-level storage data service functions can, and will, move into flash media. He made the point on a recent blog that it is logical for physical block addressing to be dynamic rather than static. A disk drive's firmware maps logical block addresses (LBAs) to physical block …
Chris Mellor, 05 Jan 2015

Let Google's tentacles fondle your mobile's web downloads and Chrome will put the data on a diet

The latest version of Google's Chrome browser for handheld devices includes a data-compression feature that's designed to save customers money on their mobile bills, among other new bells and whistles. The compression comes disabled by default on Android and iOS, but can be activated by flipping a single switch in the browser's …
Neil McAllister, 16 Jan 2014
Larry Ellison

Ellison: Sparc M7 is Oracle's most important silicon EVER

OpenWorld During his OpenWorld keynote on Sunday, Oracle CEO CTO Larry Ellison took time out from talking up his company's cloud strategy to remind the audience that the database giant is in the hardware business, too – all the way down to the silicon. Many of Oracle's "engineered systems" are powered by Intel processors – and Intel …
Neil McAllister, 29 Sep 2014
XtremIO array and 4 X-Brick nodes

EMC huffs, gives XtremIO a polish, shows off shiny data services

EMC's XtremIO all-flash array will benefit from new data services and models as the company spools up to take on Pure Storage, IBM and other flash array competitors. There is a new 5TB Starter X-Brick, lowering starter costs, and X-Brick clusters can scale out to six nodes with 12 active controllers. The Starter X-Brick can …
Chris Mellor, 08 Jul 2014
EVO: RAIL

What the Dell? Big Mike and co join Nexenta for EVO: RAIL file access

Dell is using Nexenta's software to bring file access to VMware's EVO: RAIL virtual SAN. It is shipping NexentaConnect and NexentaStor software with its EVO: RAIL kit, its pre-configured, fully integrated, hyper-converged appliance. NexentaStor is Nexenta's ZFS-based storage software which runs on certified server/storage …
Chris Mellor, 15 Oct 2014
Gartner SSA CC Overall Scores

Gartner ranks upstart trio ahead of EMC, HP and IBM in battle for flash array dominance

Gartner’s thrilling solid-state appliance critical capabilities report ranks three startups ahead of EMC, HP and IBM: SolidFire, Pure Storage and Kaminario. This assessment is not reflected in Gartner's Magic Quadrant for solid-state arrays. While the MQ looks at a company’s overall ability to execute, and its vision, the …
Chris Mellor, 13 Sep 2014
IBM's Hursley partner centre: A shop window for datacentres

IBM keeps it real with Storwize V7000

Storagebod It has been very gratifying to see the IBM Storwize V7000 and SVC getting some real love from IBM over the past couple of years. The latest bunch of announcements are good: it'll be bigger and faster, says IBM, yet it presents this news with some realism. IBM's in-house storage blogger Barry Whyte is not one to try and pull the …
StorageBod, 14 May 2014
Tintri

Tintri gazes hungrily at Japan after nailing Fujitsu OEM deal

Hybrid array startup Tintri has bagged Fujitsu as its doorway into the Japanese market. Fujitsu has its in-house ETERNUS DX arrays, classic dual-controller gear, and 50PB scale-out array for big data. The Japanese company has announced its ETERNUS TR line, with TR820, 850 and 880 models aimed at the VDI market. They feature …
Chris Mellor, 20 Jan 2015

NetApp's running with the big dogs: All-flash FlashRay hits the street

NetApp’s all-new FlashRay solid state array has been launched with limited availability and is not yet ready for prime time, having only a single controller, and lacking scale-out features and some ONTAP integration. These will come with future product upgrades, allowing NetApp to harden and fine-tune the product with this …
Chris Mellor, 17 Sep 2014

Rejoice, Windows fans: Stable 64-bit Chromium drops for Win 7 and 8

Smoother video is on the way for fans of Google's Chrome browser on Windows 7 and 8. The Chromium development team has claimed delivery of a stable release of 64-bit Chrome for Microsoft’s platform. The news, announced on the Chromium blog, marks the successful of testing started in the Chrome dev and canary channels in June …
Gavin Clarke, 28 Aug 2014
Curiosity

NASA's Curiosity rover brought Earth BUG to Mars

A 20 year old bug has been discovered in an algorithm so pervasive it's used in the Mars Curiosity rover, cars, aircraft, Android phones and a string of popular open source wares. The bug can be found in the Lempel-Ziv-Oberhumer (LZO) data compression algorithm created by Markus Oberhumer, who on Wednesday posted a new version 2 …
Darren Pauli, 27 Jun 2014
Baseball

Would you rip'n'replace your IT for Simplivity kit? Upstart reckons so

Blocks and Files Simplivity makes scale-out converged server-storage Omnicubes, and you have to rip-and-replace your IT infrastructure to make the best use of them. This sounds like a hard sell, but many of its customers are doing just that as the startup heads towards a $200m run-rate. The company was founded in September 2009, and it spent …
Chris Mellor, 11 Aug 2014
IBM RTP Data Center

IBM leaps aboard the software-defined stuff bandwagon

IBM storage is getting software-defined, with IBM seeing that concept as a way of better integrating its storage hardware and software assets. Big Blue's Storage and Software-defined Systems general manager Jamie Thomas outlined a new storage deal at IBM's Enterprise event in Las Vegas, claiming the "new model will provide …
Chris Mellor, 09 Oct 2014
Bored girl

Hey, marketing drone, what's with the FUD - nothing GOOD to say about your own kit?

Storagebod Are we drifting into another round of the storage wars where FUD starts to fly? It always makes for good copy. The little guy complaining about the big guy, who in turn is complaining about the little guy: David with his sling versus Goliath with his rocket launcher. The thing with FUD is that it doesn’t really work unless there …
StorageBod, 01 May 2014
Hawk hits drone

SkyHawk array swoops down, 136TB claws extended

All-flash array startup and packing density expert Skyera has got itself a new version of its skyHawk array, encompassing a threefold increase in capacity. The first generation skyHawk was a 1U rack enclosure with 44TB of usable flash capacity inside it. Gen 2 skyHawk FS has 136TB (raw) and also delivers increases in data …
Chris Mellor, 30 Oct 2014

Tell it to me straight, vendors: Are you cheap and easy?

Is it easy? Is is cheap? These are pretty much the only two questions which interest me when talking to a vendor these days – after years of worrying about technology. Of course, if I was to produce an RFP document with simply those two questions, I’d probably be out of a job fairly swiftly. But those two questions are not …
StorageBod, 02 Apr 2014
DeLorean from Back to the Future 3

Your move, sucker! Microsoft tests cloud gaming system that cuts through network lag

Microsoft researchers have developed software that, they say, cuts through network delay issues in cloud gaming systems. The tech, dubbed "DeLorean", speculates what a gamer will do next, renders those frames and then pushes them out to the client "one entire RTT [round-trip delay time] ahead of time". Redmond's researchers …
Kelly Fiveash, 24 Aug 2014
The CUDOS silicon waveguide

Soliton makes its way across silicon in CUDOS experiment

On-chip photonic interconnects are a step closer, with a successful demonstration of soliton compression in silicon from Australia's CUDOS research centre. In a Nature Communications report, a team from CUDOS demonstrates that solitons can be both observed and harnessed in silicon-based photonic systems. Solitons in fibre optic …
The Register breaking news

Google to buy video compression technology outfit On2

Google confirmed today that it plans to buy digital video compression outfit On2 Technologies in an all-stock agreement, valued at $106.5m. Mountain View said On2 shareholders will be handed 60 cents worth of Google class A common shares for each outstanding share they hold in the company. Clifton Park, New Jersey-based On2 …
Kelly Fiveash, 05 Aug 2009
Whitewater

NetApp buys SteelStore from Riverbed

NetApp has extricated Riverbed from some nasty Whitewater rapids that threatened to drag it under and pummel it on the rocks below. The big blue staple rode to the rescue by buying its SteelStore product line for U$80 million in cash. SteelStore is Riverbed's re-branded Whitewater cloud storage backup appliance technology. It …
Chris Mellor, 27 Oct 2014
FlashRay slide 1

NetApp FlashRay's OS is 'based on SANtricity' – analyst

A financial analyst suggests that NetApp's coming FlashRay all-flash array will not have a ground-up design operating system but will use the existing SANtricity O/S found in NetApp's EF540 and EF550 flash arrays. NetApp says he's completely wrong. FlashRay is a completely new all-flash design from NetApp designed to compete …
Chris Mellor, 13 Feb 2014
Sony X85 65-inch flat panel 4K TV

Got a 4King big TV? Ready to stream lots of awesome video? Yeah, about that…

While electronics giants are showing off their internet-connected 4K TVs, most people still do not have the web bandwidth to stream stuff in ultra high-def. That's the conclusion reached by the latest quarterly report [PDF] from internet backbone-manipulation outfit Akamai, which shows that only about 12 per cent of netizens …
Shaun Nichols, 09 Jan 2015
RFID_snail_trio

Tiny steps: HTTP 2.0 WG looks for consensus

The long-awaited HTTP 2.0 protocol has inched a step further towards completion, with the IETF issuing a last call on the two key documents of the spec, with comments to end on 1 September. The two drafts in question are the core HTTP 2.0 document, and the HPACK header compression format. It's been a long road to get to HTTP 2. …
4 racks of V7000 boxes

Storwize embiggened: Nearly 4PB of raw capacity, croons IBM's Barry Whyte

IBM has substantially refreshed its SVC (SAN Volume Controller) and Storwize storage array products, providing doubled processing power, boosting compression power as well as increasing Storwize capacity to around 4PB, it claims. There are two detailed blogs about the new hardware and software: one from Master Inventor Barry …
Chris Mellor, 12 May 2014

Golden age of invention or hyped-up age of overblown marketing?

Storagebod blog Barely a day passes without receiving an announcement from some vendor or another. Every one is "revolutionary" and a massive step forward for the industry – or so they keep telling me. It would seem that we are living in a golden age of invention. Yet many conversations with peer end users generally end up with us feeling …
StorageBod, 13 Aug 2014
Kaminario K-Blocks

Kaminario shovels RAM, shiny new processors onto K2's peaks

Kaminario has updated its K2 all-flash array with new processors, more RAM, higher capacity SSDs and data reduction technology, claiming K2 is more efficient, scalable and cost-effective than either EMC's XtremIO or Pure Storage's FA-400 all-flash arrays. The fourth generation K2 product topped the SPC-1 random IO and SPC-2 …
Chris Mellor, 20 May 2014
cloud

Out of stealth, Saisei pitches IP flow controller

Year-old startup Saisei is putting forward an SDN management framework it reckons can free up as much as half of the network performance that now gets sucked up by various overheads. The outfit's FlowCommand network performance enforcement (NPE) software is designed to take IP packet queuing and scheduling out of the performance …
XtremIO front panel

EMC: Kerr-ching! $430m XtremIO gulp's paying off... Hello, $1bn a year

EMC president Chad Sakac says the XtremIO will be the fastest product in EMC’s history to reach a billion dollar run-rate. A new release is coming to keep the momentum up. XtremIO was bought by EMC for $430m in May 2012, at which point it did not have a shipping product. The first product was announced a year later, May, 2013. …
Chris Mellor, 26 Jan 2015