Feeds

Fusion-io demos billion IOPS server config

Previews software with serious grunt

The Essential Guide to IT Transformation

Fusion-io has achieved a billion IOPS from eight servers in a demonstration at the DEMO Enterprise event in San Francisco.

The cracking performance needed just eight HP DL370 G6 servers, running Linux 2.6.35.6-45 on two, 6-core Intel processors, 96GB RAM. Each server was fitted with eight 2.4TB ioDrive2 Duo PCIE flash drives; that's 19.2TB of flash per server and 153.6TB of flash in total.

The demo used a custom load-generator that ran at 125 million ops/sec on each server and transferred 64 byte data packets.

Fusion said the ioDrives use Auto Commit Memory (ACM) software, a coming function in its ioMemory VSL subsystem. It lets developers directly control the data path to persistent (NAND flash) memory and "significantly reduces latency and system overhead in transferring data."

Fusion says data integrity is maintained "by the ioMemory architecture’s ability to flush all in-flight data, even if the power is abruptly cut, without the need for super capacitors or batteries."

The whole aim is to remove latency and O/S overhead from the access to data. David Flynn, Fusion's chairman and CEO, said: "This … is not something that could be achieved with hardware alone. Intelligent software that optimises NAND flash as a low latency, high-capacity, non-volatile memory solution for enterprise servers can transform the way organisations process the immense amounts of data that powers our lives today.”

Woz (Steve Wozniak), Fusion-io's Chief Scientist, said: “Instead of treating flash like storage, where data passes through all of the OS kernel subsystems that were built and optimised for traditional storage, our core ioMemory technology offers a platform with new programming primitives that can provide system and application developers direct access to non-volatile memory.”

Bypassing host O/S I/O subsystem

The demo preview system had 64 ioDrive 2 Duos, each with 2.4TB of capacity. Flynn said existing 2.4TB ioDrive 2 Duos do around a million IOPS. Each one in the demo system delivered 16 million IOPS, a 16X - that's right, sixteen-fold - improvement in performance.

This comes from avoiding using the host OS' I/O subsystem at all. Instead the iODRive capacity is seen by applications as an area of memory. Flynn said apps simply read or write data from an area of memory, using CPU Load Store instructions.

They use an ACM API to do this and so would need writing or rewriting to do so. Flynn said apps could be somehow fooled into thinking they were still using the host OS's I/O pathways, even tough they are not, which would make the adoption of ACM by existing software somewhat easier.

It is a data transfer, an I/O in that sense, but doesn't look like it to the host operating system. The OS's block I/O subsystem simply isn't used.

Flynn says this means application software effectively gets instantaneous I/O, data transferred at near-memory speed, and the server's CPU doesn't don't get involved with this data transfer at all.

Multiplying the effect

It's a multiplier, the company says. This means, for example, that a virtualised server with VMware gets a huge slug of CPU resource released by apps using the cut-through or Fast Path ACM software - so one host could run more virtual machines (VMs). How many more depends upon how bounded by I/O the existing apps are.

El Reg speculates that a host could run half as many VMs again as it does today.

Looking at individual apps we could ask how many more users or clients they could support with the ACM software? Would it be a tenfold increase or even more? We'll have to wait and see.

Flynn pointed out that ACM is still preview software and will be worked on some more. It could go even faster by the time the software is released.

Fusion has a track record in such demonstrations, starting with the 1 million IOPS Quicksilver demo with IBM's SVC in 2009. It needed a rack of systems. Two years later it has gone a thousand times faster with far fewer but more powerful servers.

By producing software such as Auto Commit Memory, Fusion-io is avoiding the coming commodity PCIe hardware flash trap which will cause prices, and profit margins, to drop.

Auto Commit Memory should be a real product by DEMO Enterprise in April; that's in four months. It will only be available with Fusion's hardware.

With ACM, Fusion has significantly raised the bar in enterprise server I/O and separated itself off from the PCIe flash drive pack. It's no longer enough to have fast flash drive hardware. You need clever, clever software to really make your PCIe NAND flash operate as fast as the brown stuff leaving a shovel.

Think about it. If this works then Fusion-io has just completely re-written the rules of server app I/O. Things will never be the same again. Sounds portentous. It's real. ®

The Essential Guide to IT Transformation

More from The Register

next story
Sysadmin Day 2014: Quick, there's still time to get the beers in
He walked over the broken glass, killed the thugs... and er... reconnected the cables*
Auntie remains MYSTIFIED by that weekend BBC iPlayer and website outage
Still doing 'forensics' on the caching layer – Beeb digi wonk
Microsoft says 'weird things' can happen during Windows Server 2003 migrations
Fix coming for bug that makes Kerberos croak when you run two domain controllers
Cisco says network virtualisation won't pay off everywhere
Another sign of strain in the Borg/VMware relationship?
VVOL update: Are any vendors NOT leaping into bed with VMware?
It's not yet been released but everyone thinks it's the dog's danglies
prev story

Whitepapers

Implementing global e-invoicing with guaranteed legal certainty
Explaining the role local tax compliance plays in successful supply chain management and e-business and how leading global brands are addressing this.
Boost IT visibility and business value
How building a great service catalog relieves pressure points and demonstrates the value of IT service management.
Why and how to choose the right cloud vendor
The benefits of cloud-based storage in your processes. Eliminate onsite, disk-based backup and archiving in favor of cloud-based data protection.
The Essential Guide to IT Transformation
ServiceNow discusses three IT transformations that can help CIO's automate IT services to transform IT and the enterprise.
Maximize storage efficiency across the enterprise
The HP StoreOnce backup solution offers highly flexible, centrally managed, and highly efficient data protection for any enterprise.