Feeds

Flash and the five-minute rule

NAND then there was disruption

Next gen security for virtualised datacentres

Comment "Flash is a better disk ... and disk is a better tape." So said distinguished Microsoft engineer Jim Gray in 2006.

A few years before then he had formulated his famous five-minute rule of thumb, which said that it is better to cache disk-held data in DRAM if it was going to be re-used in five minutes or less. The idea was that, given the relative costs of DRAM, disk capacity, I/Os and data page sizes, it would cost less to cache such data in DRAM than keep it on disk.

This proved to be an enduring rule and the coming of affordable flash now means that it can be used to say when data should be stored in NAND or disk or DRAM. Given the steep price declines of flash, the predictions from it are that flash will become the place to store active data, not disk.

This picture of flash's prospects was presented by David Dale of NetApp at an SNIA data centre event in London on Tuesday. His session was called The Benefits of Solid State in Enterprise Storage Systems, and he set aside NetApp partiality to present an industry picture. That's the value of SNIA sessions like this - vendor reps don't sell or market their products, they educate.

Dale's pitch was fascinating and gave a glimpse of the turmoil that lies in wait for storage and server vendors that don't embrace flash, turmoil that can be predicted by Gray's five-minute rule.

Five-minute rule formula

The rule is worked out like this: you calculate the break-even relative interval (RI), and if it's less than five minutes you cache the data. The formula is:

RI = (Data pages per MB / IOPS per disk) x (price of disk / price per MB of RAM)

According to this article 1MB of RAM cost $5,000 in 1987, a 15 IOPS disk cost $15,000 and the data page size was 1KB. The RI formula, using these figures, works out at 205 secs. Data used more often than that should be kept in RAM with the rest on disk.

By 1997 prices and IOPS had changed. The MB of RAM cost $15, a 64 IOPS disk cost $2,000 and the page size was 8KB. The RI works out to pretty much the same: 267secs.

Fast forward to 2008, and the MB of RAM now costs 10 cents, the disk plus controller costs $650 and spurts out 183 IOPS - this is a 15K, 2.5-inch enterprise drive - and the RI is 2,273 secs, or 38 minutes. Oops. You can't feasibly hold all the data that will be re-used in 38 minutes in RAM or you can increase the page size. A 64KB one gives an RI of 568 seconds (nine minutes) which is better but still too high.

Secure remote control for conventional and virtual desktops

Next page: Enter Flash

More from The Register

next story
HP busts out new ProLiant Gen9 servers
Think those are cool? Wait till you get a load of our racks
Like condoms, data now comes in big and HUGE sizes
Linux Foundation lights a fire under storage devs with new conference
Community chest: Storage firms need to pay open-source debts
Samba implementation? Time to get some devs on the job
Silicon Valley jolted by magnitude 6.1 quake – its biggest in 25 years
Did the earth move for you at VMworld – oh, OK. It just did. A lot
Forrester says it's time to give up on physical storage arrays
The physical/virtual storage tipping point may just have arrived
prev story

Whitepapers

5 things you didn’t know about cloud backup
IT departments are embracing cloud backup, but there’s a lot you need to know before choosing a service provider. Learn all the critical things you need to know.
Implementing global e-invoicing with guaranteed legal certainty
Explaining the role local tax compliance plays in successful supply chain management and e-business and how leading global brands are addressing this.
Backing up Big Data
Solving backup challenges and “protect everything from everywhere,” as we move into the era of big data management and the adoption of BYOD.
Consolidation: The Foundation for IT Business Transformation
In this whitepaper learn how effective consolidation of IT and business resources can enable multiple, meaningful business benefits.
High Performance for All
While HPC is not new, it has traditionally been seen as a specialist area – is it now geared up to meet more mainstream requirements?