The Register® — Biting the hand that feeds IT

Feeds

Amazon: S3 cloud contains two trillion objects

'We've doubled our big number in a year'

Free ESG report : Seamless data management with Avere FXT

Amazon Web Services now has over two trillion objects within its S3 storage cloud, just one year after Bezos & Co. smashed through the one-trillion ceiling.

Each Amazon object, they say, can range from "range from zero to 5 TB in size," but Amazon does not disclose the size distribution of stored objects. An object consists of a key, a Version ID, a value, metadata, subresources, and access control information.

"It took us six years to grow to one trillion stored objects, and less than a year to double that number," Amazon wrote in a blog post announcing the milestone on Thursday. "Our universe is about 13.6 billion years old. If you added one S3 object every 60 hours starting at the Big Bang, you'd have accumulated almost two trillion of them by now."

Alternately, if each object were to be worth one dollar, then AWS S3 represents the net worth of 30 Bill Gates or 133 Steve Ballmers.

S3 is now regularly peaking at 1.1 million requests per second, up from 835,000 requests per second in Q3 2012, the company wrote. This indicate that along with requiring more storage, the applications built on top of AWS are getting chattier.

These figures may not reflect the actual size of Amazon's cloud, as they do not factor in Elastic Block Storage – a service used by a very large proportion of EC2 instances. Nor does Amazon give figures for the amount of data stored in its flash-backed DynamoDB NoSQL service – another significant piece of business for the company, and one which Amazon chief Andy Jassy described in November as the fastest growing service in AWS history.

As with all things cloud, Amazon's figure is difficult to use to compare S3 against other storage clouds: mid-level operators such as Joyent and Rackspace don't break out storage figures, and neither does Amazon contemporary Google.

Amazon S3 now stores 2 trillion objects

Not pictured: proportion of which are the cat pictures of Tumblr users

Microsoft, meanwhile, stated in July 2012 that its Azure cloud stores 4.03 trillion objects, and that the peak request rate was 880,000 per second (versus Amazon's 1.1m across two trillion objects). This, along with the lack of a detailed breakdown of what goes into Azure storage, indicates that comparing Azure's 4.03 trillion with Amazon's 2 trillion may not necessarily be a fair like-for-like comparison. At the time of writing, Microsoft had not responded to queries by us for an update on Azure storage figures.

With the whopping two trillion for S3, and no information yet on DynamoDB or EBS, it's clear that Amazon Web Services is still growing at a great rate. With each new scrap of information, Bezos & Co. seem more and more like the dragon Smaug, the plus-sized star of JRR Tolkein's The Hobbit: a fearsome creature lurking in a secret mountain, guarding its vast pile of data gold. ®

5 ways to reduce advertising network latency

Whitepapers

5 ways to reduce advertising network latency
Implementing the tactics laid out in this whitepaper can help reduce your overall advertising network latency.
Supercharge your infrastructure
Fusion­‐io has developed a shared storage solution that provides new performance management capabilities required to maximize flash utilization.
Avere FXT with FlashMove and FlashMirror
This ESG Lab validation report documents hands-on testing of the Avere FXT Series Edge Filer with the AOS 3.0 operating environment.
Reg Reader Research: SaaS based Email and Office Productivity Tools
Read this Reg reader report which provides advice and guidance for SMBs towards the use of SaaS based email and Office productivity tools.
Email delivery: 4 steps to get more email to the inbox
This whitepaper lists some steps and information that will give you the best opportunity to achieve an amazing sender reputation.

More from The Register

next story
Dedupe-dedupe, dedupe-dedupe-dedupe: Flashy clients crowd around Permabit diamond
3 of the top six flash vendors are casing the OEM dedupe tech, claims analyst
Disk-pushers, get reel: Even GOOGLE relies on tape
Prepare to be beaten by your old, cheap rival
Dragons' Den star's biz Outsourcery sends yet more millions up in smoke
Telly moneybags went into the cloud and still nobody's making any profit
Hong Kong's data centres stay high and dry amid Typhoon Usagi
180 km/h winds kill 25 in China, but the data centres keep humming
Microsoft lures punters to hybrid storage cloud with free storage arrays
Spend on Azure, get StorSimple box at the low, low price of $0
WD unveils new MyBook line: External drives now bigger... and CHEAP
Less than £0.04/GB, but it loses the Thunderbolt speed
VMware vSAN test pilots: Don't panic but there's a chance of DATA LOSS
AHCI SATA controller won't play nice with Virtzilla's robo-storage beta
prev story