Feeds

Cleversafe: Our mad rig can gobble A TERABYTE in A SECOND

Big Data? This is Giant Fat Chair-smashing Bastard Data

Intelligent flash storage arrays

Cleversafe claims it has the biggest mouth for objects on the planet, gulping them in at a terabyte a second.

The company is an object storage startup and its 3000 series of appliances can cram in a terabyte's worth of objects but you need a thousand, yes indeed, 1,000, ingest boxes or Accesser 3100 storage router appliances in front if a 10EB storage cloud to do it.

The Accessers read and write objects into the object storage namespace independently and each one sucks in data at a rate of 1GB/sec.

A 10EB storage cloud is not just a Big Data installation; it is an effing gigantic data installation comprising:-

- 16 sites
- 24 portable datacenters per site (384 total)
- 21 racks per portable datacenter (8,064 total)
- 147 storage nodes (Slicestors) per portable datacenter (56,448 total)
- 84 3TB drive per Slicestor (4.7M drives total)
- 1000 Accesser 3100 appliances (1GB/s per appliance, 1TB/s total ingest)
- 96 dsNet Manager 3100 appliances (each manages 100PB of infrastructure)

This is steroidal, pump-up-the-numbers marketing. As if anybody would ever put 4.7 million disk drives in 56,448 Slicestors in 8,060 racks in 16 datacentres. It's hugely impressive - but like a theoretical orgasm for object storage buffs.

A 1TB/sec ingest rate is similar to high-performance computing data ingest rates - DataDirect Network's SFA12ke claims a 20GB/sec file ingest rate per rack - but this isn't an HPC situation, not when spread across 16 sites. It basically seems to take quite a lot of time to ingest and store unstructured information into the Cleversafe object store, as each object needs to have a hash calculated; there's a fair amount of processing involved.

The object storage vendors say their technology is better at storing billions of files across dispersed sites than a traditional file system. When we see one of them doing just that we will all be impressed. Until then it's just modelling and the real thing is always better than a model. ®

Internet Security Threat Report 2014

More from The Register

next story
NSA SOURCE CODE LEAK: Information slurp tools to appear online
Now you can run your own intelligence agency
Azure TITSUP caused by INFINITE LOOP
Fat fingered geo-block kept Aussies in the dark
NASA launches new climate model at SC14
75 days of supercomputing later ...
Yahoo! blames! MONSTER! email! OUTAGE! on! CUT! CABLE! bungle!
Weekend woe for BT as telco struggles to restore service
Cloud unicorns are extinct so DiData cloud mess was YOUR fault
Applications need to be built to handle TITSUP incidents
BOFH: WHERE did this 'fax-enabled' printer UPGRADE come from?
Don't worry about that cable, it's part of the config
Stop the IoT revolution! We need to figure out packet sizes first
Researchers test 802.15.4 and find we know nuh-think! about large scale sensor network ops
SanDisk vows: We'll have a 16TB SSD WHOPPER by 2016
Flash WORM has a serious use for archived photos and videos
Astro-boffins start opening universe simulation data
Got a supercomputer? Want to simulate a universe? Here you go
prev story

Whitepapers

Driving business with continuous operational intelligence
Introducing an innovative approach offered by ExtraHop for producing continuous operational intelligence.
The total economic impact of Druva inSync
Examining the ROI enterprises may realize by implementing inSync, as they look to improve backup and recovery of endpoint data in a cost-effective manner.
Forging a new future with identity relationship management
Learn about ForgeRock's next generation IRM platform and how it is designed to empower CEOS's and enterprises to engage with consumers.
High Performance for All
While HPC is not new, it has traditionally been seen as a specialist area – is it now geared up to meet more mainstream requirements?
Simplify SSL certificate management across the enterprise
Simple steps to take control of SSL across the enterprise, and recommendations for a management platform for full visibility and single-point of control for these Certificates.