Feeds

Careful with 'fibre speed record' hype: which record's been broken?

91 Gbps seems fast, but isn't much of a record

HP ProLiant Gen8: Integrated lifecycle automation

Last January, NASA's Energy Science Network (ESNet) ran a test that achieved 91 Gbps end-to-end data transfers.

The test made belated news this week in another outlet that touted ESNet as a "shadow network" faster than Google fibre. Leaving aside the inappropriateness of that hype, it got El Reg thinking about the business of the perennial story of communications speed records.

In just about every case – right now, we'll stick to stories about fibre network links – you can't claim a speed record, and certainly shouldn't proclaim someone else's record, if you don't understand the context.

ESnet's test was hyped as "the fastest of its type ever reported.” That's true. But "of its type” is the key phrase.

To understand why, let's look at other records – along with their context.

  • Fastest ever transfer over fibre of any kind – this seems to still belong to Bell Labs, even though it's five years old. In 2009, Bell boffins achieved a transmission speed described as 100 Petabits per second.kilometer.

    However – the company didn't actually ship 100 Pbps of anything. Bell Labs strapped together 155 lasers with a specified maximum transfer speed of 100 Gbps each. That aggregated to 15.5 Tbps link over 7,000 km of fibre. The “100 Pbps second.kilometre” is a mathematical artefact – multiplying 15.5 by 7,000.

    Still, at 15.5 Tbps, Bell Labs puts the 100 Gbps “shadow Internet” quite in the shade.

  • In 2012, Deutsche Telekom demonstrated a transmission between Hanover and Berlin, kicking along at 512 Gbps, when adjusted down for bit errors delivered 400 Gbps of usable bandwidth on unmodified, existing carrier-grade fibre. The "old fibre" angle was the story.
  • Earlier this year, BT connected BT Tower to Adastral Park with a 1.4 Tbps link. Again, the fibre rather than the speed was what was different.
  • In 2011, a group from Caltech and the University of Victoria spewed 186 Gbps between the University of Victoria and the Super Computing 2011 show floor in Washington, Seattle, a distance of 217 km. They used the BCnet and CANARIE research networks.

    The necessary context here, however, is one that's relevant to this case. The Caltech demo stipulated that its bidirectional 186 Gbps was a record for memory-to-memory transfers, not an absolute fibre speed record.

After all, carriers routinely carry more than 100 Gbps between locations. Terabit networks are easy, if you lay enough fibres.

So what has ESNet actually set a record in?

The link wasn't actually the news (neither was it news, really: the test was announced in January). It was what was going on at either end of the link.

As ESNet clearly explains here, the “special sauce” was that the researchers “achieved a record single host pair network data transfer rate of over 91 Gbps for a disk-to-disk file transfer”.

Quoting again from ESNet:

“To achieve 91+ Gbps disk-to-disk network data transfer rate between a single pair of high performance RAID servers, this demo required a number of techniques working in concert to avoid any bottlenecks in the end-to-end transfer process. This required parallelisation using multiple CPU cores, RAID controllers, 40G NICs, and network data streams; a buffered pipelined approach to each data stream, with sufficient buffering at each point in the pipeline to prevent data stalls, including application, disk I/O, network socket, NIC, and network switch buffering; a completely clean end-to-end 100G network path (provided by ESnet and MAX) to prevent TCP retransmissions; synchronisation of CPU affinities for the application process and the disk and network NIC interrupts; and a suitable Linux kernel.”

All of which is very impressive – but considered as a network link alone, 91 Gbps isn't so hot. It's all the other work that makes the jaw drop. The Caltech-Victoria University test's disk-to-disk transfer rate, for example, managed just 60 Gbps.

Our point is that a fibre speed record needs more context than "how many DVDs in how many seconds". You have to understand what previous record the researcher has in the cross-hairs.

Another point The Register wishes to emphasise: the existence of dark fibre links is not some kind of “shadow Internet”. It's quite normal – unless you never knew that such things existed.

If (to pick an example) Google decides it needs a hot-backup disaster recovery site a few km away from a facility in a major city, do you suppose it asks Comcast for 100 Gbps in megabit chunks? Or does it talk to a contractor and a carrier, and buy a brand-new fibre all its own? ®

Reducing security risks from open source software

More from The Register

next story
Sysadmin Day 2014: Quick, there's still time to get the beers in
He walked over the broken glass, killed the thugs... and er... reconnected the cables*
SHOCK and AWS: The fall of Amazon's deflationary cloud
Just as Jeff Bezos did to books and CDs, Amazon's rivals are now doing to it
Amazon Reveals One Weird Trick: A Loss On Almost $20bn In Sales
Investors really hate it: Share price plunge as growth SLOWS in key AWS division
US judge: YES, cops or feds so can slurp an ENTIRE Gmail account
Crooks don't have folders labelled 'drug records', opines NY beak
Auntie remains MYSTIFIED by that weekend BBC iPlayer and website outage
Still doing 'forensics' on the caching layer – Beeb digi wonk
BlackBerry: Toss the server, mate... BES is in the CLOUD now
BlackBerry Enterprise Services takes aim at SMEs - but there's a catch
The triumph of VVOL: Everyone's jumping into bed with VMware
'Bandwagon'? Yes, we're on it and so what, say big dogs
Carbon tax repeal won't see data centre operators cut prices
Rackspace says electricity isn't a major cost, Equinix promises 'no levy'
prev story

Whitepapers

Designing a Defense for Mobile Applications
Learn about the various considerations for defending mobile applications - from the application architecture itself to the myriad testing technologies.
Implementing global e-invoicing with guaranteed legal certainty
Explaining the role local tax compliance plays in successful supply chain management and e-business and how leading global brands are addressing this.
Top 8 considerations to enable and simplify mobility
In this whitepaper learn how to successfully add mobile capabilities simply and cost effectively.
Seven Steps to Software Security
Seven practical steps you can begin to take today to secure your applications and prevent the damages a successful cyber-attack can cause.
Boost IT visibility and business value
How building a great service catalog relieves pressure points and demonstrates the value of IT service management.