Feeds

Careful with 'fibre speed record' hype: which record's been broken?

91 Gbps seems fast, but isn't much of a record

Maximizing your infrastructure through virtualization

Last January, NASA's Energy Science Network (ESNet) ran a test that achieved 91 Gbps end-to-end data transfers.

The test made belated news this week in another outlet that touted ESNet as a "shadow network" faster than Google fibre. Leaving aside the inappropriateness of that hype, it got El Reg thinking about the business of the perennial story of communications speed records.

In just about every case – right now, we'll stick to stories about fibre network links – you can't claim a speed record, and certainly shouldn't proclaim someone else's record, if you don't understand the context.

ESnet's test was hyped as "the fastest of its type ever reported.” That's true. But "of its type” is the key phrase.

To understand why, let's look at other records – along with their context.

  • Fastest ever transfer over fibre of any kind – this seems to still belong to Bell Labs, even though it's five years old. In 2009, Bell boffins achieved a transmission speed described as 100 Petabits per second.kilometer.

    However – the company didn't actually ship 100 Pbps of anything. Bell Labs strapped together 155 lasers with a specified maximum transfer speed of 100 Gbps each. That aggregated to 15.5 Tbps link over 7,000 km of fibre. The “100 Pbps second.kilometre” is a mathematical artefact – multiplying 15.5 by 7,000.

    Still, at 15.5 Tbps, Bell Labs puts the 100 Gbps “shadow Internet” quite in the shade.

  • In 2012, Deutsche Telekom demonstrated a transmission between Hanover and Berlin, kicking along at 512 Gbps, when adjusted down for bit errors delivered 400 Gbps of usable bandwidth on unmodified, existing carrier-grade fibre. The "old fibre" angle was the story.
  • Earlier this year, BT connected BT Tower to Adastral Park with a 1.4 Tbps link. Again, the fibre rather than the speed was what was different.
  • In 2011, a group from Caltech and the University of Victoria spewed 186 Gbps between the University of Victoria and the Super Computing 2011 show floor in Washington, Seattle, a distance of 217 km. They used the BCnet and CANARIE research networks.

    The necessary context here, however, is one that's relevant to this case. The Caltech demo stipulated that its bidirectional 186 Gbps was a record for memory-to-memory transfers, not an absolute fibre speed record.

After all, carriers routinely carry more than 100 Gbps between locations. Terabit networks are easy, if you lay enough fibres.

So what has ESNet actually set a record in?

The link wasn't actually the news (neither was it news, really: the test was announced in January). It was what was going on at either end of the link.

As ESNet clearly explains here, the “special sauce” was that the researchers “achieved a record single host pair network data transfer rate of over 91 Gbps for a disk-to-disk file transfer”.

Quoting again from ESNet:

“To achieve 91+ Gbps disk-to-disk network data transfer rate between a single pair of high performance RAID servers, this demo required a number of techniques working in concert to avoid any bottlenecks in the end-to-end transfer process. This required parallelisation using multiple CPU cores, RAID controllers, 40G NICs, and network data streams; a buffered pipelined approach to each data stream, with sufficient buffering at each point in the pipeline to prevent data stalls, including application, disk I/O, network socket, NIC, and network switch buffering; a completely clean end-to-end 100G network path (provided by ESnet and MAX) to prevent TCP retransmissions; synchronisation of CPU affinities for the application process and the disk and network NIC interrupts; and a suitable Linux kernel.”

All of which is very impressive – but considered as a network link alone, 91 Gbps isn't so hot. It's all the other work that makes the jaw drop. The Caltech-Victoria University test's disk-to-disk transfer rate, for example, managed just 60 Gbps.

Our point is that a fibre speed record needs more context than "how many DVDs in how many seconds". You have to understand what previous record the researcher has in the cross-hairs.

Another point The Register wishes to emphasise: the existence of dark fibre links is not some kind of “shadow Internet”. It's quite normal – unless you never knew that such things existed.

If (to pick an example) Google decides it needs a hot-backup disaster recovery site a few km away from a facility in a major city, do you suppose it asks Comcast for 100 Gbps in megabit chunks? Or does it talk to a contractor and a carrier, and buy a brand-new fibre all its own? ®

The Power of One eBook: Top reasons to choose HP BladeSystem

More from The Register

next story
Sysadmin Day 2014: Quick, there's still time to get the beers in
He walked over the broken glass, killed the thugs... and er... reconnected the cables*
Auntie remains MYSTIFIED by that weekend BBC iPlayer and website outage
Still doing 'forensics' on the caching layer – Beeb digi wonk
SHOCK and AWS: The fall of Amazon's deflationary cloud
Just as Jeff Bezos did to books and CDs, Amazon's rivals are now doing to it
BlackBerry: Toss the server, mate... BES is in the CLOUD now
BlackBerry Enterprise Services takes aim at SMEs - but there's a catch
The triumph of VVOL: Everyone's jumping into bed with VMware
'Bandwagon'? Yes, we're on it and so what, say big dogs
Carbon tax repeal won't see data centre operators cut prices
Rackspace says electricity isn't a major cost, Equinix promises 'no levy'
prev story

Whitepapers

Implementing global e-invoicing with guaranteed legal certainty
Explaining the role local tax compliance plays in successful supply chain management and e-business and how leading global brands are addressing this.
Consolidation: The Foundation for IT Business Transformation
In this whitepaper learn how effective consolidation of IT and business resources can enable multiple, meaningful business benefits.
Application security programs and practises
Follow a few strategies and your organization can gain the full benefits of open source and the cloud without compromising the security of your applications.
How modern custom applications can spur business growth
Learn how to create, deploy and manage custom applications without consuming or expanding the need for scarce, expensive IT resources.
Securing Web Applications Made Simple and Scalable
Learn how automated security testing can provide a simple and scalable way to protect your web applications.