Data Centre

Networks

The Social Network™ releases its data networking code

Open/R distributed router software goes open source, with Juniper, Arista aboard

By Richard Chirgwin

10 SHARE

Facebook has sent another shiver running up Cisco's spine, by releasing the code it uses for packet routing.

Open/R, its now-open source routing platform, runs Facebook's backbone and data centre networks. The Social Network™ first promised to release the platform in May 2017.

In the post that announced the release, Facebook said it began developing Open/R for its Terragraph wireless system, but since applied it to its global fibre network, adding: “we are even starting to roll it out into our data center fabrics, running inside FBOSS and on our Open Compute Project networking hardware like Wedge 100.”

Apart from Facebook's internal platforms, the company launched Open/R with support from third-party vendors including:

Facebook said in the post that while working on Open/R with Terragraph, it decided it needed a distributed networking platform to get over the shortcomings of both Layer 2 protocols for large networks (lacking resiliency) and Layer 3 protocols (“poorly suited to highly variable and dynamic outdoor conditions”).

“Thus, we designed Open/R to be the distributed networking platform on top of the Terragraph network that could cope with its large scale and rapid changes, and allow for fast extensibility”, the post said.

Those features also made Open/R suitable to control traffic and routing across the Express Backbone it built in May.

“Instead of using a traditional routing protocol such as IS-IS, we decided to introduce Open/R into the Express Backbone as the distributed control plane for the network, where it would work together with a centralised controller. Here, Open/R provides basic connectivity in a network, fast reactions to network events, and a "distributed information bus" to export new information to the controller and agents on the network nodes.”

Open/R uses a database as the control plane rather than a routing protocol (as noted on slide 10 of this IETF presentation by Tom Herbert of Quantonium and Petr Lapukhov – a co-author of the announcement – describing a proposed IPv6 location identifier standard).

Open/R architecture

The image below shows the key architectural components.

Open/R architecture. Click to embiggen.

The KV-STORE – key-value store – is replicated around the network for distributed communications and state replication; Spark handles neighbour discovery and reporting.

LinkMonitor's role is probably self-explanatory, PrefixManager handles “automatic prefix suballocation”, Decision is the route information computer, FIB is the route programming proxy, and Platform “implements route programming and interface discovery logic for the target hardware platform.”

So engineers don't need to put live networks at risk, Open/R offers an emulation environment: a systemd-nspawn wrapper. This, Facebook wrote, “starts thousands of Linux containers and forms a mesh of tunnels among them with a single command”, so engineers can test the impact of latency, jitter, and packet loss.

The distributed state database lets an administrator view current network state from any node on the network, watching over activity like nodes connecting, adjacencies tearing down, or metric values changing.

For functions that need a centralised controller, the post said, “Open/R provides APIs allowing remote agents to learn the link state or subscribe to database updates, such as notifications of a link capacity change”.

Other features Facebook listed include:

The post also said Open/R includes “many features similar to those found in IS-IS (intermediate system to intermediate system) and OSPF (open shortest path first).

Open/R's GitHub repository is here. ®

Sign up to our NewsletterGet IT in your inbox daily

10 Comments

More from The Register

Facebook suggests mm-wave spectrum should be free in Australia

Hints at multi-gig wireless, which should get nbn™ - and government - feeling nervous

Vodafone sues Ofcom to reclaim 'overpaid' mobe spectrum fees

EE set it up, now Voda's shooting for goal

Facebook's new always-listening home appliance kit Portal doesn't do Facebook

Trust us, pleads the Zuck

Oracle gets busy with Lazy FPU fix, adds more CPU Spectre-protectors

Oracle Linux and VM get their innoculations

ZX Spectrum reboot firm boss delays director vote date again

Vega+ scandal lingers as desperate board delays crunch-time vote again

High-end router flinger DrayTek admits to zero day in bunch of Vigor kit

'It may be possible for an attacker to intercept your router'

If you haven't already patched your MikroTik router for vulns, then if you could go do that, that would be greeeeaat

MikroTik. Stupid name. Stupid bugs. Get those fixes

O2 wolfs down entire 4G spectrum as pals fiddle with their shiny 5G band

UK mobe operators fling £1.3bn at Ofcom auction

Ofcom gives six operators green light to bid for spectrum

Includes Hull-based Connexin and US subsidiary Airspan

Oracle Database 18: Now in downloadable Linux flavour

Oh, and Windows, but cool kids don't use that