Data Centre


IETF doc seeks reliable vSwitch benchmark

Once switches become just another function to spawn, you'll need to know how they'll fare

By Richard Chirgwin


If you fancy wrapping your mind around the complexities that make virtual switches (vSwitches) hard to benchmark, an IETF informational RFC is worth a read.

Put together by Maryam Tahhan and Billy O'Mahony of Intel (note the usual disclaimer that RFCs are the work of individuals not employers) and Al Morton of AT&T, RFC 8204 is designed to help test labs get repeatable, reliable vSwitch benchmarks.

It's part of the ongoing work of the OpenNFV VSperf (vSwitch Performance) project group, which wants to avoid the kind of misunderstanding that happens when people set up tests that suit themselves.

The world of the vSwitch needs benchmarking, if for no other reason than for data centre designers to work out how much punch servers will need to match a physical switch, which is going to be important if switches become just another virtual service to be spun up as needed.

As the RFC notes: “A key configuration aspect for vSwitches is the number of parallel CPU cores required to achieve comparable performance with a given physical device or whether some limit of scale will be reached before the vSwitch can achieve the comparable performance level.”

And that's a knotty problem, because a vSwitch has available to it all of the knobs, buttons, levers and tweaks a sysadmin can apply to the server that hosts it.

Moreover, as they note, benchmarks have to be repeatable. Since the switches will likely run as VMs on commodity servers, there's a bunch of configuration parameters tests should capture that nobody bothers with when they're testing how fast a 40 Gbps Ethernet can pass packets port-to-port.

The current kitchen-sink list includes (for hardware) BIOS data, power management, CPU microcode level, the number of cores enabled and how many of those were used in a test, memory type and size, DIMM configurations, various network interface card details, and PCI configuration.

There's an even-longer list of software details: think “everything from the bootloader up”.

Not to mention that in the virtualized world, we're supposed to assume that a host runs lots of processes – even if that would take a benchmark standard down one rabbit hole too many.

“It's unlikely that the virtual switch will be the only application running on the system under test (SUT)”, the RFC notes, “so CPU utilization, cache utilization, and memory footprint should also be recorded for the virtual implementations of internetworking functions.

“However, internally measured metrics such as these are not benchmarks; they may be useful for the audience … to know and may also be useful if there is a problem encountered during testing.”

VSperf is documented here. ®

Sign up to our NewsletterGet IT in your inbox daily

Post a comment

More from The Register

HPC botherer DDN breaks file system benchmark record

Runs SPEC SFS 2014 software builds 25% faster than E8 Optane system

Colt, Verizon show off inter-carrier SDN

Care for some extra bandwidth? Just turn the knob

Open-source software supply chain vulns have doubled in 12 months

Hackers 'mainlining' vulns into projects – report

Desktop virtualisation kit-calculator goes open source

Andre Leibovici's out of time, so it's your turn to step up

Redis has a license to kill: Open-source database maker takes some code proprietary

It's 'cuz cloud giants use tools without giving anything back

Open Source Security hit with bill for defamation claim

Judge okays $260K in defense costs to Bruce Perens and lawyers under anti-SLAPP

SUSE punts SES v5.5 out door, says storage is going software-defined and open source

Don't mind us, just having a Linux moment

Boffins are building an open-source secure enclave on RISC-V

Open source trusted execution component expected this fall

E8 Storage Optanes top slot in SPEC file server benchmark

Fastest software builds – if you go by benchmarks

I got 257 problems, and they're all open source: Report shines light on Wild West of software

It's like a jungle sometimes, it makes me wonder how I keep from going under