Intel gives Facebook the D – Xeons thrust web pages at the masses

System designs and software libraries published

By Chris Williams, Editor in Chief

Posted in Servers, 10th March 2015 19:15 GMT

Open Compute Summit Facebook is using Intel's Xeon D processors to build stacks of web servers for the 1.39 billion people who visit the social network every month.

The OpenRack server design is codenamed Yosemite, is pictured above, and is available for anyone to use under the OpenCompute project. The hardware "dramatically increases speed and more efficiently serves Facebook traffic," the website's engineers boast.

Each sled holds four boards, and on each board sits a single Xeon D-1540 processor package with its own RAM and flash storage. That D-1540 part features eight cores (16 threads) running at 2GHz, plus two 10Gb Ethernet ports, PCIe and other IO.

Each processor consumes up to 65W, 90W for the whole server card, and 400W (TDP) for a full sled. A single rack can hold 48 sleds, which adds up to 192 Xeon Ds and 1,536 Broadwell cores. The Yosemite motherboard has a 50Gb/s multi-host network interconnect that hooks the four CPU boards through a single Ethernet port.

The key thing is that this design is easier for Facebook's software engineers to program. Each independent server is essentially a single socket processor with its own RAM, storage and NIC, whereas previous designs are two-socket affairs. The single-socket design gets rid of all the NUMA headaches present in a two-socket system, when writing and tuning multi-threaded code to generate and serve web pages.

"We took a look at our heavy workloads ... and the challenges with balancing NUMA, and came up with Yosemite," Jay Parikh, Facebook's veep of engineering, told The Register at the OpenCompute Summit today in San Jose, California.

"There are four trays, and each tray has a one-socket computer in it. This is a four-in-one design for each sled. Each card has a CPU, memory and SSD, so you can boot it up as a server.

"890 million people visit Facebook on mobile every day. We have to build the infrastructure to support this."

Halving the socket count also cuts power consumption, we're told, and reduces the footprint of each server. Parikh added that Facebook's data centers are "100 per cent" powered by OpenCompute gear, and has saved the biz $2bn in the past three years in terms of energy saved, and so on.

Facebook and Intel have apparently been working on using Xeon Ds for the past couple of years while, in the background, the social network has been toying with the idea of using dense ARM-powered system-on-chips for front-end servers. So far, it seems, Intel is winning out.

"We started experimenting with SoCs about two years ago. At that time, the SoC products on the market were mostly lightweight, focusing on small cores and low power," said Facebook hardware design engineer Harry Li.

"Most of them were less than 30W. Our first approach was to pack up to 36 SoCs into a 2U enclosure, which could become up to 540 SoCs per rack.

"But that solution didn't work well because the single-thread performance was too low, resulting in higher latency for our web platform. Based on that experiment, we set our sights on higher-power processors while maintaining the modular SoC approach."

Of the more than 50 design wins that Intel has thus far for the Xeon Ds, only a quarter of them are for microservers and three quarters of them are for network, storage, and IoT devices ...

In other developments

Sign up to our NewsletterGet IT in your inbox daily


More from The Register

Facebook smartmobe app's pre-ticked privacy settings violate German data protection law

Court favours consumer group in long-running dispute

Facebook confesses: Facebook is bad for you

Grazing FB is ruining your life, admits social network after probing its army of addicts

Hey, we've toned down the 'destroying society' shtick, Facebook insists

The Social Network rises to criticism from former exec

Team Trump goes in to bat for Google and Facebook

What swamp?

Sky customer dinged for livestreaming pay-per-view boxing to Facebook

It's a mystery how they found out. Call Sherlock

EU court to rule whether Facebook should seek and destroy hate speech

Austrian lawmakers bump up row over criminal content

Facebook helping devs keep up with TLS certificates

Crawling transparency logs, so you don't need to

Facebook's big solution to combating election ad fraud: Snail mail

Lo-tech brainwave 'won't solve everything', says biz

Facebook's send-us-your-nudes service is coming to UK, America

Pre-emptive perv to defang revenge pr0nz peddlers

Suspicion of villainy leads Facebook to ban cryptocoin ads

‘Many companies advertising ICOs and cryptocurrencies are not operating in good faith’