Data Centre


Intel gives Facebook the D – Xeons thrust web pages at the masses

System designs and software libraries published

By Chris Williams, Editor in Chief


Open Compute Summit Facebook is using Intel's Xeon D processors to build stacks of web servers for the 1.39 billion people who visit the social network every month.

The OpenRack server design is codenamed Yosemite, is pictured above, and is available for anyone to use under the OpenCompute project. The hardware "dramatically increases speed and more efficiently serves Facebook traffic," the website's engineers boast.

Each sled holds four boards, and on each board sits a single Xeon D-1540 processor package with its own RAM and flash storage. That D-1540 part features eight cores (16 threads) running at 2GHz, plus two 10Gb Ethernet ports, PCIe and other IO.

Each processor consumes up to 65W, 90W for the whole server card, and 400W (TDP) for a full sled. A single rack can hold 48 sleds, which adds up to 192 Xeon Ds and 1,536 Broadwell cores. The Yosemite motherboard has a 50Gb/s multi-host network interconnect that hooks the four CPU boards through a single Ethernet port.

The key thing is that this design is easier for Facebook's software engineers to program. Each independent server is essentially a single socket processor with its own RAM, storage and NIC, whereas previous designs are two-socket affairs. The single-socket design gets rid of all the NUMA headaches present in a two-socket system, when writing and tuning multi-threaded code to generate and serve web pages.

"We took a look at our heavy workloads ... and the challenges with balancing NUMA, and came up with Yosemite," Jay Parikh, Facebook's veep of engineering, told The Register at the OpenCompute Summit today in San Jose, California.

"There are four trays, and each tray has a one-socket computer in it. This is a four-in-one design for each sled. Each card has a CPU, memory and SSD, so you can boot it up as a server.

"890 million people visit Facebook on mobile every day. We have to build the infrastructure to support this."

Halving the socket count also cuts power consumption, we're told, and reduces the footprint of each server. Parikh added that Facebook's data centers are "100 per cent" powered by OpenCompute gear, and has saved the biz $2bn in the past three years in terms of energy saved, and so on.

Facebook and Intel have apparently been working on using Xeon Ds for the past couple of years while, in the background, the social network has been toying with the idea of using dense ARM-powered system-on-chips for front-end servers. So far, it seems, Intel is winning out.

"We started experimenting with SoCs about two years ago. At that time, the SoC products on the market were mostly lightweight, focusing on small cores and low power," said Facebook hardware design engineer Harry Li.

"Most of them were less than 30W. Our first approach was to pack up to 36 SoCs into a 2U enclosure, which could become up to 540 SoCs per rack.

"But that solution didn't work well because the single-thread performance was too low, resulting in higher latency for our web platform. Based on that experiment, we set our sights on higher-power processors while maintaining the modular SoC approach."

Of the more than 50 design wins that Intel has thus far for the Xeon Ds, only a quarter of them are for microservers and three quarters of them are for network, storage, and IoT devices ...

In other developments

Sign up to our NewsletterGet IT in your inbox daily


More from The Register

Facebook's new always-listening home appliance kit Portal doesn't do Facebook

Trust us, pleads the Zuck

Facebook sued for exposing content moderators to Facebook

Updated Endless series of beheadings and horrible images take mental toll, US lawsuit claims

Facebook's Sheryl Sandberg can't remember smear firm, but 'some of their work' crossed her desk

Outgoing comms chief post gets FB treatment

Facebook pulls 'snoopy' Onavo VPN from Apple's App Store after falling foul of rules

Cupertino banned software that slurps data for marketing

Go Zuck Yourself: Facebook destroys patent suit over timeline

Chalk one up in court for the Social Network

Facebook gives third-party apps the all-clear

Social network says SSO-slurping miscreants didn't reuse tokens on third-party apps

Sorry, we haven't ACLU what happened in sealed 'Facebook decryption' case, but let's find out

American Civil Liberties Union wants to know what govt asked for, and why court refused

Facebook flat-out 'lies' about how many people can see its ads – lawsuit

'Made-up PR numbers' used by social giant to exaggerate online advertising audience

Stop us if you've heard this one: Facebook apologizes for bug leaking private photos

Data gathering biz still having trouble keeping data secure

Facebook Onavo Protect doesn't protect against Facebook

VPN app collects all sorts of details