Data Centre

Servers

Intel gives Facebook the D – Xeons thrust web pages at the masses

System designs and software libraries published

By Chris Williams, Editor in Chief

7 SHARE

Open Compute Summit Facebook is using Intel's Xeon D processors to build stacks of web servers for the 1.39 billion people who visit the social network every month.

The OpenRack server design is codenamed Yosemite, is pictured above, and is available for anyone to use under the OpenCompute project. The hardware "dramatically increases speed and more efficiently serves Facebook traffic," the website's engineers boast.

Each sled holds four boards, and on each board sits a single Xeon D-1540 processor package with its own RAM and flash storage. That D-1540 part features eight cores (16 threads) running at 2GHz, plus two 10Gb Ethernet ports, PCIe and other IO.

Each processor consumes up to 65W, 90W for the whole server card, and 400W (TDP) for a full sled. A single rack can hold 48 sleds, which adds up to 192 Xeon Ds and 1,536 Broadwell cores. The Yosemite motherboard has a 50Gb/s multi-host network interconnect that hooks the four CPU boards through a single Ethernet port.

The key thing is that this design is easier for Facebook's software engineers to program. Each independent server is essentially a single socket processor with its own RAM, storage and NIC, whereas previous designs are two-socket affairs. The single-socket design gets rid of all the NUMA headaches present in a two-socket system, when writing and tuning multi-threaded code to generate and serve web pages.

"We took a look at our heavy workloads ... and the challenges with balancing NUMA, and came up with Yosemite," Jay Parikh, Facebook's veep of engineering, told The Register at the OpenCompute Summit today in San Jose, California.

"There are four trays, and each tray has a one-socket computer in it. This is a four-in-one design for each sled. Each card has a CPU, memory and SSD, so you can boot it up as a server.

"890 million people visit Facebook on mobile every day. We have to build the infrastructure to support this."

Halving the socket count also cuts power consumption, we're told, and reduces the footprint of each server. Parikh added that Facebook's data centers are "100 per cent" powered by OpenCompute gear, and has saved the biz $2bn in the past three years in terms of energy saved, and so on.

Facebook and Intel have apparently been working on using Xeon Ds for the past couple of years while, in the background, the social network has been toying with the idea of using dense ARM-powered system-on-chips for front-end servers. So far, it seems, Intel is winning out.

"We started experimenting with SoCs about two years ago. At that time, the SoC products on the market were mostly lightweight, focusing on small cores and low power," said Facebook hardware design engineer Harry Li.

"Most of them were less than 30W. Our first approach was to pack up to 36 SoCs into a 2U enclosure, which could become up to 540 SoCs per rack.

"But that solution didn't work well because the single-thread performance was too low, resulting in higher latency for our web platform. Based on that experiment, we set our sights on higher-power processors while maintaining the modular SoC approach."

Of the more than 50 design wins that Intel has thus far for the Xeon Ds, only a quarter of them are for microservers and three quarters of them are for network, storage, and IoT devices ...
Read more on

In other developments

Sign up to our NewsletterGet IT in your inbox daily

7 Comments

More from The Register

Facebook Onavo Protect doesn't protect against Facebook

VPN app collects all sorts of details

Sueballs flying over Facebook's Android app data slurping

Class action seeks a Zuck-ton of money for privacy invasion

Facebook's Trending news box follows fired freelancers out the door

Banishment comes after bias investigation that found nothing

Facebook stuck with IRS bill after court tosses $7 BEEELLION appeal

Not even Zuckerberg can escape the tax man

Facebook Android app caught seeking 'superuser' clearance

Updated And what reason would you have not to trust Facebook with your personal data?

Facebook tells users to report crappy customer service from advertisers

Threatens to ban ads from businesses with low marks

Facebook sends lowly minions to placate Euro law makers over data-slurp scandal

We wanted actual C-suiters, growls EU committee

The hits keep coming for Facebook: Web giant made 14m people's private posts public

Latest privacy gaffe is nothing if not impeccably timed

Facebook back in court fighting claims it nicked British data centre IP

UK-based BladeRoom's founder airs grievances

Commonwealth Games are just the ticket for Facebook

Free Wi-Fi will be lousy without a Social Network™ login, which in this of all weeks is just dumb