Feeds

Facebook's open hardware: Does it compute?

Open hardware is not open source

Build a business case: developing custom apps

Server minimalism

The same minimalist design philosophy applies to the two motherboards that Facebook designed in conjunction with Quanta Computer, the Taiwanese ODM, which is also a PC and server maker in its own right. Facebook's workloads don't require a lot of peripheral expansion, so unnecessary slots are removed. The motherboards have CPU and memory voltage regulators that have in excess of 93 per cent efficiency, and the chassis is equipped with a power supply that runs at 94.5 per cent efficiency.

There's a 277 volt main power input and a 48 volt power input from backup batteries that are adjacent to the triple-wide 42U rack. That battery power is just to give Facebook's systems time to cut over from main power to generators without crashing in the event of a power failure.

Here's what the rack looks like:

Facebook Open Compute triple rack

The Facebook Open Compute triple rack

The triple rack has two top-of-rack switches at the top and can house 30 of the Open Compute servers in each column, for a total of 90 servers.

For the moment, Facebook has two motherboards, one based on Intel processors and chipsets and the other based on chips from Advanced Micro Devices. These machines are not, as we were speculating, micro servers, but as we pointed outk ahead of the Facebook launch, the company's Facebook Lab has only begun testing micro servers and did not expect to roll them until later in 2011 or 2012.

The Intel motherboard that Facebook has designed with Quanta to snap into the Open Compute chassis looks like this:

Facebook Open Compute Intel mobo

This Intel board uses the company's 5500 chipset and supports two quad-core Xeon 5500 or six-core Xeon 5600 processors; it can take any processor running 95 watts or cooler. It has nine memory slots per socket, for a maximum memory of 288GB using 16GB memory sticks. It has six SATA-II ports for linking to the drives, two external USB 2.0 ports and one internal for a flash-based hypervisor (not that Facebook virtualizes its workloads, but it could). It has three Gigabit Ethernet ports.

The AMD board is a bit beefier on the core and main memory:

Facebook Open Compute AMD mobo

This AMD option of the Open Compute mobo can support the Opteron 6100 processors with either eight or twelve cores. Only those chips with an ACP rating of 85 watts or less can be used in the chassis. Each G34 socket has a dozen memory slots, for a maximum of 384GB of main memory using 16GB memory sticks. This mobo uses AMD's SR5650/SP5100 chipset, and offers the same six SATA ports, USB ports, and Gigabit Ethernet ports as the Intel board.

Both the Intel and AMD boards can be operated in a single-CPU mode if a job that Facebook is running needs richer memory-to-compute ratio for a server node.

The upshot of the server design, according to Frank Frankovsky, director of hardware design and supply chain at Facebook, is that the Facebook servers cost about 20 per cent less than the boxes the company was previously using and have 22 per cent less metal and plastic in them. And when plugged into the Prineville data center, these servers consume 38 per cent less power.

Boost IT visibility and business value

More from The Register

next story
The Return of BSOD: Does ANYONE trust Microsoft patches?
Sysadmins, you're either fighting fires or seen as incompetents now
Microsoft: Azure isn't ready for biz-critical apps … yet
Microsoft will move its own IT to the cloud to avoid $200m server bill
Shoot-em-up: Sony Online Entertainment hit by 'large scale DDoS attack'
Games disrupted as firm struggles to control network
Cutting cancer rates: Data, models and a happy ending?
How surgery might be making cancer prognoses worse
Silicon Valley jolted by magnitude 6.1 quake – its biggest in 25 years
Did the earth move for you at VMworld – oh, OK. It just did. A lot
VMware's high-wire balancing act: EVO might drag us ALL down
Get it right, EMC, or there'll be STORAGE CIVIL WAR. Mark my words
prev story

Whitepapers

Implementing global e-invoicing with guaranteed legal certainty
Explaining the role local tax compliance plays in successful supply chain management and e-business and how leading global brands are addressing this.
Endpoint data privacy in the cloud is easier than you think
Innovations in encryption and storage resolve issues of data privacy and key requirements for companies to look for in a solution.
Scale data protection with your virtual environment
To scale at the rate of virtualization growth, data protection solutions need to adopt new capabilities and simplify current features.
Boost IT visibility and business value
How building a great service catalog relieves pressure points and demonstrates the value of IT service management.
High Performance for All
While HPC is not new, it has traditionally been seen as a specialist area – is it now geared up to meet more mainstream requirements?