Facebook tour reveals Open Compute Project in action

Facebook tour reveals Open Compute Project in action

Facebook tour reveals Open Compute Project in action

Date: Jul 16, 2014

Facebook's Forest City, North Carolina data center isn't "cool" just because of the outside-air economizer or the colorful local art in the offices. The cool part is the Open Compute Project racks, servers and other equipment -- all of which could be in your data center in the future.

"Open source is the way to go," said Keven McCammon, data center manager for the location. "We've seen that in the software side of IT -- you get more out of it than you individually put in."

Open Compute Project (OCP) servers are standardized and stripped down to the necessities for easier repair and cooling -- no vanity cases here -- but that doesn't mean every row of racks is exactly the same. There are several generations of Open Compute racks in the data halls. Facebook refreshes IT hardware roughly every three years, depending on application and capacity needs.

Even if diagnosis is wrong, with so few parts, it's very quick to find the real problem.

Keven McCammon,
data center manager at Facebook

"Open Compute servers are easier to cool and [are] built to tolerate humidity," McCammon said.

The cold aisle averages 83 degrees Fahrenheit and relative humidity is around 65%. The hot aisle can reach 120 degrees F.

The architecture is also built for failure. During a Facebook tour this month, McCammon popped off network cables on a server and pulled it out of the rack. Any application attempting to use the resources on that blade will simply reroute to an available server. Even if a cluster were to go down, end users would probably not notice any lag, according to one employee at the data center.

"[Web traffic routing servers] can take a failure with no impact because of their redundancy," McCammon said. He then put the server back in place, prompting an automatic scan to verify nothing was broken. "The system then reaccepts it."

Facebook's homegrown data center management software also works in concert with the vanity-free OCP servers for fast repairs. The system diagnoses potential problem sources before the technician pulls the server. Memory, CPUs and networking cards come off the motherboard without any tools beyond a screwdriver for the heatsinks.

"Even if diagnosis is wrong, with so few parts, it's very quick to find the real problem," McCammon noted.

For provisioning, Facebook doesn't waste time installing one blade at a time. An integrator puts all the servers into a rack, and then the team rolls it into place, connects the power, connects the fiber and boots the servers.

The site, which represents about one-third of Facebook's hundreds of thousands of servers globally, uses one system administrator per roughly 20,000 servers.

Cold storage

Facebook's Open Compute Project

Microsoft joins 100+ members of OCP

Getting the most out of OCP

2014 OCP Summit recap

One of the three buildings in Forest City is dedicated to cold storage for very old user data. That photo of your breakfast in 2006, McCammon explained, remains available, but moves to an archival tier of storage.

Cold storage saves a lot of power on the back end. Since these racks are filled with standard OCP storage disks only active when writing or retrieving data, they require less aggressive cooling. The cold aisles here are even warmer than Facebook's standard. Facebook miniaturized its dehumidifying, filtration and air flow system developed on the traditional data halls into modular units for the cold storage halls.

Between its Forest City and Prineville, Oregon locations, all of Facebook's archival data is moving off higher-performance storage and into this energy-saving tier.

Continue your Facebook tour with a look at the data center's facilities, power and cooling.

Meredith Courtemanche is the site editor for SearchDataCenter.com. She edits tips and other content for the site, writes news stories and creates editorial guides.

More on x86 commodity rackmount servers

  • canderson

    Server Month wrap-up

    VIDEO - The conclusion of our Server Month coverage includes discussions on key 1U server features and capabilities, as well as pointers for those considering a purchase.
  • canderson

    Inside a Dell server

    VIDEO - In this video, you’ll get an in-depth look at the Dell PowerEdge R415 1U rack server, including a walk-through of the specs, interior and exterior of the system.
  • canderson

    Inside a Fujitsu server

    VIDEO - The Fujitsu Primergy RX200 S6 has features similar to other 1U servers in its class, but there are several unique aspects to its interior design that are noteworthy.
  • The FPGA server promises flexible app acceleration

    Tip - FPGAs offload tasks from server processors more flexibly than other accelerator options. Hyperscale data centers are keen to deploy the technology.
  • Why big data servers stay on-premises in data centers

    Feature - Compute- and I/O-intensive big data workloads won't stray to the cloud yet as security and existing infrastructure keep analytics in the data center.
  • Vendors race to provide big data infrastructure

    Feature - Enterprise big data workloads demand a lot from storage and network bandwidth. Storage, cloud and as-a-service vendors are developing the infrastructure to support them.
  • Small updates meet big data center requirements

    Tip - Not all IT infrastructure projects require a large budget and lengthy schedule. These relatively inexpensive updates boost performance and reliability.
  • The ARM-based server vies for first in your data center

    Tip - Are the alluring functions of ARM servers enough to cause a reshaping of data center operations? Or will the x86 server continue its domination?

There are Comments. Add yours.

TIP: Want to include a code block in your comment? Use <pre> or <code> tags around the desired text. Ex: <code>insert code</code>

REGISTER or login:

Forgot Password?
By submitting you agree to receive email from TechTarget and its partners. If you reside outside of the United States, you consent to having your personal data transferred to and processed in the United States. Privacy
Sort by: OldestNewest

Forgot Password?

No problem! Submit your e-mail address below. We'll send you an email containing your password.

Your password has been sent to: