Facebook tour reveals Open Compute Project in action

Facebook tour reveals Open Compute Project in action

Date: Jul 16, 2014

Facebook's Forest City, North Carolina data center isn't "cool" just because of the outside-air economizer or the colorful local art in the offices. The cool part is the Open Compute Project racks, servers and other equipment -- all of which could be in your data center in the future.

"Open source is the way to go," said Keven McCammon, data center manager for the location. "We've seen that in the software side of IT -- you get more out of it than you individually put in."

Open Compute Project (OCP) servers are standardized and stripped down to the necessities for easier repair and cooling -- no vanity cases here -- but that doesn't mean every row of racks is exactly the same. There are several generations of Open Compute racks in the data halls. Facebook refreshes IT hardware roughly every three years, depending on application and capacity needs.

Even if diagnosis is wrong, with so few parts, it's very quick to find the real problem.

Keven McCammon,
data center manager at Facebook

"Open Compute servers are easier to cool and [are] built to tolerate humidity," McCammon said.

The cold aisle averages 83 degrees Fahrenheit and relative humidity is around 65%. The hot aisle can reach 120 degrees F.

The architecture is also built for failure. During a Facebook tour this month, McCammon popped off network cables on a server and pulled it out of the rack. Any application attempting to use the resources on that blade will simply reroute to an available server. Even if a cluster were to go down, end users would probably not notice any lag, according to one employee at the data center.

"[Web traffic routing servers] can take a failure with no impact because of their redundancy," McCammon said. He then put the server back in place, prompting an automatic scan to verify nothing was broken. "The system then reaccepts it."

Facebook's homegrown data center management software also works in concert with the vanity-free OCP servers for fast repairs. The system diagnoses potential problem sources before the technician pulls the server. Memory, CPUs and networking cards come off the motherboard without any tools beyond a screwdriver for the heatsinks.

"Even if diagnosis is wrong, with so few parts, it's very quick to find the real problem," McCammon noted.

For provisioning, Facebook doesn't waste time installing one blade at a time. An integrator puts all the servers into a rack, and then the team rolls it into place, connects the power, connects the fiber and boots the servers.

The site, which represents about one-third of Facebook's hundreds of thousands of servers globally, uses one system administrator per roughly 20,000 servers.

Cold storage

Facebook's Open Compute Project

Microsoft joins 100+ members of OCP

Getting the most out of OCP

2014 OCP Summit recap

One of the three buildings in Forest City is dedicated to cold storage for very old user data. That photo of your breakfast in 2006, McCammon explained, remains available, but moves to an archival tier of storage.

Cold storage saves a lot of power on the back end. Since these racks are filled with standard OCP storage disks only active when writing or retrieving data, they require less aggressive cooling. The cold aisles here are even warmer than Facebook's standard. Facebook miniaturized its dehumidifying, filtration and air flow system developed on the traditional data halls into modular units for the cold storage halls.

Between its Forest City and Prineville, Oregon locations, all of Facebook's archival data is moving off higher-performance storage and into this energy-saving tier.

Continue your Facebook tour with a look at the data center's facilities, power and cooling.

Meredith Courtemanche is the site editor for SearchDataCenter.com. She edits tips and other content for the site, writes news stories and creates editorial guides.

More on x86 commodity rackmount servers

  • canderson

    Server Month wrap-up

    VIDEO - The conclusion of our Server Month coverage includes discussions on key 1U server features and capabilities, as well as pointers for those considering a purchase.
  • canderson

    Inside a Dell server

    VIDEO - In this video, you’ll get an in-depth look at the Dell PowerEdge R415 1U rack server, including a walk-through of the specs, interior and exterior of the system.
  • canderson

    Inside a Fujitsu server

    VIDEO - The Fujitsu Primergy RX200 S6 has features similar to other 1U servers in its class, but there are several unique aspects to its interior design that are noteworthy.
  • COTS servers signal better TCO than converged systems

    Tip - Enterprise IT shops have new choices: Converged systems simplify management and scaling, while commercial off-the-shelf servers tailor resources without vendor lock-in.
  • Applications dictate new server technologies

    News - Enterprise IT now has specific next-gen servers that are created by the workload and are fully customized. Has the future of servers arrived?

    ( Nov 13, 2014 )

  • The virtual GPU offloads intense processing to the data center

    Tip - Whether adding virtual GPU is going to be an expensive nicety or a core support pillar for the business comes down to the applications using it.
  • Meet the application-minded IT infrastructure architecture

    Tip - A core-and-pod architecture segments the data center's resources by application. Could your IT organization benefit from the scalability and automation that pods promise?
  • It's time for new data center servers

    Tip - Outdated data center servers can set your IT organization back, stifling business innovation and productivity. It's almost 2015 -- don't get caught with old hardware.

There are Comments. Add yours.

 
TIP: Want to include a code block in your comment? Use <pre> or <code> tags around the desired text. Ex: <code>insert code</code>

REGISTER or login:

Forgot Password?
By submitting you agree to receive email from TechTarget and its partners. If you reside outside of the United States, you consent to having your personal data transferred to and processed in the United States. Privacy
Sort by: OldestNewest

Forgot Password?

No problem! Submit your e-mail address below. We'll send you an email containing your password.

Your password has been sent to: