Facebook tour reveals Open Compute Project in action

Facebook tour reveals Open Compute Project in action

Facebook tour reveals Open Compute Project in action

Date: Jul 16, 2014

Facebook's Forest City, North Carolina data center isn't "cool" just because of the outside-air economizer or the colorful local art in the offices. The cool part is the Open Compute Project racks, servers and other equipment -- all of which could be in your data center in the future.

"Open source is the way to go," said Keven McCammon, data center manager for the location. "We've seen that in the software side of IT -- you get more out of it than you individually put in."

Open Compute Project (OCP) servers are standardized and stripped down to the necessities for easier repair and cooling -- no vanity cases here -- but that doesn't mean every row of racks is exactly the same. There are several generations of Open Compute racks in the data halls. Facebook refreshes IT hardware roughly every three years, depending on application and capacity needs.

Even if diagnosis is wrong, with so few parts, it's very quick to find the real problem.

Keven McCammon,
data center manager at Facebook

"Open Compute servers are easier to cool and [are] built to tolerate humidity," McCammon said.

The cold aisle averages 83 degrees Fahrenheit and relative humidity is around 65%. The hot aisle can reach 120 degrees F.

The architecture is also built for failure. During a Facebook tour this month, McCammon popped off network cables on a server and pulled it out of the rack. Any application attempting to use the resources on that blade will simply reroute to an available server. Even if a cluster were to go down, end users would probably not notice any lag, according to one employee at the data center.

"[Web traffic routing servers] can take a failure with no impact because of their redundancy," McCammon said. He then put the server back in place, prompting an automatic scan to verify nothing was broken. "The system then reaccepts it."

Facebook's homegrown data center management software also works in concert with the vanity-free OCP servers for fast repairs. The system diagnoses potential problem sources before the technician pulls the server. Memory, CPUs and networking cards come off the motherboard without any tools beyond a screwdriver for the heatsinks.

"Even if diagnosis is wrong, with so few parts, it's very quick to find the real problem," McCammon noted.

For provisioning, Facebook doesn't waste time installing one blade at a time. An integrator puts all the servers into a rack, and then the team rolls it into place, connects the power, connects the fiber and boots the servers.

The site, which represents about one-third of Facebook's hundreds of thousands of servers globally, uses one system administrator per roughly 20,000 servers.

Cold storage

Facebook's Open Compute Project

Microsoft joins 100+ members of OCP

Getting the most out of OCP

2014 OCP Summit recap

One of the three buildings in Forest City is dedicated to cold storage for very old user data. That photo of your breakfast in 2006, McCammon explained, remains available, but moves to an archival tier of storage.

Cold storage saves a lot of power on the back end. Since these racks are filled with standard OCP storage disks only active when writing or retrieving data, they require less aggressive cooling. The cold aisles here are even warmer than Facebook's standard. Facebook miniaturized its dehumidifying, filtration and air flow system developed on the traditional data halls into modular units for the cold storage halls.

Between its Forest City and Prineville, Oregon locations, all of Facebook's archival data is moving off higher-performance storage and into this energy-saving tier.

Continue your Facebook tour with a look at the data center's facilities, power and cooling.

Meredith Courtemanche is the site editor for SearchDataCenter.com. She edits tips and other content for the site, writes news stories and creates editorial guides.

More on x86 commodity rackmount servers

  • canderson

    Server Month wrap-up

    VIDEO - The conclusion of our Server Month coverage includes discussions on key 1U server features and capabilities, as well as pointers for those considering a purchase.
  • canderson

    Inside a Dell server

    VIDEO - In this video, you’ll get an in-depth look at the Dell PowerEdge R415 1U rack server, including a walk-through of the specs, interior and exterior of the system.
  • canderson

    Inside a Fujitsu server

    VIDEO - The Fujitsu Primergy RX200 S6 has features similar to other 1U servers in its class, but there are several unique aspects to its interior design that are noteworthy.
  • Avoid common server racking issues

    Tip - Increasing physical demands of modern IT gear can pose problems for classic rack enclosures. Watch for these factors when buying new racks or equipment.
  • Rethinking data center components as commodities

    Feature - Labeling servers and hypervisors as commodities like corn and cattle may be overly simplistic. It's time to reconsider what constitutes a commodity.
  • Virtualized firewall servers and other bad ideas

    Tip - Virtualization is a great idea, but not for everything in the data center. Even if your goal is 100% virtualization, leave these servers off the list.
  • What's the best way to get a server benchmark?

    Answer - What is the best way to access large multicore servers for benchmarking? How do I know what needs to be benchmarked?
  • Can I use a transformer that doesn't match my high-voltage server?

    Answer - The specs of the 480-V power equipment are all the same as a 400-V step-up transformer. The only difference is voltage. Can we use the 480-V transformer with 400-V servers?

There are Comments. Add yours.

TIP: Want to include a code block in your comment? Use <pre> or <code> tags around the desired text. Ex: <code>insert code</code>

REGISTER or login:

Forgot Password?
By submitting you agree to receive email from TechTarget and its partners. If you reside outside of the United States, you consent to having your personal data transferred to and processed in the United States. Privacy
Sort by: OldestNewest

Forgot Password?

No problem! Submit your e-mail address below. We'll send you an email containing your password.

Your password has been sent to: