Q
Get started Bring yourself up to speed with our introductory content.

What's the best way to get a server benchmark?

What is the best way to access large multicore servers for benchmarking? How do I know what needs to be benchmarked?

Today's servers come in a variety of flavors, performance levels and prices, but figuring out value to your specific...

operations poses a difficult question for admins.

A challenge for any data center administrator is figuring the return on investment on a server. Will a 16-core server run my application fast enough to justify the steep price compared to fewer-core models?

This is a tough question. A server's performance isn't just driven by core count and gigahertz: Memory size, cache size and disk I/O have a major influence on performance, as does network speed in many use cases. A server benchmark enables better side-by-side comparisons of real-world performance than datasheets from competitive vendors.

Assuming we know what we need to benchmark -- usually an existing application used by the business -- the hard part is finding a server to run tests on.

The first step is to check if you need to run your own server benchmark. Software vendors, especially in high-performance computing, like to know what their applications can achieve in terms of performance, and may already recommend server configurations complete with benchmark results.

For popular apps, the server vendor may already have a set of numbers from its own benchmarking lab. Compare these results from as evenly matched benchmark tests on competitive systems as possible. On most x64 machines, the processors derive from the same Intel/AMD reference design, so the same configuration benchmarks almost identically. In this case, the benchmark can come from a different server vendor than the one with the best deal.

Without vendor benchmarks, you need to get a server or cluster. The vendor might provide a loaner system for benchmark tests if your total purchase is priced high for a low volume of systems, such as a server loaded with solid-state direct-attached storage. If you're buying just a handful of average-cost servers, consider calling upon a long-standing relationship with the vendor or their channel representative.

Beyond a physical machine to benchmark, the cloud is an obvious place to look. High-core count instances are hard to find on cloud hosts, and the likelihood of finding the exact server model that you want to buy is low. If current-generation machines that are close to your prospective purchase are available as cloud instances, use one of those and extrapolate from the results. For example, Nvidia's GPU instances are available as a service.

About the author:
Jim O'Reilly is a consultant focused on storage and cloud computing. He was vice president of engineering at Germane Systems, where he created ruggedized servers and storage for the U.S. submarine fleet. He has also held senior management positions at SGI/Rackable and Verari; was CEO at startups Scalant and CDS; headed operations at PC Brand and Metalithic; and led major divisions of Memorex-Telex and NCR, where his team developed the first SCSI ASIC, now in the Smithsonian.

Next Steps

Benchmark testing best practices

Big Blue benchmark tests SSDs

This was last published in March 2015

PRO+

Content

Find more PRO+ content and other member only offers, here.

Essential Guide

Server performance and benchmark testing guide

Have a question for an expert?

Please add a title for your question

Get answers from a TechTarget expert on whatever's puzzling you.

You will be able to add details on the next page.

Join the conversation

4 comments

Send me notifications when other members comment.

By submitting you agree to receive email from TechTarget and its partners. If you reside outside of the United States, you consent to having your personal data transferred to and processed in the United States. Privacy

Please create a username to comment.

What performance metrics do you benchmark servers against?
Cancel
The first, of course, is the reliability or up-time capabilities. I want a server with a longer and more reliable up-time. Then there is the aspect of Processor speed. It's only good for me for my server to have a muscular processor for fast processing of data, and again this is because the third metric is storage capacity which I always prefer to adequately handle my storage needs and be upgradable whenever necessary.
Cancel
Uptime, processor speed, network speed, storage and latency. Those are the key five. If those are inadequate, the entire experience is inadequate.
Cancel
Usually, it is important to know the reputation of the business being benchmarked, to save time.
Cancel

-ADS BY GOOGLE

SearchWindowsServer

SearchServerVirtualization

SearchCloudComputing

Close