Inside the belly of the benchmark debate

Summary:David Berlind says Intel's benchmarks don't add up. George Ou disagrees.

David Berlind says Intel's benchmarks don't add up. George Ou disagrees. The debate on technology benchmarks--whether it's hardware related like Intel vs. AMD or software--is nearly endless.

This Talkback sums up the state of affairs with benchmarks:

When I look at almost any product I can think of, I would not trust the manufactures claims. Instead, I look for independent reviews. There are a number of sites that do real world usage benchmarks (Toms Hardware) and can provide a lot of information on how hardware performs on tasks that you, George, or I might do. That to me means vastly more than some sideways applied counting contest called a benchmark.

Anyhow, yes I agree, manufactures marketing spin in their claims are outlandish, that is why they should be ignored...

The big problem: Technology buyers don't have much beyond manufacturer claims. Benchmarking standards don't exist. Independent third parties are disappearing as tech trade magazines cut back on labs. Reviews are helpful, but benchmarks are still all over the map.

I'm not sure what the answers are to the benchmarking issue, but the problem needs to be fixed across the entire sector. Here's some required reading as we ponder what exactly that fix should be.

Topics: Processors

About

Larry Dignan is Editor in Chief of ZDNet and SmartPlanet as well as Editorial Director of ZDNet's sister site TechRepublic. He was most recently Executive Editor of News and Blogs at ZDNet. Prior to that he was executive news editor at eWeek and news editor at Baseline. He also served as the East Coast news editor and finance editor at CN... Full Bio

zdnet_core.socialButton.googleLabel Contact Disclosure

Kick off your day with ZDNet's daily email newsletter. It's the freshest tech news and opinion, served hot. Get it.

Related Stories

The best of ZDNet, delivered

You have been successfully signed up. To sign up for more newsletters or to manage your account, visit the Newsletter Subscription Center.
Subscription failed.