IBM Symphony orchestrating technical and big data applications

Summary:Developing low latency orchestration tools that can accelerate technical and big data applications requires vast knowledge of cluster and grid computing dynamics. IBM just released the results of several benchmarks that demonstrates mastery of that arcane knowledge.

Rohit Valia, of IBM's Platform Computing group, stopped by the other day to fill me in on some outstanding technical computing and big data benchmark results that were generated using IBM Platform's Symphony and LSF products.  The results were impressive.

  • The Terasort benchmark ran 40 times faster using BigInsights and Platform Symphony 5.2
  • A MapReduce test ran 63 times faster with Platform Symphony 5.2 than a similar configuration that just used Apache MapReduce
  • The Berkley SWIM test ran 6 times faster using Hadoop 1.0.1 combined with Platform Symphony than Hadoop 1.0.1 could manage all by itself.

Snapshot analysis

When people want to show me the results of their benchmarks, I typically am reminded of a quote, "There are three kinds of lies: lies, damned lies, and statistics." that is often is attributed to either Benjamin Disraeli or Mark Twain. Had the author known about them, benchmarks would have most certainly been added to the list.

Regardless of who is actually responsible for that statement, it is often true that suppliers use and abuse benchmarks in the hopes of winning over potential customers even when the benchmark has little or nothing to do with the customer's proposed use of systems. Why do suppliers do this? It is because it is very difficult to know ahead of time how a cluster or grid computing solution is going to really perform until a specific workload is installed and used in real life.

Topics: Big Data, IBM


Daniel Kusnetzky, a reformed software engineer and product manager, founded Kusnetzky Group LLC in 2006. He is responsible for research, publications, and operations. Mr. Kusnetzky has been involved with information technology since the late 1970s. Mr. Kusnetzky has been responsible for research operations at the 451 Group; corporate and... Full Bio

Contact Disclosure

Kick off your day with ZDNet's daily email newsletter. It's the freshest tech news and opinion, served hot. Get it.

Related Stories

The best of ZDNet, delivered

You have been successfully signed up. To sign up for more newsletters or to manage your account, visit the Newsletter Subscription Center.
Subscription failed.