Between the Lines

Larry Dignan, Andrew Nusca and Rachel King

Amazon Web Services tackles high performance computing instances

By | July 12, 2010, 9:01pm PDT

Summary: Amazon Web Services will launch compute clusters for high-performance computing applications like genomic research.

Amazon Web Services on Tuesday will launch compute clusters for high-performance computing applications like genomic research.

The offering, dubbed Cluster Compute Instances for Amazon EC2, is designed for intensive computational workloads like parallel processes used by the likes of Lawrence Berkeley National Laboratory for research.

High-performance computing (HPC) is a competitive space that’s closely watched for jaw-dropping throughput and speeds. With its move into HPC, AWS is looking to capture some of the market typically dominated by the likes of HP, Cray and IBM with their supercomputers. AWS reps say that customers have been asking for instances to run complex computing workloads.

Amazon Web Services’ (AWS) cluster computing move will either be an interesting showpiece for a limited market or end up democratizing supercomputing. In the meantime, Lawrence Berkeley National Labs was a early tester of AWS’ Cluster Compute Instances. AWS’ HPC service features pay-as-you-go pricing and the ability to scale up or down on demand. These cluster computer instances operate the same as Amazon’s Elastic Compute Cloud.

According to AWS, Cluster Compute Instances will run $1.60 per instance hour. A one-year reserved instance will be $4,290 upfront and carry a usage price of 56 cents an hour per instance. A three-year reserved instance will be $6,590 upfront and 56 cents an hour per instance. In a blog post, AWS said that each Cluster Compute Instance consists of a pair of quad-core Intel “Nehalem” X5570 processors with a total of 33.5 ECU (EC2 Compute Units), 23 GB of RAM, and 1690 GB of local instance storage.

The big difference is speed. AWS’ says that applications on its HPC instances can garner 10 times the network throughput of its largest EC2 versions. In a statement, Peter De Santis, general manager of Amazon EC2, said “in our last pre-production test run, we saw an 880 server sub-cluster achieve a network rate of 40.62 TFlop.” AWS says it hasn’t tried to establish a theoretical peak load, a metric that’s watched in the supercomputer rankings, but larger clusters would provide more performance.

AWS said in its blog that its HPC system would rank 146 on the Supercomputer Top 500 list.

We ran the gold-standard High Performance Linpack benchmark on 880 Cluster Compute instances (7040 cores) and measured the overall performance at 41.82 TeraFLOPS using Intel’s MPI (Message Passing Interface) and MKL (Math Kernel Library) libraries, along with their compiler suite. This result places us at position 146 on the Top500 list of supercomputers.

Overall, Amazon’s cluster computing efforts fit in with its other large-scale efforts such as public data sets and services to popularize Hadoop, a tool to analyze a lot of data.

Related:

Kick off your day with ZDNet's daily e-mail newsletter. It's the freshest tech news and opinion, served hot. Get it.

Larry Dignan is Editor in Chief of ZDNet and SmartPlanet as well as Editorial Director of ZDNet's sister site TechRepublic.

Disclosure

Larry Dignan

Larry Dignan has nothing to disclose. He doesn’t hold investments in the technology companies he covers.

Biography

Larry Dignan

Larry Dignan is Editor in Chief of ZDNet and SmartPlanet as well as Editorial Director of ZDNet's sister site TechRepublic. He was most recently Executive Editor of News and Blogs at ZDNet. Prior to that he was executive news editor at eWeek and news editor at Baseline. He also served as the East Coast news editor and finance editor at CNET News.com. Larry has covered the technology and financial services industry since 1995, publishing articles in WallStreetWeek.com, Inter@ctive Week, The New York Times, and Financial Planning magazine. He's a graduate of the Columbia School of Journalism and the University of Delaware.

For daily updates, follow Larry on Twitter.

Talkback - Tell Us What You Think

Formatting +
BB Codes - Note: HTML is not supported in forums
  • [b] Bold [/b]
  • [i] Italic [/i]
  • [u] Underline [/u]
  • [s] Strikethrough [/s]
  • [q] "Quote" [/q]
  • [ol][*] 1. Ordered List [/ol]
  • [ul][*] · Unordered List [/ul]
  • [pre] Preformat [/pre]
  • [quote] "Blockquote" [/quote]

The best of ZDNet, delivered

ZDNet Newsletters

Get the best of ZDNet delivered straight to your inbox

Facebook Activity

White Papers, Webcasts, & Resources