Wanted: Cloud infrastructure backed by SSDs

Wanted: Cloud infrastructure backed by SSDs

Summary: Netflix cloud architect Adrian Cockcroft wants faster input/output mechanisms in the cloud. Amazon Web Services' problem: SSDs don't massively scale yet.

SHARE:

Netflix is one of Amazon Web Services' biggest customers and services backed by solid state drives is No. 1 on its wish list.

That's the takeaway from Netflix cloud architect Adrian Cockcroft. In a Q&A with ZDNet UK's Jack Clark, Cockcroft kept coming back to the importance of faster input output mechanisms in the cloud. "I've been asking for SSDs in the cloud for some time," said Cockcroft.

He is getting some of that SSD love via Amazon Web Services' Dynamo DB, but Cockcroft wants more scale. Netflix has a data store architecture called Cassandra that dishes out streaming media to the masses. SSDs would help Netflix's cause.

The problem is that SSDs don't massively scale---something Amazon needs before it offers a service. As a result, AWS has instances for CPU, memory and network capacity for data centers, but the I/O is limited to disk. Cockcroft noted:

For Amazon to do something they have to do it on a scale that's really mind-boggling. If you think about deploying an infrastructure service with a new type of hardware — if they got it wrong, they can't turn it back out and do it again differently. So they have to over-engineer what they do.

In other words, Amazon could go SSD-happy with its Web services, but it's risky.

Cockcroft added:

Obviously I want SSDs in there. We've been asking cloud vendors to do that for a while. With Cassandra, we've had to go onto horizontal scale and use the internal disks and triple replicate across availability zones, so you end up with a triple-redundant data store that is careful not to overload the disks.

Related:

Topics: Networking, Amazon, Browser, Cloud, Data Centers, Enterprise Software, Hardware, Software, Storage

Kick off your day with ZDNet's daily email newsletter. It's the freshest tech news and opinion, served hot. Get it.

Talkback

6 comments
Log in or register to join the discussion
  • ssd's

    Hard to think why this company would want to incur astronomical (apple even) costs in replacing much larger drives for 320gig ssd's that will die faster than a HD will.
    Nate_K
  • Storage on ACID

    I operate some extremely fast Oracle clusters with multi-terabyte data-sets running exclusively on SSD. Once you've got it you've got to have it. Surprisingly we have not had the failure rate we thought we would have. The SSDs have performed better than traditional spindles. The only issue has been latency during WRITES which required more SSD devices just to spread the writes out and reduce the latency. Scalability is a HUGE issue. I would think that netflix would be using a database-driven filesystem on traditional spindles and then use something like flash-cache to maintain the performance since streaming is pretty much all reads with little to no writes. Of course, do it with *NIX for stability and performance and low overhead.
    dbeecher@...
  • the cloud

    not in this world the cloud is very bad so bad so NO NO NO NO NO NO
    ttx19
  • great

    this site help me a lot! www.windows7office2007.com
    sophia.123
  • i have no idea about that.

    but i just the this site is awesome: www.windows7office2007.com
    sophia.123
  • If the bandwidth is the greatest bottleneck,

    SSDs won't make much difference.
    HypnoToad72