7 important survival tips Amazon's orphaned 0.07 percent can teach us

By | April 27, 2011, 4:32am PDT

Summary: Service Level Agreements won’t save your butt when the technology’s out to get you.

Cloud technology is hard to build. Even if you’re a company with all the cloud experience of Amazon.com (probably one of the two biggest brain trusts on the planet for cloud implementation), making it all work can be a challenge.

Yesterday, the Register reported that about 0.07 per cent of Amazon’s lost EBS storage volumes in the East Region of its infrastructure cloud are not fully recoverable.

In other words, some data is permanently lost.

This, of course, is in reference to Amazon’s devastating cloud failure last week.

See also: Seven lessons to learn from Amazon’s outage

See also: Amazon Web Services outage: ‘Detailed post mortem’ coming

If there’s any one company you would think you could trust with your data, it’d be Amazon. Even more than Google — who’s likely to hold your data, and then subject it to some sort of inhuman scrutiny, trying to extract the unified field theory, the meaning of life, and what your favorite breakfast cereal is from the data stored in your online documents — Amazon has always seemed to be the most trusted keeper of the sacred cloud.

But those who fly too high are apparently destined to fall to Earth, and Amazon’s cloud hid within it not just a silver lining, but bolts of lightning.

[It's at this point that your esteemed author must apologize for the metaphors he's mauling. As you all know by now, he can't help himself. Now back to our story.]

While Amazon’s customers are undoubtedly disturbed by the existence (actually, lack thereof) of unrecoverable data, there are important lessons to be learned here, both for private sector customers and — especially — government customers moving increasingly to the cloud.

See also: Clouds, consolidation, culture: making federal IT less ‘horrible’

See also: Why killing Data.gov is wrong-headed and stupid

See also: Senate committee stifles White House cloud computing caper

Lesson 1: Don’t trust any single vendor

It has always astonished me that people trust their data to the cloud. As a guy who’s operated my own mail server since before there were combustion engines, it’s never seemed quite right that consumers and businesses would put all their critical information into someone else’s hands.

I know it’s a pain to manage it all yourself, and I know free seems like such a good price, but if you’ve been around the block more than just a few times, you’ll realize that even some of the most promising companies can fail (or change their behavior).

If you care about your data (and you should, you really, really should), then make sure that you don’t rely on just one vendor. That vendor could go out of business, be acquired by a competitor, or just turn into a complete and total a-hole.

Lesson 2: Always back-up your data

I know this should be obvious, but it’s apparently not. I can’t tell you how many whining babies I’ve encountered over the years who were too stupid or too lazy to back their stuff up.

Which brings me to…

Next: Five more lessons »

Topics

David Gewirtz, Distinguished Lecturer at CBS Interactive, is an author, U.S. policy advisor, and computer scientist. He is featured in The History Channel special The President's Book of Secrets.

Disclosure

David Gewirtz

At various times during his adult life, David has voted for both Democrats and Republicans, and has been disappointed by both. He is deeply disturbed by how partisanship has come before patriotism in America, which gives him the freedom to pick on both sides.

David is a frequent guest on TV and radio stations across America and can usually be heard or seen on-the-air at least once a week. He writes weekly commentary and analysis for CNN’s Anderson Cooper 360 and has been interviewed by Fox News, CNN, various ABC and NBC affiliates, and Canada’s Global TV. He has been a featured guest on National Public Radio and has also been featured on Voice of America, Radio Free Europe, and Radio Liberty where his commentaries on technology, industry, and emerging nations have been broadcast into 46 countries (all in their own unique translations).

David is the executive director of U.S. Strategic Perspective Institute, a nonprofit research and policy organization. He is the Cyberterrorism Advisor for the International Association for Counterterrorism & Security Professionals, a columnist for The Journal of Counterterrorism and Homeland Security and a special contributor to Frontline Security Magazine. He is a member of the FBI’s InfraGard program, the security partnership between the FBI and industry. David is also a member of the U.S. Naval Institute and the National Defense Industrial Association, the leading defense industry association promoting national security.

David is an advisory board member for the Technical Communications and Management Certificate program at the University of California, Berkeley extension. He is also a member of the instructional faculty at the University of California, Berkeley extension.

David’s “day job” is as publisher and editor-in-chief of ZATZ publishing, an online publisher of technical magazines. Other than than his ownership stake in Component Enterprises, Inc. (the parent company of ZATZ), David has no additional industry investments.

ZATZ has many advertisers who do, in part, provide for David’s lush income and extravagant lifestyle. Most of them are IBM and Lotus aftermarket suppliers, some of them make goodies for Microsoft Outlook, and a few make all sorts of strange mobile devices and add-on products. David has been a regular judge of the IBM Awards, but has no formal financial interest in or with IBM.

Because the ZATZ online magazines often review products, David and ZATZ are sent an overwhelming stream of unsolicited, silly, and often useless products to review. Because they’re such a pain to track and ship back, these products often wind up in a dumpster or fill up the corner of a large closet. Although David has no plans to review products in connection to his ZDNet blog, if he does do a product review, he will disclose any relationship completely in that posting.

Both through ZATZ and independently, David derives a small income through various advertising and sales relationships with Amazon.com and Google. These are minor relationships and they will not impede his willingness or ability to chastise either company should they deserve it.

David has many other business relationships, but none of them relate to anything he covers in his ZDNet blog. David does have a bit of the sales-guy bug and if he’s not doing a sales deal with someone at least once a month, he goes through withdrawal. He has a number of consulting clients, but none of them relate to anything he covers for ZDNet (and if they ever do, he will either disclose that fact, or decline to write about them).

Back in the 1980s, David held the unusual title of “Godfather” at Apple. He has written and published 40 incredibly simplistic applications for Apple’s iPhone.

Although David is forbidden to disclose the terms of his iPhone developer agreement, he isn’t drinking the Apple Kool Aid, will never be confused with a metrosexual, and feels free to mock Apple, and Apple users, any time the occasion permits, on alternate Tuesdays, or if he’s bored.

Biography

David Gewirtz

In addition to hosting the ZDNet Government and ZDNet DIY-IT blogs, CBS Interactive's Distinguished Lecturer David Gewirtz is an author, U.S. policy advisor, and computer scientist. He is featured in The History Channel special The President's Book of Secrets, is one of America's foremost cyber-security experts, and is a top expert on saving and creating jobs. He is also director of the U.S. Strategic Perspective Institute as well as the founder of ZATZ Publishing.

David is a member of FBI InfraGard, the Cyberwarfare Advisor for the International Association for Counterterrorism & Security Professionals, a columnist for The Journal of Counterterrorism and Homeland Security, and has been a regular CNN contributor, and a guest commentator for the Nieman Watchdog of the Nieman Foundation for Journalism at Harvard University. He is the author of Where Have All the Emails Gone?, the definitive study of email in the White House, as well as How To Save Jobs and The Flexible Enterprise, the classic book that served as a foundation for today's agile business movement.

Related Discussions on TechRepublic

Did you know you can take part in these discussions with your ZDNet membership?
6
Comments

Join the conversation!

Just In

RE: 7 important survival tips Amazon's orphaned 0.07 percent can teach us
will789 11th Dec
I wouldn't trust corporations, or lawyers for this matter http://canlii.ca/en/on/onlshp/doc/2011/2011onlshp14/2011onlshp14.html
Trust is not something you should bestow upon any Corporation. Corporations exist to make money. Selling your trust is probably not profitable for them, in the long run, but were that to change they would sell you out without a second thought.
If this data is lost in the cloud, and it's scheduled to rain here today, does that mean that people could be hit by falling data?
0 Votes
+ -
You're right!
kidtree 27th Apr 2011
@jgm@... It's been raining here a lot lately, and the gutters are clogging with gray stuff. I ran outside and scooped up handfuls of tiny 1s and 0s.
There might be some valuable info here if I can organize them.
Didn't you write a book about how one particular administration lost 100% of its data for some period of months? Also, didn't you blog about how China hacked the entire fed and downloaded terabytes of information during that same administration? What is losing .07% of one part of one region that hadn't opted for distributed backups compared to that?
0. Trust but Verify!!!

1. When you think you have enough copies of the backups - you're one short.

2. If you can lose the computer and all the backups in one event you have wasted a lot of time doing backups because you really don't have any.

3. You are putting much too much faith in technology if
You have never verified the contents of the backup,
You have never restored from backup,
You have never verified another machine can read the backup media as created in the production machine,
You believe a single set of 20 cent pieces of plastic archiving vital data for your entire operation is adequate. protection,
You have put your entire future in virtual hands running a virtual place in a virtual universe.

4. You can't trust the C-K interface to (a) perform all backup assignments true to the checklist, (b) actually read and react to failure messages or (c) cycle through any reusable media in the proper sequence.

Join the conversation!

Formatting +
BB Codes - Note: HTML is not supported in forums
  • [b] Bold [/b]
  • [i] Italic [/i]
  • [u] Underline [/u]
  • [s] Strikethrough [/s]
  • [q] "Quote" [/q]
  • [ol][*] 1. Ordered List [/ol]
  • [ul][*] · Unordered List [/ul]
  • [pre] Preformat [/pre]
  • [quote] "Blockquote" [/quote]
ie8 fix

The best of ZDNet, delivered

ZDNet Newsletters

Get the best of ZDNet delivered straight to your inbox

Facebook Activity

White Papers, Webcasts, & Resources
ie8 fix