ie8 fix

Clearing the fog from cloud

By | March 3, 2010, 3:23pm PST

People are making the cloud computing and storage much more complicated than it has to be. There are 2 key elements in cloud infrastructure: scalability and manageability. Those are the hard problems. If you don’t have those you CAN’T have a cloud. The rest is pool.

Tempest in a cloud
My ZDnet colleague, Phil Wainewright, recently opined

Yet in my view, the most important attribute of the cloud — too readily overlooked by many commentators — is that it lives in the Internet. The Internet dimension is crucial because it brings with it an obligation and a necessity to remain open to connections. It means that a cloud has to have:

  • Open APIs
  • Unlimited bandwidth
  • Collective scrutiny and innovation

These are all Good Things, but only if they rest on scale and management. Otherwise, what’s the point?

Public vs private
James Hamilton, Amazon architect and a very smart guy, recently blogged about private clouds. In Private Clouds Are Not The Future he argues that economies of scale make public clouds much more efficient than private clouds.

I agree that several effects make web scale public clouds more efficient:

  • Quality. Large clouds can economically employ experts to design and optimize their services and infrastructure. Security and server/storage design are two areas where deep expertise can provide more reliable and efficient service.
  • Utilization. Power systems and power cost are optimized when data centers are run at 100% utilization. As utilization rises across the board so does the capital efficiency, i.e. work per invested dollar.
  • Cost. Large-scale investments create their own lower-cost dynamic. Public cloud providers save money on infrastructure acquisition through volume buys. Volume lets them get high-efficiency power supplies or custom cost-reduced motherboards, that offer little economic advantage to small buyers.

With all these advantages it is obvious that private clouds are not the future. Or are they?

It isn’t all about the Benjamins
Economics is not the driver many assume. But some cloud capabilities will filter down to smaller-scale private clouds.

Enterprise data center costs are often 50%-70% labor. Internet data centers are as low as 3%. If cloud techniques allow enterprises to reduce their labor to 20% of cost, then private clouds become competitive with public clouds for critical apps.

Why? Often perceived benefits cannot be measured in dollars. Convenience, availability, consistency and control often relate to emotional needs and wants that are rarely quantified or questioned.

But we don’t have to invoke those to understand why private clouds will be part of the computing landscape. Just a quick look at one of the large Internet data centers will tell us what we need to know.

Show me the power
All the advantages of public clouds have analogs in the world of power generation and distribution. Power generation is cheapest when centralized and large-scale distribution systems move power at the lowest cost per watt.

Electrical power generation and distribution is over 125 years old. The technology is well understood, the industry is mature, and has a massive infrastructure for production and distribution.

And yet Google’s dual 85,000 sq. ft. Dalles, Oregon data centers, built next to a substation a few miles from the nation’s largest hydropower system - one of the world’s most reliable power sources - flanks each data center with generators. I expect Amazon does the same.

Why do Google, Amazon and every other cloud service provider invest millions in private power production? They don’t trust public power.

Same with the Internet.

Access
Clearly, access to data is at least as important as access to power or why would data centers spend the money on uninterruptible power supplies?

Is the Internet that different?

We cannot rely 100% on Internet access to our data. Given the outages we’ve seen to date, even 99% is a stretch.

If the application is important enough, as judged by often subjective human criteria, we will keep our data as close as Google keeps its generators.

Even if it isn’t the most economic choice.

The Storage Bits take
I’ve grappled with the question of private clouds for the last couple of years. The advantages of web scale systems are obvious, but the need for reliable data access and control has not receded.

Public and private will not displace each other: they will coexist just as public and private power sources coexist today. No doubt public clouds will claim the majority of the market whether measured in dollars or exabytes, but private clouds will remain significant contributors to our data infrastructure for decades, if not centuries, to come.

Web-scale techniques will filter down to the enterprise and as the decades pass more and more legacy infrastructure will be migrated to them. Just as payroll is now outsourced - plenty of sensitive data there! - some apps will find their way to public clouds. But mission critical data storage will remain inside because Internet latency and bandwidth will always be slower and smaller than private local clouds.

Comments welcome, of course.

Kick off your day with ZDNet's daily e-mail newsletter. It's the freshest tech news and opinion, served hot. Get it.

More from “Storage Bits”

Topics

Robin Harris has been messing with computers for over 30 years and selling and marketing data storage for over 20 in companies large and small.

Disclosure

Robin Harris

Robin Harris is a president of TechnoQWAN, a consulting and analyst firm in northern Arizona. He also writes StorageMojo.com, a blog which accepts advertising from companies in the storage industry, and has a 25 year history with IT vendors. He has many industry contacts, many of whom are friends and all of whom he has opinions about. Robin has relationships with many companies in the technology industry. Every company he writes about may have sought to influence his opinion through carefully-crafted marketing messages and self-serving white papers, gifts ranging from desk calendars, t-shirts, lunches and trips as well as analyst or consulting assignments. He also invests in some technology companies. He may accept payment for services in stock as well. Robin discloses financial investments in or client relationships with companies named in Storage Bits. To help readers sort out the gold from the dross in his writings, Robin tries to communicate his reasons as clearly as he can. If you agree, you are intelligent and discerning. If you disagree, well, you disagree. In all cases, Robin encourages readers to subject everything they read, see or hear on the internet or from politicians to some simple questions: * What assumptions are implicit in the world view and judgments of the author? * What, if any, is the factual basis for the opinions the author expresses? * Is it reasonable, logical and clear? Your critical faculties: use ‘em or lose ‘em!

Biography

Robin Harris

Harris has been messing with computers for over 30 years and selling and marketing data storage for over 20 in companies large and small. He introduced a couple of multi-billion dollar storage products (DLT, the first Fibre Channel array) to market, as well as a many smaller ones. Earlier he spent 10 years marketing servers and networks. After leaving corporate life he founded TechnoQWAN, a consulting and analyst firm. He also developed StorageMojo into one of the top storage industry blogs.

Robin writes, consults, coaches and lives among the mountains of northern Arizona.

2
Comments

Join the conversation!

Just In

RE: Clearing the fog from cloud
yarinsiz Updated - 16th Apr 2011
Great!! ! thanks for sharing this information to us!
sesli sohbet sesli chat
0 Votes
+ -
About the power analogy
mr1972 4th Mar 2010
Most companies that have mission critical electric power needs have back up generators and if they can afford it, generate there own power. Their business success depends on a level of service an outsourced electric company can't provide for them. This works into the cloud analogy well. If the local access to the Internet goes down, your business should not screech to a stand still. Mission critical apps, services, and resources have to be redundant or you risk going out of business.

Also most local electrical power plants are heavily socialized. There is almost no competition inside the local market so energy prices are much higher than they should be. I am not sure I would like to see a socialistic cloud structure with cloud companies subsidized by tax payer money and guaranteed not to fail.

Another analogy cloud people like to use is in Banking. Sure it is outsourced from a company to local banks but again, the banking industry is heavily socialized and tax payer money is used to guarantee banks don't go out of business. Again, I would like to see a more capitalistic answer to cloud computing.

Also cloud adoption is also about trust. Trust that cloud consumer's data is secure. Trust that consumer generated content remains owned by the content generator, not the cloud vendor. Trust that if a single cloud vendor goes out of business or gets sold the cloud consumers data, services, and resources will still be available to them.

Scale, management and cost are non-issues until you have trust in the technology. So far cloud evangelists have been pushing some of the positive productivity gains but have been ignoring the trust issues.

Every single cloud vendor I have researched has had different levels of secure connections. Some offer https, some don't, some don't even know what an ecrypted connection is. Most don't offer encrypted storage. Some will allow you to encrypt your own files and store them, some demand you turn over your encryption key, others don't even know what your talking about when you mention encrypted files.

You hear stories about video hosting sites that shut down and give users only 24 hours to get their content off the hosted site. For consumers this is bad, imagine if you are a company using a cloud companies service and they only get 24 hours to get their data off the cloud? What happens to the corporate client? Do they also go out of business? What kinds of exit strategies are out there in the cloud? Is socialism the best exit strategy, simply guarantee that no matter how mismanaged a cloud company is, it will continue to exits?
0 Votes
+ -
RE: Clearing the fog from cloud
yarinsiz Updated - 16th Apr 2011
Great!! ! thanks for sharing this information to us!
sesli sohbet sesli chat

Join the conversation!

Formatting +
BB Codes - Note: HTML is not supported in forums
  • [b] Bold [/b]
  • [i] Italic [/i]
  • [u] Underline [/u]
  • [s] Strikethrough [/s]
  • [q] "Quote" [/q]
  • [ol][*] 1. Ordered List [/ol]
  • [ul][*] · Unordered List [/ul]
  • [pre] Preformat [/pre]
  • [quote] "Blockquote" [/quote]
ie8 fix

The best of ZDNet, delivered

ZDNet Newsletters

Get the best of ZDNet delivered straight to your inbox

Facebook Activity

White Papers, Webcasts, & Resources
ie8 fix