The detailed technical descriptions of what went wrong clearly indicate the source of the real issue. Unfortunately it's an issue that's rarely discussed, let alone in the context of cloud computing. So what is it?
As my storage-minded colleague Don MacVittie expounded in a recent blog, many people have had much to say about the Amazon outage, but the one thing that it brings to the fore is not a problem with cloud, but a problem with storage. Yes, we have a problem with storage and it's compounded by cloud computing.
The underlying problem is that storage virtualisation is about aggregation of resources for purposes of expanding capacity of the entire storage network, not individual files. Storage virtualisation controllers, unlike application delivery controllers, do not provide failover.
If a resource such as a file system becomes unavailable, it's unavailable. There's no backup, no secondary, no additional copies of that file system to which the storage virtualisation controller can redirect users. Storage virtualisation products just aren't designed with redundancy in mind, and redundancy is critical for enabling availability of resources.
Redundancy is critical, but it's not the only technological feature required. Interfaces to storage must also be normalised across redundant resources. A common interface allows transparent failover from one resource to another in the event of failure, making it possible to take advantage of redundancy.
Multiple copies of the application
Applications, for example, especially in cloud-computing environments, generally take advantage of the ubiquitous nature of HTTP. Availability of applications is made possible by the existence of multiple copies of the application and because all clients are accessing the application via HTTP. If one instance fails, the same protocol can seamlessly interact with a secondary or tertiary copy of the application.
Storage virtualisation products have addressed the problem of normalised interfaces by acting as a go-between, a proxy, to provide a single interface to clients while managing the complexity of heterogeneous storage systems in the background.
But the protocols used to manage storage resources internal to the storage architecture are not always...
...the ones used to access storage resources across physically disparate environments, such as between the datacentre and a cloud-computing environment.
Every provider presents its own service interface, requiring storage virtualisation products to use customised access methods to integrate such services into the enterprise architecture.
For intra-provider redundancy, this situation is not a problem, but for inter-provider redundancy, it becomes a very serious drawback, as generally only the most popular provider services are supported.
Redundancy and interfaces
What storage services need, particularly in cloud-computing environments, is the ability to provide for failover — whether across environments or internal to the environment. Storage virtualisation products must take the next step towards availability and, ultimately, true storage-as-a-service.
That step means making storage services available in a more standards-oriented way to enable inter-cloud and ultimately inter-architecture compatibility.
Normalised interfaces would make it possible for storage virtualisation systems typically deployed in large enterprises to take advantage of external storage without the complexity and dependency on vendor whim or pure populism.
But first, storage virtualisation products must implement failover capabilities. They must be able to not only create tiers of data across environments, as they do now, but they must be able to replicate and failover from one to another to assure availability of the aforementioned services — especially of mission-critical files.
Single point of failure
Storage virtualisation products need to support redundancy in a manner similar to the network and application redundancy that has enabled highly available architectures to date. Without the ability to support redundancy, and thus failover, storage-as-a-service remains a single point of failure that, as evidenced by the Amazon outage, can be disastrous.
Without the ability to support redundancy, and thus failover, storage-as-a-service remains a single point of failure.
Once redundancy and subsequently high availability are achieved internal to the storage architecture, then it becomes possible to include external storage-as-a-service as part of that architecture. It is at that point that standard interfaces become imperative to providing customers with the choice and flexibility of services.
But first and foremost, we have to recognise that the real issues with storage-as-a-service are caused by inadequacies in storage technology, not by the concept itself. We have to address those problems rather than lay responsibility at the feet of cloud computing.
Lori MacVittie is responsible for application services education and evangelism at application delivery firm F5 Networks. Her role includes producing technical materials and participating in community-based forums and industry standards organisations. MacVittie has extensive programming experience as an application architect, as well as in network and systems development and administration.
Get the latest technology news and analysis, blogs and reviews
delivered directly to your inbox with ZDNet UK's
newsletters.
According
to
ServiceNow,
the
company
is
looking
to
help
solve
the
last
mile
challenge
of
vaccine
management
including
distribution,
administration
and
monitoring
...
BitDegree
is
an
online
learning
platform
that
offers
interactive
courses
for
digital
skills,
and
it's
currently
offering
8
hours
of
study
material
on
AWS.
...
New
version
4
of
the
BI
+
big
data
platform
is
based
on
Spark
and
Parquet,
leverages
machine
learning
and
is
optimized
for
cloud
storage.
It's
available
on
the
Azure
Marketplace
now
...
Want
to
avoid
having
your
online
accounts
hacked?
Enable
two-factor
authentication,
a
crucial
security
measure
that
requires
an
extra
step
when
signing
in
to
high-value
services.
...
Some
65%
of
businesses
in
the
region
have
adopted
at
least
one
Asian-made
technology
product,
with
another
72%
describing
vendors
from
the
region
as
better
providers
for
their
understanding
...
Join Discussion