ie8 fix
madison

Hardware 2.0

Adrian Kingsley-Hughes

T-Mobile turns Sidekick data disaster into a PR mess

By | October 13, 2009, 8:20am PDT

Over the weekend it emerged that a server crash at Microsoft/Danger had caused significant data loss for Sidekick users on the T-Mobile network. Yesterday T-Mobile released a statement which caused further anger and confusion amongst Sidekick users.

Here’s the statement:

Dear valued T-Mobile Sidekick customers:

We are thankful for your continued patience as Microsoft/Danger continues to work on preserving platform stability and restoring all services for our Sidekick customers.  We have made significant progress this past weekend, restoring services to virtually every customer.  Microsoft/Danger has teams of experts in place who are working around-the-clock to ensure this stability is maintained.

Regarding those of you who have lost personal content, T-Mobile and Microsoft/Danger continue to do all we can to recover and return any lost information.  Recent efforts indicate the prospects of recovering some lost content may now be possible.  We will continue to keep you updated on this front; we know how important this is to you.

In the event certain customers have experienced a significant and permanent loss of personal content, T-Mobile will be sending these customers a $100 customer appreciation card.  This will be in addition to the free month of data service that already went to Sidekick data customers.  This card can be used towards T-Mobile products and services, or a customer’s T-Mobile bill.  For those who fall into this category, details will be sent out in the next 14 days – there is no action needed on the part of these customers.  We however remain hopeful that for the majority of our customers, personal content can be recovered.

Wow! A $100 gift card that you spend with T-Mobile … Woohoo. Also, what is it with the “experienced a significant and permanent loss of personal content” nonsense? Who decides what’s significant? Way to make a tech disaster into a PR disaster too T-Mobile!

Along with clarity over compensation, I think that Sidekick customers are entitled to answers to a few questions, such as:

  • What caused the outage?
  • Why no data backup?
  • Why is a fix taking so long?
  • What precautions have been put in place to prevent a repeat of this mess?

Personally, I’m wary of cloud computing. If I lose data because I’ve not backed it up, that’s my look out, but it seems that you can’t even trust big companies to have bancups either.

Kick off your day with ZDNet's daily e-mail newsletter. It's the freshest tech news and opinion, served hot. Get it.

Topics

Adrian Kingsley-Hughes is an internationally published technology author who has devoted over a decade to helping users get the most from technology.

Disclosure

Adrian Kingsley-Hughes

All opinions expressed on Hardware 2.0 are those of Adrian Kingsley-Hughes. Every effort is made to ensure that the information posted is accurate. If you have any comments, queries or corrections, please contact Adrian via the email link here. Any possible conflicts of interest will be posted below. [Updated: February 23, 2010] - Adrian Kingsley-Hughes has no business relationships, affiliations, investments, or other actual/potential conflicts of interest relating to the content posted so far on this blog.

Biography

Adrian Kingsley-Hughes

Adrian Kingsley-Hughes is an internationally published technology author who has devoted over a decade to helping users get the most from technology -- whether that be by learning to program, building a PC from a pile of parts, or helping them get the most from their new MP3 player or digital camera.

Adrian has authored/co-authored technical books on a variety of topics, ranging from programming to building and maintaining PCs. His most recent books include "Build the Ultimate Custom PC", "Beginning Programming" and "The PC Doctor's Fix It Yourself Guide". He has also written training manuals that have been used by a number of Fortune 500 companies.

Adrian also runs a popular blog under the name The PC Doctor, where he covers a range of computer-related topics -- from security to repairing and upgrading.

35
Comments

Join the conversation!

Just In

Not really missing anything.
compudog 21st Oct 2009
I said that if someone buys something they CAN'T back up locally, they should be aware of that. Most users, apparently Sidekick users included, don't understand that or its ramifications.

I also didn't say anything about "society" blaming others. Not sure what your talking about there, but of course it's your prerogative to believe that it's fine to rely on others to look after something that's yours.

Or maybe I am just ignorant.
0 Votes
+ -
This wasn't cloud computing
Johnny Vegas Updated - 13th Oct 2009
This wouldn't have happened with cloud computing. In a cloud architecture users wouldn't have even realized any disruption. They would have automatically been distributed among other non failed geo dispursed instances while the failed instance was automatically restarted on other hardware and restored from replicated data sources.

I suspect that Danger fully disclosed it's architecture to TMobile at original partnership and MS probably revisited it with both of them when they acquired Danger. I also suspect that TMobile declined to invest in adding reliability and offsite backups to keep cost/price down. Perhaps they clearly stated in the terms of service that there were no data loss guarantees and users were responsible for their own backups.

I would really like to see some investigative reporting and facts and less pure speculation...
0 Votes
+ -
Agree on both counts.
njoho 13th Oct 2009
Descriptions of Danger's set up don't sound like cloud computing - more like a Server + SAN in a data-center somewhere. Any old web-server isn't "cloud computing".

Also, there's been far too much speculation already. Danger and/or Microsoft really need to make public the full details on this, however embarrasing that may be. The PDC is coming up soon, and a full, honest, presentation there entitled "How we screwed up with Sidekick" would not be inappropriate.
0 Votes
+ -
Isn't it amazing how the press throw buzz words around?
David Hamilton Updated - 13th Oct 2009
I've not seen anything around this that indicates that the Sidekick data
was stored in a cloud. The 'technical' press seem to think anything
that is stored on the internet is in the cloud - wrong!

An early report indicated that the failure occurred when Microsoft's
hardware subcontractor (Hitatchi) replaced SAN resources. How true
that is, I don't know, but that would make it likely that the Sidekick
data was
not stored on any of the recognised cloud providers.

Also, I saw a user comment that T-Mobile terms and conditions gave
no guarantees on user data, which tallies with your conclusion.
0 Votes
+ -
...then the service they're selling must not be
considered a "cloud"?

Exactly how is the hapless end consumer supposed
to differentiate between who is part of "the
cloud" and who is not if they are not privy to the
most intimate details of a vendors back-side?
0 Votes
+ -
Cloud computing means that the service and data is distributed between different nodes in different locations for fault tollerance.

A single SAN and server cluster is not "Cloud computing". That the Internet in general has been called the cloud means that a lot of people don't differentiate between the Internet (single web servers or clusters serving up content) and Cloud Computing (distributed servers balancing and replicating data globally).
0 Votes
+ -
Big difference to who?
JohnMcGrew@... 14th Oct 2009
Again, how is the end-consumer supposed to know
that? If a month ago, a soon-to-be-hapless
Sidekick user were to ask their local T-Mobile
representative if the data infrastructure behind
their Sidekick was on distributed servers
balancing and replicating data globally, what kind
of answer would they get?

It doesn't matter. It's "the cloud".
0 Votes
+ -
"End Users" No, Tech Journalists, Yes
pvsutton 15th Oct 2009
Few people expect the ordinary end users to understand when saving something to "the Internet" is the same as, or different from, saving it to "the Cloud."

However, the original point was about the way in which the story was being reported. Most of the people reporting it are technology journalists, and many are doing so in the technical press. The tech journalists should most assuredly understand the distinction, and need not report it sloppily or inaccurately.

It is not going to make it any harder for "end users" - and especially not for the readers of this sort of site - if you say that Sidekick's data was stored on a remote server, rather than saying it was stored in "the cloud."

If the company/ies involved were perpetrating this sort of muddle then the matter is even less forgiveable. Say, "We lost is in the cloud," and there's a sort of general excuse implied. "Oh, you know this new, vague sort of thingy - Cloud. All cutting edge, teething troubles, way out there, not really our fault - Cloud." Say it often enough and even your disgruntled customers may start to believe that you were a bit unlucky.

Say, "All the data was on one server and the backup was dodgy to start with, and then the main server threw a wobbly." Now even not-so technical users are going to wonder why their "It's really safe, you don't need a personal backup," data was entrusted to one hardly backed up at all server.

So, "It's the cloud," is sloppy research or sloppy writing by tech journalists. And if T-Mobile/Danger are using it, it's probably purposely misleading.
0 Votes
+ -
But once again, how are they to know?
JohnMcGrew@... 16th Oct 2009
If a month ago a "tech journalist" has asked a
Microsoft representative if Sidekick data resided
"on a server" or "in the cloud", what kind of
answer do you think they would have received?
0 Votes
+ -
Then please explain exactly what "Cloud Computing" is.
A Grain of Salt Updated - 13th Oct 2009
My simple assumption was if I sent data or files to reside on a 3rd party
server, for example: Mobile Me, Drop Box or flicker, I was sending it to
the "cloud". I assume the sites I just mentioned are very similar to the
Sidekick site. Now, I am probably quite wrong in this simplistic
assumption, so fill me in. What is the "cloud"?
0 Votes
+ -
As with any hot technology (SOA, etc) each vendor has its own take on
the definition of cloud, so I went (sigh!) to wikipedia for a general
overview, and it does provide some support for your point of view:

"The term cloud is used as a metaphor for the Internet, based on
how the Internet is depicted in computer network diagrams and is an
abstraction of the underlying infrastructure it conceals."


However the definition that most technologists put on "The Cloud"
appears further down:

"The majority of cloud computing infrastructure, as of 2009,
consists of reliable services delivered through data centers and built
on servers with different levels of virtualization technologies."


"Reliability improves through the use of multiple redundant sites,
which makes cloud computing suitable for business continuity and
disaster recovery."


In other words, clouds use virtualization to spread and duplicate
services and storage across multiple hardware resources, massively
minimising the chance of data loss, and almost eliminating the chance
of a complete data loss such as that suffered by Sidekick.
0 Votes
+ -
Thank you. Eggs in many places (nt)
A Grain of Salt 14th Oct 2009
(nt)
0 Votes
+ -
What does...
MobyMud 15th Oct 2009
Eggs in many places mean?
But as far as "Cloud computing" goes, there in nothing integral in the meaning of the cloud that implies redundancy of any kind. All that it STATES is that the hardware is "somewhere out there" as opposed to on site. While a number of implementations of cloud computing in fact allows for multiple failovers for both processing and storage, that is a flavor, NOT the definition.
0 Votes
+ -
Eggs
levinson 15th Oct 2009
"Eggs in many places" as opposed to 'eggs in one basket." Remember the
old saying, "Don't put your eggs in one basket"? One server with no
back-up=one basket. Many servers with many back-ups=eggs in many
places. The analogy doesn't actually fit, since if we are talking eggs in
many baskets and one basket breaks you lose one egg permanently
(unless you scrape it off the ground). But if one server crashes, the
redundancy means you don't lose anything. Still, it's the thought that
counts.
0 Votes
+ -
Short of giving another phone...
mrlinux 13th Oct 2009
One that does not rely on MS/Danger, I would be opting for the free early termination and go somewhere else.
Of course, I've had a Treo 270, Treo 600, Blackberry Pearl (my LEAST favorite phone, but not T-Mobile's fault - it's just a poor compromise between Blackberry OS and a consumer phone) and a G-1 in that time - and I store my stuff locally because I Have Not Now Nor Have I Ever Trusted Online Storage....
Stop being so pretentious.

To normal laymen users, "cloud" computing just means their data is held somewhere else not under their control. So this was a cloud computing disaster for Sidekick users.
0 Votes
+ -
Not pretentious at all
chris@... 13th Oct 2009
The normal layman needs to learn, then. If this is being- incorrectly- termed cloud computing, then it is a disservice to real cloud setups. I was under the impression that it was a cloud setup, but I could not understand how the heck they could simply loose the data.
A basic server makes more sense (though it's still hard to figure out how they managed not to have backups).
0 Votes
+ -
caveat emptor
muzza2005 14th Oct 2009
'I assume' equates to 'can't be ar5ed reading all the T+C's', cloud or otherwise. If they can't understand what they are reading, get 3rd-party advice.

Disservice to 'real' cloud setups? T-Mobile doesn't give a rats tazz about that, otherwise they would have belt+braces the infrastructure; they did it on the cheap EOS.
0 Votes
+ -
People who use technical terms without knowing what they mean, just
because they sound cool, merely confuse everybody and make the term
meaningless.

But it's the press that are the ones using the word 'cloud', supposedly
not laymen, and they really should know better.
0 Votes
+ -
T-Mobile PR suggestion going forward...
simkavitz@... 13th Oct 2009
(1) Tell the impacted T-Mobile subscribers the situation is only temporary, as we get more information we will get back to them.

(2) State frankly we had some concerns with our technology partner?s architectural approach and we will investigate to get to the root cause of the problem.

(3) Thank you for sticking with us as a trusted supplier during this unprecedented event- we appreciate your business and hope to restore your trust in our company as we resolve this unfortunate 3rd party equipment failure.

(4) We now need to go work this pressing issue... stay tuned.

r simkavitz
0 Votes
+ -
Better than most companies
Been_Done_Before 13th Oct 2009
Most will give you a free month or two with an apopology.

100 bucks is a 100 bucks be greatful or cancel your service.
0 Votes
+ -
wrong
kennedy@... 13th Oct 2009
$100 cash is a 100 bucks. A $100 credit that must be used with a company you wish to penalize by never spending another dime with them is NOT a 100 bucks.
I'm a sidekick user, and still don't have several features available, namely "third-party" email.

I'm still of the opinion that lawyers may be behind the delay in restoring service and actually the sidekick and danger product may be halted permanently during this outage. It would seem to me that if Microsoft was considering pulling the plug on Danger, this would be the time to migrate any users willing to stick with T-Mobile.

Since the delays between "News Announcements and PR Releases" on the T-Mobile website don't contain any substantial information on what's currently going on with the restore process, it can only lead one to wonder what's really behind the two companies true intentions.

Time will tell.
Cloud shmoud... They had some sort of catastrophic failure and failed to have a working backup solution in place. I'm sure the data was stored on hard drives and not in a cloud.
0 Votes
+ -
Lets recap
theo_durcan Updated - 13th Oct 2009
So here we have a MS setup/service that lost the data of close to a million customers.
Next we have MS apologists blaming the cloud for this. Sad...

TD
0 Votes
+ -
I agree with Adrian. If you think that your data is safe online, you are mistaken. If Sen, John "Jay" Rockefeller's (D-WV) bill passes, you may (will) kiss your data goodbye. Give the govt an excuse to shut down the commercial internet for some vaguely defined so-called security "threats" and you have a recipe for disaster for the rest of us. I now keep in mind his statement, "I think it would have been better if the internet had never been invented," and keep all my data in-house. Especially, these days... our govt at work!
0 Votes
+ -
Not Ashcroft?
ElCondor11 15th Oct 2009
You mean, a republican is NOT advocating the Govt take-over of the internet in an emergency? Really? A Democrat is pushing this idea? I bet it's so they can shut down RushLimbaugh.com when he gets to bombastic. LOL
I don't understand what all the fuss is about.

When you buy a Sidekick, you can't back it up locally. That's a fact the buyer chooses to live with, and the buyer also chooses to surrender control over their backups to a nameless, faceless server. If the information that might be lost in this way is so important to the user, the user must take responsibility to ensure the security of the data. Choosing to let someone else be responsible for one's backup is hardly taking ownership.

Our society's love of blaming everyone and everything but ourselves for our problems has had no trouble splashing over into our tech lives.
0 Votes
+ -
Uhhh...
drsparks@... 13th Oct 2009
You're missing the point. If Sidekick users
could backup their devices, then I'd agree with
you. But if you don't give users the option of
backing up and also fail at doing that for
them, then the company in question is at fault.

Also, I am so sick of hearing people say that
society loves to blame our problems on others.
That is a gross simplification at best and pure
ignorance otherwise.
0 Votes
+ -
...which can be backed up locally. Being so
totally dependent upon vendors unknown or
uncertain is to scary.
0 Votes
+ -
Not really missing anything.
compudog 21st Oct 2009
I said that if someone buys something they CAN'T back up locally, they should be aware of that. Most users, apparently Sidekick users included, don't understand that or its ramifications.

I also didn't say anything about "society" blaming others. Not sure what your talking about there, but of course it's your prerogative to believe that it's fine to rely on others to look after something that's yours.

Or maybe I am just ignorant.
0 Votes
+ -
Has anyone blogging on this subject even heard about the fact that the cloud IS the backup for the T-Mobile Piece of S**.... errrrr.. Sidekick? That's what makes the whole thing really maddening for anyone who owns a Sidekick (which excludes me- I HATE those phones)- the fact that "making your own backups" is FAR from easy- There has been a lot of talk about "make your own backups and don't trust the cloud" but on these phones, that just isn't an easy option, due to the EXTREMELY closed nature of the platform and the OS.
0 Votes
+ -
The real story is the SLAs in force
David Hamilton 13th Oct 2009
If anything does come of this failure, it is the fact that we
are increasingly reliant on internet-based services of many
kinds (I personally use hosted services such as Unfuddle to
run my software development). However, most current
SLAs act as if we didn't rely on these services - they
provide no guarantees of services or data at all.

If Internet-hosted solutions are to establish themselves in
the mainstream, vendors are going to have to bite the
bullet and actually make guarantees of service and
compensation for loss. Which, their lawyers will hate, of
course.
How about we call it "CLOD computing"?
Or maybe "Mushroom Cloud Computing"?

Join the conversation!

Formatting +
BB Codes - Note: HTML is not supported in forums
  • [b] Bold [/b]
  • [i] Italic [/i]
  • [u] Underline [/u]
  • [s] Strikethrough [/s]
  • [q] "Quote" [/q]
  • [ol][*] 1. Ordered List [/ol]
  • [ul][*] · Unordered List [/ul]
  • [pre] Preformat [/pre]
  • [quote] "Blockquote" [/quote]
ie8 fix
Click Here
ie8 fix

The best of ZDNet, delivered

ZDNet Newsletters

Get the best of ZDNet delivered straight to your inbox

Facebook Activity

White Papers, Webcasts, & Resources
ie8 fix
ie8 fix