SSD security: the worst of all worlds

By | March 29, 2011, 8:52am PDT

Data security on SSDs is a mess. Good luck removing data! Preserve it for digital forensics? Uh-oh. Secure erase might work, but it that good enough?

SSD data recovery
SSD security is important because data recovery is so much easier than for hard drives. For less than $1k you can buy the equipment that will read flash chips.

Flash SSD architecture leaves sensitive data at risk. Unlike hard drives, when flash SSDs rewrite a block, they don’t overwrite a fixed block: they grab some empty block and write over that, leaving the original data untouched.

Architectural insecurity
Flash is written to the first free 128k or 256k blocks. Rewriting means making a copy of the block and writing the old data plus the new data to another block.

Flash drive controllers virtualize the flash capacity through the flash translation layer (FTL). The blocks your OS sees are not the blocks that are being written. In addition, flash SSDs maintain a large pool of capacity that is not seen by the operating system.

Which leaves your old data on the old block. New writes are written to the first free location, not, as on a disk, to a specified physical location.

Garbage collection eventually overwrites the old block to adds it to the free block pool. Cheaper MLC drives avoid aggressive garbage collection because it wears out the drive sooner.

In addition, the flash failure mode is that the block cannot be written. As blocks reach their end of life, they may not get rewritten at all - leaving sensitive data there for years.

In the meantime you can have 10’s of gigabytes of data sitting on capacity that your OS can’t see. And like hard disks, “deleting” a file does nothing of the sort.

File deletion
As a result, OS-based file erasure doesn’t work well. None of the tested methods - including US DoD 5220.22-M using multiple overwrites - succeeded in always erasing all of a file.

File system deletes left anywhere from 4 to 91% of a file on an SSD. Even free space overwriting left a majority of the data intact on all the drives.

(In)secure erase
The ATA command set has a secure erase function - disabled by most BIOS’s - that will wipe a hard drive. But the researchers found that SATA SSD implementations of secure erase ranged from dire to successful.

3 of 7 tested drives did not properly execute the secure erase command. One drive reported a successful erase but didn’t erase anything.

In a paper (pdf) presented at FAST - File And Storage Technology - ‘11, Michael Wei, Laura M. Grupp, Frederick E. Spada and Steven Swanson of UC San Diego discuss their research into SSD security. They found that techniques that work on disks - other than physical destruction - don’t work on SSDs.

That includes multiple overwrites - which do nothing of the sort on SSDs - the single most popular method on hard drives. If data security is vital, physical destruction is the only sure method today.

The flip side
Another paper by academic researchers Solid State Drives: The Beginning of the End for Current Practice in Digital Forensic Recovery? (pdf) finds that

. . . solid-state drives (SSDs) have the capacity to destroy evidence catastrophically under their own volition, in the absence of specific instructions to do so from a computer.

The Storage Bits take
In SSDs we have the worst of both security worlds: we can’t reliably remove or preserve data. It won’t take long for horror stories to start popping up.

Comments welcome, of course.

Kick off your day with ZDNet's daily e-mail newsletter. It's the freshest tech news and opinion, served hot. Get it.

Topics

Robin Harris has been messing with computers for over 30 years and selling and marketing data storage for over 20 in companies large and small.

Disclosure

Robin Harris

Robin Harris is a president of TechnoQWAN, a consulting and analyst firm in northern Arizona. He also writes StorageMojo.com, a blog which accepts advertising from companies in the storage industry, and has a 25 year history with IT vendors. He has many industry contacts, many of whom are friends and all of whom he has opinions about. Robin has relationships with many companies in the technology industry. Every company he writes about may have sought to influence his opinion through carefully-crafted marketing messages and self-serving white papers, gifts ranging from desk calendars, t-shirts, lunches and trips as well as analyst or consulting assignments. He also invests in some technology companies. He may accept payment for services in stock as well. Robin discloses financial investments in or client relationships with companies named in Storage Bits. To help readers sort out the gold from the dross in his writings, Robin tries to communicate his reasons as clearly as he can. If you agree, you are intelligent and discerning. If you disagree, well, you disagree. In all cases, Robin encourages readers to subject everything they read, see or hear on the internet or from politicians to some simple questions: * What assumptions are implicit in the world view and judgments of the author? * What, if any, is the factual basis for the opinions the author expresses? * Is it reasonable, logical and clear? Your critical faculties: use ‘em or lose ‘em!

Biography

Robin Harris

Harris has been messing with computers for over 30 years and selling and marketing data storage for over 20 in companies large and small. He introduced a couple of multi-billion dollar storage products (DLT, the first Fibre Channel array) to market, as well as a many smaller ones. Earlier he spent 10 years marketing servers and networks. After leaving corporate life he founded TechnoQWAN, a consulting and analyst firm. He also developed StorageMojo into one of the top storage industry blogs.

Robin writes, consults, coaches and lives among the mountains of northern Arizona.

49
Comments

Join the conversation!

Just In

Somebody STOP THE SPAMMERS!
MontrealPaul 20th Oct
Somebody STOP THE SPAMMERS!

First - very interesting article, Robin, and as usual, the comments are equally, and sometimes even more, interesting!

However, the last few have been fake comments, probably automatically generated, with links leading to junk sites, probably also generating "click revenue" (hover before clicking!)

Does someone have the ability to delete these messages?
They are the dozen or so above this one, with the poster's names all in CAPS.
0 Votes
+ -
SSD
Hasam1991 29th Mar 2011
Speed matters, I don't care!!! the faster the better!!
0 Votes
+ -
How About Encryption?
matricellc 29th Mar 2011
Mr. Harris,
I know this was not the intent of your posting, but it would be interesting to know how secure data on SSD's is with full drive encryption. I know there were some early issues with some implementations of full drive encryption, but I wonder what the current state of affairs is.
0 Votes
+ -
RE: SSD security: the worst of all worlds
Robin Harris 29th Mar 2011
@matricellc
I haven't played with any of the FDE options or host-based encryption either. From what I can see however, none of them have taken off with consumers. I suspect that results from a combination of human inertia, techno-anxiety, skewed risk assessment and availability.

Robin
0 Votes
+ -
@Robin Harris If it does use encryption, how much does it take to crack it?
0 Votes
+ -
@Robin Harris

It's more that even things such as TrueCrypt have an ABYSMAL record of having 'unrecoverable errors' which leave all your data impossible to get to.
That is the main reason why I refuse to use it, even though I am a little paranoid.
0 Votes
+ -
@Robin Harris

If you're so concerned about your data as to invest in professional grade wiping and using the secure erase SATA command - you're not an average consumer.

@Lerianis10

Last I checked, TrueCrypt was block based and an error in one block does not affect the others.

The biggest issue I see with TrueCrypt is losing the password - if you forget that, you've lost the whole drive.


That, and TrueCrypt seemed freeze my system every once in a while so that I had to reboot to start working again. It does seem to have some big bugs. Nothing that destroyed my data, though.

@asdacap

If using TrueCrypt, you've got some of the best encryption on the planet, assuming you're using a good password. Can't say anything about the others, I've only tried TrueCrypt.
0 Votes
+ -
The more legit reason
voyager529 30th Mar 2011
@Robin Harris

has more to do with what is actually to be a problem amongst consumers. Despite Windows 7 supporting Bitlocker, for all but one of my clients this would be a bad idea.
I've dealt with more unbootable machines due to bad MBRs, bad sectors in *just* the wrong spot, virus attacks, rootkits, update corruption, and just about any other thing you can shake a stick at. Between disk imaging software like Acronis and Ghost, bootable Linux CDs like Knoppix, and tools like the UBCD4Windows and Active@ Boot Disk, I've recovered data for virtually all of those clients, and they are eternally grateful. By contrast, only one end user ever asked me about the data security of disposing of a hard disk. He took the pragmatic route and took a masonry bit to the drive half a dozen times after letting it sit next to a subwoofer magnet overnight. Obviously the latter doesn't apply to SSDs, but the former does.

SSDs aren't as cheap as spinning rust, but even the expensive ones at $300-$500 a clip are worth destroying physically with a drill bit or shotgun if the data is valuable enough. If it isn't worth the cost of replacing the drive physically or repurposing the drive within the home, it probably isn't data valuable enough to worry about securely erasing.

Since a nonbooting system is a legit concern that many, many people have had personal experience with, while data theft through disk disposal is not, it makes more sense to plan for the more likely scenario, does it not?

Joey
@Robin Harris
If the data is important to me, then I apply two simple rules - regardless of the storage media:- Encrypt it - pref. with an open source encryption tool such as Truecrypt that can be scrutinised for COFEE-style back doors. Back it up - pref. with a reliable, open source backup tool such as RSync that allows me to see exactly what it is doingFor those complaining of issues with Truecrypt, we have been running Truecrypt successfully on FAT32, EXT3 (and more recently EXT4) file systems on Ubuntu and Debian Linux for several years without any major issue. We use it on both mechanical and solid state storage devices.

Granted, we have suffered media failures. However these have been nothing to do with Truecrypt. The king of failures is Western Digital's awful 2TB "Green" drives. Though we have also had several high-capacity pen drives go down too, along with some elderly 120GB PATA units that have already exceeded their expected life. But all these failures have been no more than a minor inconvenience because we regularly RSync (or Rsync over SSH) our dataset(s) to several other backup volumes.

When the time comes finally to decommission storage media, usually because it is physically knackered, then we physically dismantle it. This is partly out of curiosity (and because I like playing with the magnets! lol!) but mainly because physical destruction of redundant storage media, regardless of its type, severely restricts the possibility of future hackers (with better decryption tools), ever getting their grubby hands on our data.

It's common sense really, isn't it?

Best wishes, G.
0 Votes
+ -
What I know, is that SSD's are more secure than HD's as you really can not anymore recover data fully after you delete it. Just like the article links at the end.

And article in the Slashdot (can be found by searching "SSD")

"Firmware built into many solid state drives (SSDs) to improve their storage efficiency could be making forensic analysis at a later date by police forces and intelligence agencies almost impossible to carry out to legally safe standards, Australian researchers have discovered. They found that SSDs start wiping themselves within minutes after a quick format (or a file delete or full format) and can even do so when disconnected from a PC and rigged up to a hardware blocker."
0 Votes
+ -
RE: SSD security: the worst of all worlds
gwconnery@... 29th Mar 2011
@Fri13 Here's an actual link to the article you mention:

http://news.techworld.com/security/3263093/ssd-fimware-destroys-digital-evidence-researchers-find/

HOWEVER, while it may be true that SSDs create problems for forensic analysts, that doesn't invalidate the concerns raised in this article. Guess what? Both are true.

SSDs are different than hard drives, and all the methods, both to probe them for 'deleted' files and to delete all the data on them, that we're used to from rotating media days don't work reliably on them.

Both approaches need work.
0 Votes
+ -
RE: SSD security: the worst of all worlds
Lerianis10 Updated - 30th Mar 2011
@gwconnery@...

I have to agree. Personally, I will stick to regular mechanical hard drives on most of my computers until those security issues are taken care of..... I'm worried about a virus that is able to hide itself on SSD's because of the 'lack of total deletion' and therefore becomes impossible to totally remove.
The bad side of this is that if someone goofs and deletes or formats there may be no recovery other than a backup.
0 Votes
+ -
Proofread
flareback 29th Mar 2011
Do you proofread?
0 Votes
+ -
One word: Blendtec . If the SSD is ground into fine sand like granules, the odds of data recovery are zero .
0 Votes
+ -
@Mattster67
Exactly, if it is so important to get rid of secure info then Blendtec or the cheaper route microwave 15 seconds on high.
0 Votes
+ -
@MoeFugger
Just pull off the outside cover and run a drill through the chips. Secure erase.
0 Votes
+ -
RE: SSD security: the worst of all worlds
johnlgalt@... 30th Mar 2011
@MoeFugger I'm pretty positive that 15 seconds would not constitute enough harm to the chips used in SSDs. Blender, yes, microwave no.

Pluss, remember the no metal in microwaves thing?
0 Votes
+ -
Data corrosion - misleading term
Patanjali 29th Mar 2011
That paper uses the term 'data corrosion', which implies that SSDs may destroy your data of their own volition.

However. it is a beatup, because your data WILL not be damaged AT ALL.

The worst that can happen is that they cannot forensically guarantee from where on the disk that data they read comes.
0 Votes
+ -
RE: SSD security: the worst of all worlds
nickswift498 29th Mar 2011
Want total security? Use thermite.
0 Votes
+ -
sdghh
0 Votes
+ -
0 Votes
+ -
We use a grinder
voska1 30th Mar 2011
We contract with a company that shreds paper and hard drives. They have grinder which turns a hard drive into tinny bit's of metal and plastic to be sent for recycling.
0 Votes
+ -
PUHLEEZE ... just use the SSD utility
gallee Updated - 30th Mar 2011
Why would you use the old utilities to manage new technology? All the SSD's I've ever used come with their own utilities. Use them instead of making up news ...

I bet you can't quite get your carburetor float adjustment tool to work on your fuel injected car either. Obviously the new car's fault, right?

Patient: "Doc, it hurts when I do this."
Doctor: "Don't do that!"
0 Votes
+ -
RE: SSD security: the worst of all worlds
TimothyMcGowan 30th Mar 2011
@gallee:
"3 of 7 tested drives did not properly execute the secure erase command. One drive reported a successful erase but didn?t erase anything."

I didn't understand from the article that old utilities were being used when these data were compiled.

-- Tim
0 Votes
+ -
We don't really need all the stuff you are whining about. SSD right now is for speed and not much else.
0 Votes
+ -
Please proofread
0 Votes
+ -
What good is secure erase if it's disabled in the BIOS? Does the BIOS have an option (in some? all? cases) to leave it enabled (perhaps just for this boot cycle)? AFAIK, I have to boot UBCD and then plug in the disk(s) to be secure erased - not for the faint of heart. Any better solutions than keeping a _really_ old mobo around for doing secure erasures?
0 Votes
+ -
Or use TrueCrypt, if that floats your boat. Either way, FDE (full disk encryption) solves this problem for any type of drive, spinning or SSD.

When you want to get rid of a disk, you disconnect it and throw it away.

Some disks (including SSD) have FDE built-in, but frankly with built-in FDE I feel a bit uncomfortable about the fact that the private encryption key is stored on the device it is encrypting.
0 Votes
+ -
Typo in "but it that good enough?"
AMusnikow 30th Mar 2011
At the end of the first paragraph, should "it" be "is" in "but it that good enough?"
If SSDs "have the capacity to destroy evidence catastrophically," it would seem like those capacities could be harnessed, and used instead of "erasing" techniques to prevent recovery. The fact that the data is not "removed" is of no significance if it can't be accessed.

Forensic data recovery has access to all the recovery techniques available to thieves. Therefore, if these "capacities" make it impossible for forensics teams to recover data, I don't see why we need to worry about the thieves. What am I missing?
0 Votes
+ -
Erase an SSD
david@... 31st Mar 2011
Just erase or delete everything. And then fill it with useless data. I realize that some of the blocks of memory that were holding sensitive data are used as block pointers or.. Maybe. But if you fill a SSD with data you are telling me that there is some extra capacity that we can not get to or is not used? I could write this program in minutes.
0 Votes
+ -
Encription and backup
alexisgarcia72@... 1st Apr 2011
SSD are extremely fast and give you several advantages: less heat, less battery consumption, more spead, better life, better MTBF, big performance, etc. Of course everything is not love, some cons must be present with this new technology. If you have issues with critical data: use SSD only for OS and keep your data in regular disks, use encription, use a datalocker (encript data on hd on the fly with AES 256bit without software, drivers or user intervension in the pc). There is alternatives.

And don't forget to make your backups or use tech like Dropbox to keep your data safe and replicated.

You can use Beyond compare as well to keep sync of all data from one important location to your backup storage.
0 Votes
+ -
Clearly the I/O command set should include a command for the explicit purpose of doing a secure erase of a file.
0 Votes
+ -
Like someone else said, these problems are more or less nullified by following standard practices:

If you have anything on a drive so important nobody else can see it, you need to encrypt it. If you're getting rid of it do full disk encryption, then format. If you have Department of Defense level information on a drive and you're getting rid of it then you GRIND IT TO DUST.

Regardless of storage media, have backups. Optical discs are pretty reliable is they are stored and left alone. If you have anything really important and it can't be lost you need it backed up on more than.hard drives.
Like someone else said, these problems are more or less nullified by following standard practices:

If you have anything on a drive so important nobody else can see it, you need to encrypt it. If you're getting rid of it do full disk encryption, then format. If you have Department of Defense level information on a drive and you're getting rid of it then you GRIND IT TO DUST.

Regardless of storage media, have backups. Optical discs are pretty reliable is they are stored and left alone. If you have anything really important and it can't be lost you need it backed up on more than.hard drives.
0 Votes
+ -
Windows 7 and the latest Linux (but not OSX) support the TRIM command for SSDs. If I understand the purpose of the TRIM command correctly (via Wikipedia), then when the OS issues a disk file erase, it also issues the TRIM command to the SSD memory controller to wipe that 128/256kB block. The purpose of this is not so much to permanently erase the block but rather to maintain write performance, which degrades over time if the SSD controller has to constantly do the read, update, block erase and write. Besides there are utilities out there from the SSD makers mostly targeted at earlier generation SSD's without TRIM support that claim to do an EEPROM all-erase to restore write performance. I'm not sure this article is totally up-to-date.
0 Votes
+ -
This is an excellent article. The following publish supplies genuinely high quality info. My spouse and i?meters bound to check in it. Truly extremely helpful points are given listed here. Many thanks a great deal. Carry on favorable functions. vintage snapback hats best solid state drive
This is a really good read for me. Must admit that you are one of the best bloggers I have ever read. Thanks for posting this informative article. baby gifts for boys baby gifts for girls
I like the article you wrote here; it is very informative and useful for the internet users like me. I will come back to read more blog posts on your website and I have bookmarked your website as well Thank You know style clothing store girls clothing stores online
0 Votes
+ -
I also desire to signal in your RSS feeds. Thank you as soon as once again and maintain up the great operate! nccma cooler
0 Votes
+ -
I used to be more than happy to seek out this internet-site.I wanted to thanks in your time for this glorious read!! I positively enjoying each little bit of it and I have you bookmarked to check out new stuff you weblog post. this thread is amazing i like your work and i appreciate you that you have share a useful stuff thanks for sharing the i shop abatwa
0 Votes
+ -
I used to be more than happy to seek out this internet-site.I wanted to thanks in your time for this glorious read!! I positively enjoying each little bit of it and I have you bookmarked to check out new stuff you weblog post.Bookmarking now thanks please consider a follow up post. power sa shop
0 Votes
+ -
I think the representation of this article is actually superb one. This is my first visit to your site. Thanks a lot and keep sharing the information. Keep updating the information for all of us. Thanks ZDNet Government was launched as the brand's first industry vertical, with a mission to cater to IT professionals in the public secto I agree with your post. However, do you have any sources I can cite for my paper wheel car com bury
Well welcome, hopefully you can become a vital member of the community and really help to push far ahead of google. Which Im sure the development team would love. This will of course earn you alot points too and get you on the leaders board. z d n e t t h a n k Im not sure i come to an agreement with you on every level, howevor it absolutely was a good posting, many thanks for taking the time to put up your ideas.
0 Votes
+ -
This is my first visit to z d n e t site. Thanks a lot and keep sharing the information. Keep updating the information for all of us.how can i clean up, because i don???t know why it seems my skeen has to fat i get the glasses dirty every day.i search y a h o o Very good quality indeed. I surely recommend it. The template used in their site is also great.
0 Votes
+ -
Fantastic news about the new release.I positively enjoying each little bit of it and I have you b o o k m a r k e d to check out new stuff you weblog post.Im not sure i come to an agreement with you on every level, howevor it absolutely was a good posting, many thanks for taking the time to put up your ideas
0 Votes
+ -
Why is it so hard to erase old data, or any data for that mater?
sam - seo tips
0 Votes
+ -
Good day to confirm this comment I would appreciate T h e b e s t o f Z D N e t d e l i v e r e d your website very nice to everyone Yes, Oracle is the only one with shared-disk architecture, but that is there advantage. It means you can add or remove nodes and the database lives on. In a shared nothing architecture, if you lose a node, you lose the system. I'm sure Oracle appreciates EMC highlighting their advantage.I also desire to signal in your RSS feeds. Thank you as soon as once again and maintain up the great operate Awesome post! Thank you very much || thanks for nice content this is really benefit to me.
0 Votes
+ -
Somebody STOP THE SPAMMERS!
MontrealPaul 20th Oct
Somebody STOP THE SPAMMERS!

First - very interesting article, Robin, and as usual, the comments are equally, and sometimes even more, interesting!

However, the last few have been fake comments, probably automatically generated, with links leading to junk sites, probably also generating "click revenue" (hover before clicking!)

Does someone have the ability to delete these messages?
They are the dozen or so above this one, with the poster's names all in CAPS.

Join the conversation!

Formatting +
BB Codes - Note: HTML is not supported in forums
  • [b] Bold [/b]
  • [i] Italic [/i]
  • [u] Underline [/u]
  • [s] Strikethrough [/s]
  • [q] "Quote" [/q]
  • [ol][*] 1. Ordered List [/ol]
  • [ul][*] · Unordered List [/ul]
  • [pre] Preformat [/pre]
  • [quote] "Blockquote" [/quote]
ie8 fix

The best of ZDNet, delivered

ZDNet Newsletters

Get the best of ZDNet delivered straight to your inbox

Facebook Activity

White Papers, Webcasts, & Resources
ie8 fix