ie8 fix

Mac fail: SSD security

By | February 21, 2011, 8:33am PST

Summary: Apple consumes 50% of the world’s NAND flash - and their flagship OS can’t securely delete SSD data. Isn’t total control of the hardware and software supposed to improve integration?

SSDs, Mac OS X and data security don’t mix. Not only does the standard file delete not delete files - which savvy readers already know, but even the Mac’s “Secure Erase Trash” function leaves 2/3rds of a file recoverable.

“Fake Erase” perhaps?

The SSD problem
Vendors have struggled to make flash SSDs look like disk drives even though the underlying media are very different. Hard drives associate a physical location with each logical block address (LBA). SSDs don’t.

And that’s the security problem.

Our secure file deletion tools assume that the data is stored in a set physical location. If the LBA is written to, the existing data at that LBA can be presumed to have been overwritten. (Bad block replacement is the big exception to that general rule.)

But on flash-based SSDs, the firmware that makes flash look like a disk - the flash translation layer (FTL) - is constantly changing the physical address of the data. When the OS issues an overwrite, the FTL overwrites only the most recent location the data - leaving older locations untouched.

The research
This is a problem for all file systems, but according to a paper presented at FAST ‘11 last week, Mac OS 10.6 Secure Erase Trash command did an especially poor job.

The UC San Diego researchers, Michael Wei, Laura M. Grupp, Frederick E. Spada and Steven Swanson, ran 14 different file overwriting utilities 3 times on SSD and USB drives. They then disassembled the drives to electronically access the flash chips to see what data they could recover.

Here’s the table of their results:

Oddly enough, Secure Erase Trash was much more effective on cheap USB drives than on SSDs - the reverse of most of the other overwriting techniques.

What about Windows?
Windows does not offer a command equivalent to “Secure Empty Trash” so they aren’t misleading users about their data security. Apple chooses to offer “Secure Empty Trash” in the Finder menu so they need to ensure it does what they say.

The Storage Bits take
Apple consumes 50% of the world’s NAND flash - and their flagship OS can’t securely delete SSD data. Isn’t total control of the hardware and software supposed to improve integration?

Who, exactly, is minding the store?

No doubt the Mac OS X file system team can hack the already much-hacked HFS+ to fix this problem. But how is it that no one on the engineering team caught this problem?

Surely some engineer - from Toshiba or Samsung, flash and flash controller vendors to Apple - or in the OS X group, raised the issue of security. If that didn’t flag the problem, why didn’t the OS team’s regression testing find it?

HFS+ is long past due for retirement. It is time for Apple to get serious about how it’s products handle customer data. As an SSD-based Mac owner I’m more than a little peeved at the company’s cavalier attitude.

Note that Apple’s other major OS - iOS - wasn’t tested. But who can have a warm feeling about the iOS remote delete facility now?

Comments welcome, of course. I’ll have more on the UCSD paper later this week, but if you can’t wait here’s a link to the pdf of Reliably Erasing Data From Flash-Based Solid State Drives. Update: I added the What about Windows? paragraph above in response to the 1st comment.

Kick off your day with ZDNet's daily e-mail newsletter. It's the freshest tech news and opinion, served hot. Get it.

Robin Harris has been messing with computers for over 30 years and selling and marketing data storage for over 20 in companies large and small.

Disclosure

Robin Harris

Robin Harris is a president of TechnoQWAN, a consulting and analyst firm in northern Arizona. He also writes StorageMojo.com, a blog which accepts advertising from companies in the storage industry, and has a 25 year history with IT vendors. He has many industry contacts, many of whom are friends and all of whom he has opinions about. Robin has relationships with many companies in the technology industry. Every company he writes about may have sought to influence his opinion through carefully-crafted marketing messages and self-serving white papers, gifts ranging from desk calendars, t-shirts, lunches and trips as well as analyst or consulting assignments. He also invests in some technology companies. He may accept payment for services in stock as well. Robin discloses financial investments in or client relationships with companies named in Storage Bits. To help readers sort out the gold from the dross in his writings, Robin tries to communicate his reasons as clearly as he can. If you agree, you are intelligent and discerning. If you disagree, well, you disagree. In all cases, Robin encourages readers to subject everything they read, see or hear on the internet or from politicians to some simple questions: * What assumptions are implicit in the world view and judgments of the author? * What, if any, is the factual basis for the opinions the author expresses? * Is it reasonable, logical and clear? Your critical faculties: use ‘em or lose ‘em!

Biography

Robin Harris

Harris has been messing with computers for over 30 years and selling and marketing data storage for over 20 in companies large and small. He introduced a couple of multi-billion dollar storage products (DLT, the first Fibre Channel array) to market, as well as a many smaller ones. Earlier he spent 10 years marketing servers and networks. After leaving corporate life he founded TechnoQWAN, a consulting and analyst firm. He also developed StorageMojo into one of the top storage industry blogs.

Robin writes, consults, coaches and lives among the mountains of northern Arizona.

88
Comments

Join the conversation!

Just In

RE: Mac fail: SSD security
BerthaCounsellor 16th Dec
@ye: ...it is advertised to do. Thus leaving the user with a false sense of security. The reason(s) why are irrelevant.

Valid point! Here at couple counsellor we can't afford any leaks or errors!
0 Votes
+ -
Goodbye, Meester Bond
Robert Hahn Updated - 21st Feb 2011
This article is unclear. It appears that the researchers compared an off-the-shelf commercial OS to a number of military-grade 'shredders' from various countries' defense departments, and found the commercial-grade OS wanting. Since Apple had the bad luck to be the only commercial-grade OS tested, they get the hit piece on ZDNet. Did I miss something?
0 Votes
+ -
RE: Mac fail: SSD security
SmAcKjAcK Updated - 21st Feb 2011
@Robert Hahn

Good point. I wonder how Windows 7 or Ubuntu would perform in those same tests.
0 Votes
+ -
RE: Mac fail: SSD security
snoop0x7b 22nd Feb 2011
@SmAcKjAcK That'll depend on file system with Ubuntu... I have no answer for Windows 7.
0 Votes
+ -
RE: Mac fail: SSD security
WordpressGuy 13th Sep
@SmAcKjAcK Maybe that should be a response article. I shall do some research to see if there is any data on that.
Wordpress Training.
0 Votes
+ -
RE: Mac fail: SSD security
ripslyme00 16th Sep
@SmAcKjAcK I strongly believe windows 7 will have a better result
Dr Steven J White Reviews
Dr Sharon Packer Reviews
Dr Sydney Coleman Reviews
0 Votes
+ -
RE: Mac fail: SSD security
epark732 22nd Sep
@SmAcKjAcK
This was a really great read. Please keep the insight, opinions, and info coming. Thanks! Baltimore Chiropractor
0 Votes
+ -
RE: Mac fail: SSD security
thomasutt1984 3rd Oct
@SmAcKjAcK
What about xp or pro? dont you think they need some recommendation?
zygor guides
0 Votes
+ -
RE: Mac fail: SSD security
epark732 4th Oct
@SmAcKjAcK
Another great read. These articles and short informative pieces are always a delight to read and keep me coming back for more.
Las Vegas chiropractor San Jose chiropractor Sacramento chiropractor San Francisco chiropractor Minneapolis chiropractor Indianapolis chiropractor
0 Votes
+ -
RE: Mac fail: SSD security
Robin Harris Updated - 21st Feb 2011
@Robert Hahn
Windows 7 does not claim to perform a secure erase of any data. OS 10.6 does.

You can go to Microsoft's TechNet and download a command line utility - SDelete - that claims to zero all free blocks (-c option) or that will overwrite free blocks any number of times (-p option). But this isn't an option that civilians are likely to even know exists.

There are numerous 3rd party delete utilities for Windows, but Apple offers the option of a "Secure Empty Trash" that - if you have an SSD - doesn't do what it says.

Robin
0 Votes
+ -
@Robin Harris: and since only people who really, really want to securely erase their data go lengths getting "SDelete" utility, importance of it's possible failure is much more significant -- even though formally it is equal.
You can do multipass erase options using Disk Utility, however, the problem lies in part with SSD drives itself (hence the disparity in performance between a standard USB drive and a SSD drive.) In fact, you can apply a random write erase using military grade erase schemes, and the drive would still have recoverable data:

http://nvsl.ucsd.edu/sanitize/
so exactly what was your point? Oh, yeah. Double standards.
0 Votes
+ -
@denisrs: and since only people who really, really want to securely erase their data go lengths getting "SDelete" utility, importance of it's possible failure is much more significant -- even though formally it is equal.

If you want to test the effectiveness of sdelete feel free to do so. However any results would be indicative of that utility only. It would have no bearing on Windows.
@olePigeon: You can do multipass erase options using Disk Utility, however, the problem lies in part with SSD drives itself (hence the disparity in performance between a standard USB drive and a SSD drive.)

...it is advertised to do. Thus leaving the user with a false sense of security. The reason(s) why are irrelevant.
0 Votes
+ -
RE: Mac fail: SSD security
cy11q1 4th Mar 2011
@Robin Harris
All current versions of Windows claim to perform a multipass secure erase of drive free space (i.e.- after you empty the trash) from the command line. The command is
CIPHER /W:C:\
(replace C:\ with any folder on the drive whose free space you want multi-wiped).
0 Votes
+ -
RE: Mac fail: SSD security
HypnoToad72 9th Mar 2011
@Robin Harris - great post, and article - thank you.
0 Votes
+ -
RE: Mac fail: SSD security
BerthaCounsellor 16th Dec
@ye: ...it is advertised to do. Thus leaving the user with a false sense of security. The reason(s) why are irrelevant.

Valid point! Here at couple counsellor we can't afford any leaks or errors!
0 Votes
+ -
Really? You Had to Chose This One?
GlennAC 22nd Feb 2011
@Robin Harris

Wow, the false urgency of the article, and the conspiratorial tone of the writer, makes it hard for me to take seriously. Sure, Mac OS X has offered a Secure Empty Trash option for quite some time giving it one more advantage over MS Windows.

But the fact that such a feature no longer works on todays SSDs simply makes Macs equivalent to Windows PCs. How is that a disadvantage? Granted, the authors' point is that the OS implies that such functionality is still available. But it hardly warrants the "Oh my God! They're lying to their customers!" conspiratorial tone. I would expect this of a Windows fanboy, not a seasoned tech journalist.

There are plenty of other areas to criticize Apple on. Really? This was the one you chose? This just sounds petty.
0 Votes
+ -
RE: Mac fail: SSD security
snoop0x7b 22nd Feb 2011
@GlennAC That is a good place to criticize them. A false sense of security is a lot worse than knowing you're not secure...
0 Votes
+ -
RE: Mac fail: SSD security
snoop0x7b 22nd Feb 2011
@Robert Hahn The commercial grade OS's secure delete feature is comparable when you're talking about traditional media, which is why this comparison is worth making. These military grade data deletion algorithms are also publicly available...

Part of what he's exposing is how HFS+'s filesystem driver does not handle SSDs correctly for secure deletion.
0 Votes
+ -
RE: Mac fail: SSD security
krtinberg 30th Aug
@snoop0x7b I agree with this.. This was my line of thinking exactly.
barska binoculars
0 Votes
+ -
RE: Mac fail: SSD security
GAGYRO 22nd Feb 2011
@Robert Hahn You didn't miss anything ZDNet writers are paid to do hit pieces. And If you study the articles it is overwhelmingly against, now who could that be, I wonder?.
0 Votes
+ -
Only OS X in this test... Come on!
papyrus100 21st Feb 2011
Please be more critical of the data and the information you are reading. I am an Apple geek, but I want to get the whole picture, not just OS X. What about Windows XP/7/Mobile, Linux Red Hat, Linux Ubuntu or Sun Solaris? Where are they? An incomplete study brings incomplete conclusions.
You do not have enough data to conclude that OS X has flaws, we do not know about the others I have mentioned. When I see all the data, and if the date still says OS X has flaws, I will gladly complain to Apple about it. But until then, an incomplete study brings incomplete conclusions.
Also, other overwrite operations have a pretty high failure rate like pseudo random data yet, it is not mentioned in your article.
0 Votes
+ -
RE: Mac fail: SSD security
*Hutch* 22nd Feb 2011
@papyrus100
There is nothing to test on the other OS's. Only OS X makes the claim that data is securely erased.
0 Votes
+ -
RE: Mac fail: SSD security
Gis Bun 22nd Feb 2011
@papyrus100 : Why do you want to show the other OSs? Aside from Hutch's comment that the others don't claim to have some type of secure trash, there is no reason for a comparison - unless you want to switch your allegiance.
0 Votes
+ -
RE: Mac fail: SSD security
Tommy S. 1st Apr 2011
@papyrus100 Windows does not make any claim of a secure erase feature. OS X falsely claim to do it. I think the issue is rather simple.
0 Votes
+ -
RE: Mac fail: SSD security
magikben 21st Feb 2011
I think that Robin needs to learn about iOS and its encryption techniques before blindly commenting on it. On 3GS phones and above, hardware encryption protects the data and the wipe simply pulls the encryption key rendering the data effectively gone.
0 Votes
+ -
RE: Mac fail: SSD security
Robin Harris 21st Feb 2011
@magikben
And you're absolutely sure that the key is not recoverable?

I'm not. I'd like to see a 3rd party data recovery firm confirm it.

Robin
0 Votes
+ -
RE: Mac fail: SSD security
magikben 21st Feb 2011
@Robin Harris
Sure, that makes sense, so let me see what I can dig up.
0 Votes
+ -
RE: Mac fail: SSD security
snoop0x7b 22nd Feb 2011
@Robin Harris In theory the cryptographic key needs to be accessible every time you mount the root filesystem... So if you're not typing a password to mount that file system that key needs to be available to the init process. I'm going to go with yes, it is recoverable because you don't need a password to start iOS devices. And also because it was recently revealed that you can easily crack the iOS keychain.
0 Votes
+ -
RE: Mac fail: SSD security
snoop0x7b 22nd Feb 2011
@magikben He made no comment about iOS. Plus it was recently revealed that you can steal taht key fairly easily.
0 Votes
+ -
RE: Mac fail: SSD security
Michael Kelly 21st Feb 2011
What about "dd if=/dev/zero of=/dev/hd?"? Can't a Mac do that?
0 Votes
+ -
RE: Mac fail: SSD security
greenl1ght 21st Feb 2011
@Michael Kelly Due to garbage collection and wear leveling algorithms, that won't work to clear all data on an SSD.
0 Votes
+ -
Windoze fanboy whining, nothing to see here
comp_indiana 21st Feb 2011
What a clueless rant. As if SSD were a security problem akin to the total mess you have in Windoze-land!

What is this a JOKE COLUMN? You have NO SECURITY WHATSOEVER on Windows--ins't that BLEEDINGLY obvious?

Thanks for the tip, but this is not a federal case here. On an SSD it takes very little time to overwrite the entire contents a few times, so your article is a total fail. Anyone that really wanted to obliterate the data would overwrite it and not merely erase it. Yes, this is what secure erase is supposed to do. I'm sure that if YOU are right (questionable since you are biased) then Apple will fix that on the next free point update.
0 Votes
+ -
RE: Mac fail: SSD security
Hallowed are the Ori Updated - 21st Feb 2011
.
0 Votes
+ -
You don't read this column much, do you?
use_what_works_4_U 21st Feb 2011
@comp_indiana
Robin is a Mac user, hardly a Windows (note the spelling please) Fanboy. The issue is quite relevant for those of us who deal in sensitive data every day. If the OS tells me that my data has been overwritten and is irrecoverable, then that need to be the case!
0 Votes
+ -
RE: Mac fail: SSD security
snoop0x7b 22nd Feb 2011
@macadam Damn right!
0 Votes
+ -
RE: Mac fail: SSD security
Gis Bun 22nd Feb 2011
@comp_indiana : Jeez. Get a life. You're the one whining because Apple lied/failed. So what do you do? Blame it on [what you call] Windows lack security? Ya. Right. Funny how Windows was never mentioned in the article. The article is just showing that OS X's secure trash got trashed. It doesn't work. Grow up.
0 Votes
+ -
RE: Mac fail: SSD security
snoop0x7b 22nd Feb 2011
@comp_indiana Actually no, what he revealed was that in reality you believe you're overwriting the content, but you're not because each block is not individually addressable. Plus not to mention, you don't necessarily want to overwrite the entire drive just to delete a file.

Regardless, if you have trade secrets or other confidential information stored on that SSD and you "secure delete" it (which is an advertised feature) you aren't getting what you expect, you're getting a false sense of security. If you believe that data is gone for good you're going to make different assumptions about the physical security of that device which could be harmful and possibly leave you legally liable for the damages incurred by your carelessness.

The fact is by including that feature, even when there is an SSD, Apple is misleading you and it can have real consequences.
0 Votes
+ -
SO WHAT FILES SYSTEM DO YOU WANT?
jameskatt Updated - 21st Feb 2011
SSDs change the location of a file frequently in order to avoid wearing out the flash modules.

The SSD changes the location of the file on the disk no matter what file system you use.

No matter what file system you use, this will be a problem.

Thus, what file system do you propose to replace Mac OS X HFS????? If you have no idea, then this article sucks for complaining without a solution.

In fact, the only way to securely erase a file on an SSD is to simultaneously overwrite the empty space in the SSD. Of course, this will just wear out an SSD more quickly.
0 Votes
+ -
RE: Mac fail: SSD security
Robin Harris 21st Feb 2011
@jameskatt
The general outlines of a solution seem to lie in the direction of added intelligence in the flash controller. It needs to understand that when a secure erase of a file is selected, the controller has to erase not only the current file blocks, but also the past blocks that held any part of the file.

On a well-used SSD, garbage collection will eventually get around to overwriting all old blocks. But as disk sizes increase and data cools, that interval could become quite long.

There is an industry effort to formulate a standard to total SSD overwriting - similar to the secure device erase in the SATA command set - but secure file delete won't be addressed by that.

Given Apple's long time commitment to flash storage and their status as the world's #1 consumer, I'm disappointed that they didn't figure this out years ago.

Robin
PS - I'd like them to replace HFS+ with ZFS - which they almost did in 10.6 server.
0 Votes
+ -
RE: Mac fail: SSD security
killirien@... 21st Feb 2011
@Robin Harris
So long story short ... this isn't an Apple only problem. It's industry wide and more to do with the medium. How would zfs help?
That's the theory.

However, all SSD drives have part of their capacity reserved for the wear-levelling, so you can NEVER do anything to ALL of the drive. There will always be part that is inaccessable, and that part can have old versions of files on them.

Which means that SSDs are inherently insecure.

I remember OCZ had a secure erase or rest utility, but I don't know whether that actually erased the complete drive.

TRIM supposedly erases after a delete, rather than the default action before another write, but whether that enables a complete predictable erase is unknown to me.
0 Votes
+ -
RE: Mac fail: SSD security
snoop0x7b 22nd Feb 2011
@jameskatt Other file systems may or may not have a way to deal with this. You CAN have meta data about a file stored as a part of the file system... That's what metadata is for.
0 Votes
+ -
Wrong...
james347 21st Feb 2011
...SSD is fast, light, and portable. That's all anyone needs to know and care about. The rest of this mumbo-jumbo is fear mongering.
0 Votes
+ -
No, it's not feat mongering.
ye 21st Feb 2011
@james347: The rest of this mumbo-jumbo is fear mongering.

The fact is one cannot rely on Secure Delete to securely delete a file.
0 Votes
+ -
Total failure to understand ..
Patanjali 21st Feb 2011
@james347
.. that others may do some data critical things with their computers, and require that there are NO remnants of deleted files.
0 Votes
+ -
RE: Mac fail: SSD security
james347 22nd Feb 2011
@Patanjali

Only Criminals need to try and cover their tracks. Sounds like you have something to hide.
0 Votes
+ -
RE: Mac fail: SSD security
snoop0x7b 22nd Feb 2011
@james347 Or people who are storing confidential information like health records on a server, or people storing confidential business information, client-attorney correspondences, government secrets, or any of the wide array of confidential information I can think of.

That "only criminals need secrecy" argument is also a terrible argument. If that's the case, please email me all of your personally identifiable information.
0 Votes
+ -
RE: Mac fail: SSD security
snoop0x7b 22nd Feb 2011
@james347 It's all mumbo jumbo until you're storing confidential information and expect to be able to securely delete it, as per relevant laws and regulations. Tell me it's baseless mumbo jumbo and FUD when you store something confidential and end up liable for not educating yourself about the implications of a particular storage medium.

Personally, I have confidential business information on my work laptop (on an encrypted disk). I'm happy Robin brought this to my attention, because it will definitely influence my organization's security policies for future laptops with SSDs.

Join the conversation!

Formatting +
BB Codes - Note: HTML is not supported in forums
  • [b] Bold [/b]
  • [i] Italic [/i]
  • [u] Underline [/u]
  • [s] Strikethrough [/s]
  • [q] "Quote" [/q]
  • [ol][*] 1. Ordered List [/ol]
  • [ul][*] · Unordered List [/ul]
  • [pre] Preformat [/pre]
  • [quote] "Blockquote" [/quote]
ie8 fix

The best of ZDNet, delivered

ZDNet Newsletters

Get the best of ZDNet delivered straight to your inbox

Facebook Activity

White Papers, Webcasts, & Resources
ie8 fix