Microsoft goes public with plans for its new Windows 8 file system

By | January 16, 2012, 2:38pm PST

Summary: Microsoft officials are sharing some details about the new ReFS file system that will debut first as part of Windows Server 8.

Microsoft officials are finally sharing publicly details about “Protogon,” the new file system that the company is developing as part of Windows 8.

Officially named ReFS — for Resilient File System — the new file system will be made available via a staged “evolution,” according to a January 16 post on the “Building Windows 8″ blog.

ReFS will begin life as a storage system for Windows Server only. Then — some time post Windows 8 — it will become a storage system for Windows clients, and then ultimately “as a boot volume,” said author of the post, Surendra Verma, a development manager on the Windows Storage and File System team. (Interestingly, when the first leaks about ReFS, codenamed Protogon, occurred last year, those who discovered the new file system found it in leaked Windows 8 client builds.)

NTFS, the New Technology File System, has been part of Windows since Windows XP and Windows NT 3.1 were introduced in 2001 and 1993, respectively. (Thanks for the date corrections, readers.)

There are some NTFS features for which Microsoft plans to drop support with ReFS, specifically named streams, object IDs, short names, compression, file level encryption (EFS), user data transactions, sparse, hard-links, extended attributes, and quotas, Verma blogged. That said, one of Microsoft’s goals with ReFS is to “maintain a high degree of compatibility with a subset of NTFS features that are widely adopted while deprecating others that provide limited value at the cost of system complexity and footprint,” Verma said.

ReFS is designed to complement the Storage Spaces feature in Windows 8 and Windows Server 8. It will help with the verification and auto-correction of data and optimize for scale, according to the post. Here’s Verma’s explanation of the internals:

“Underneath this reused portion (the code responsible for implementing the Windows file system semantics), the NTFS version of the code-base uses a newly architected engine that implements on-disk structures such as the Master File Table (MFT) to represent files and directories. ReFS combines this reused code with a brand-new engine, where a significant portion of the innovation behind ReFS lies.”

It’s interesting to hear that Microsoft is doing what very early rumors about Windows 8 claimed it would: Introduce a new file system. (Though to be fair, some early tipsters claimed the Softies planned to do away with the core file system all together in Windows 8….)

Update: As reader Mahesh Sreekandath (@msreekan) noted in the comments below, NTFS, despite its longevity, hasn’t always been architected to handle tasks in the most elegant manner. (See Softie Raymond Chen for an example.) Microsoft execs don’t want to come out and diss NTFS, since it’s the file system inside Windows 7 and Windows Server 2008 R2. But if you’re wondering why Microsoft is thinking about reengineering the file system, just know it seemingly could stand some improvement.

Kick off your day with ZDNet's daily e-mail newsletter. It's the freshest tech news and opinion, served hot. Get it.

Topics

Mary Jo has covered the tech industry for more than 25 years for a variety of publications and Web sites, and is a frequent guest on radio, TV and podcasts, speaking about all things Microsoft-related. She is the author of Microsoft 2.0: How Microsoft plans to stay relevant in the post-Gates era (John Wiley & Sons, 2008).

Disclosure

Mary-Jo Foley

Freelance journalist/blogger Mary Jo Foley has nothing to disclose. WYSIWYG (what you see is what you get). I do not own Microsoft stock or stock in any of its partners or competitors. I have no business ventures that are sponsored by/funded by Microsoft or any of its partners or competitors.

Biography

Mary-Jo Foley

Mary Jo Foley has covered the tech industry for 25 years for a variety of publications, including ZDNet, eWeek and Baseline. She has kept close tabs on Microsoft strategy, products and technologies for the past 10 years. In the late 1990s, she penned the award-winning "At The Evil Empire" column for ZDNet, and more recently the Microsoft Watch blog for Ziff Davis.

Got a tip? Send her an email with your rants, rumors, tips and tattles. Confidentiality guaranteed.

Talkback Most Recent of 122 Talkback(s)

  • RE: Microsoft goes public with plans for its new Windows 8 file system
    Fascinating overview of the new file system storage mechanisms coming in ReFS.

    Key takeaways:
    * Data integrity is far and away the key priority
    * Ability to recover from many forms of corruption seamlessly and without user intervention
    * Works on partnership with StorageSpaces to provide a holistic reliable, scalable file storage system
    * ReFS comprises the lowest layers of the filesystem so most existing apps will continue to work as expected
    * Pretty much every "limit" (directory size, file size, filename length, etc) are essentially "gone"

    Can't wait to get my hands on this wink
    ZDNet Gravatar
    bitcrazed
    16th Jan
  • RE: Microsoft goes public with plans for its new Windows 8 file system
    @bitcrazed I know what you mean! I'm annoyed we're apparently not getting it in Win8 D=

    Thanks for the list by the way. That's the kind of data I was hoping for, in just the format I prefer. Hah!
    ZDNet Gravatar
    Imrhien
    16th Jan
  • RE: Microsoft goes public with plans for its new Windows 8 file system
    @Imrhien - don't be annoyed. Be glad that MS takes the time to bake a change this substantial. The client desktop is a very hostile environment filled with any number of flaky, shaky apps that could trip up if MS changes the on-disk file format.

    Better they bake the server which is generally a much better-managed, cleaner, more demanding environment and then apply any learning & fixes to the client port.

    This is one area where MS should, and will, take a very conservative approach.
    ZDNet Gravatar
    bitcrazed
    16th Jan
  • RE: Microsoft goes public with plans for its new Windows 8 file system
    @bitcrazed

    Good point about the apps having to be rewritten to not call for some of those things that Microsoft is going to remove. If they aren't? Flaky and shaky will be the LEAST of the names given to Windows * with ReFS.
    ZDNet Gravatar
    Lerianis10
    16th Jan
  • would be interesting
    @bitcrazed .. to have ZDNet or Tech Republic do an in depth side-by-side break-down / comparison between NTFS and ReFS - maybe even a comparison / contrast between ReFS and other common file systems in use: like, say, HFS+, XFS or even ext3. (Possibly Harris or Bott to do so .. maybe both).

    As to your comments, i couldn't agree more: ReFS looks like a great evolutionary step forward in MS file system development. (Echoing the sentiment about removing many hard & soft limits / impediments that previously existed with prior file system architectures).
    ZDNet Gravatar
    thx-1138_@...
    16th Jan
  • RE: Microsoft goes public with plans for its new Windows 8 file system
    @thx-1138_@...

    I think they should compare it more with Btrfs. It's not fully out yet (the fsck utility in particular has yet to surface), but it seems to have a lot of the same underlying technology as ReFS - while at the same time providing a few features that ReFS does not... For example, copy-on-write snapshots.

    I'd say, overall, the five filesystems to be compared are:

    Commonly used already:
    ZFS
    Ext4
    NTFS

    In Development:
    ReFS
    Btrfs

    The reason why I include Ext4 in there, is because it's the de-facto filesystem on Linux at the moment - hence it's good to compare things to how things "Really are," and not just how things "Will be."
    ZDNet Gravatar
    Tynach
    18th Jan
  • RE: Microsoft goes public with plans for its new Windows 8 file system
    @bitcrazed Sure hope they re-worked the filter driver hooks, maybe firewall them a bit and make them not so darn difficult to write for the filesystem so that 3rd parties can't bluescreen the box. Seeing that about 99% of the bluescreens I've seen that come from NTFS.sys are all related to some filter driver issue I would think that would be on their radar.
    ZDNet Gravatar
    TardHugger@...
    17th Jan
  • Half-baked on rev.v.1.0
    @bitcrazed
    So, let's see, ZFS is on what, version 29 . . . version 30 . . . what ever.... It takes a bit of time to get those types of features baked in and working. Not sure how they can get a lot of them working on v.1.0. Just separating the disk engine from NTFS layer with no features adds is going to be tough enough. It would be like separating the Disk Mangement interface into two separate pieces. The part that is "online", "initialize" and "partition would have to be all in some sort of ZFS like construct with pools, virtual devices (vdev), vdev redundancy (mirror, raid, raw) and replacemnt/repair/scrub tools. And then the NTFS layer with format, drive letter, mount point stuff. Also, for server side, no mention of ZFS style enhancements like SSD log or SSD cache adjunct features.
    ZDNet Gravatar
    eddoaloha
    17th Jan
  • It's not ZFS doh doh ...
    @eddoaloha reply by @cracoscosmos -- First of all, it's more like AZFS and second of all I commend your references, though ... !
    ZDNet Gravatar
    crcgraphix
    17th Jan
  • RE: Microsoft goes public with plans for its new Windows 8 file system
    @bitcrazed
    You can, it's all been in ZFS since 2005.
    ZDNet Gravatar
    914four
    17th Jan
  • RE: Microsoft goes public with plans for its new Windows 8 file system
    @bitcrazed About damn time! I'm tired of only been able to move or copy files that have a certain amounts of characters in them/total path length.
    ZDNet Gravatar
    guiri
    17th Jan
  • RE: Microsoft goes public with plans for its new Windows 8 file system
    @bitcrazed One of the most annoying "limits" is the lack of case sensitivity. Fix that and we'll have better interoperability with Linux.
    ZDNet Gravatar
    davidr69
    17th Jan
  • RE: Microsoft goes public with plans for its new Windows 8 file system
    @davidr69 NTFS actually has that feature. If the filename is in the POSIX namespace it will not only be case sensitive compared but it will allow many characters not usually legal in Windows filenames.
    ZDNet Gravatar
    AsifHussain1
    17th Jan
  • RE: Microsoft goes public with plans for its new Windows 8 file system
    @davidr69 Fixing Case Sensitivity will Break most of the Existing Software, All the developers and user's have been ignoring case. Most utilities wont work. Utter Kiosk, unless they can switch it off.
    ZDNet Gravatar
    narenhacker@...
    17th Jan
  • RE: Microsoft goes public with plans for its new Windows 8 file system
    @davidr69
    One of the most annoying features of Linux et al is the case sensitivity. It's a real pain.
    Rather than fixing the biggest operating system to work better with something that only geeks use, why not start a movement to make Linux have a non-case-sensitive mode of operation?
    ZDNet Gravatar
    JoCaBa
    18th Jan

Talkback - Tell Us What You Think

Formatting +
BB Codes - Note: HTML is not supported in forums
  • [b] Bold [/b]
  • [i] Italic [/i]
  • [u] Underline [/u]
  • [s] Strikethrough [/s]
  • [q] "Quote" [/q]
  • [ol][*] 1. Ordered List [/ol]
  • [ul][*] · Unordered List [/ul]
  • [pre] Preformat [/pre]
  • [quote] "Blockquote" [/quote]

The best of ZDNet, delivered

ZDNet Newsletters

Get the best of ZDNet delivered straight to your inbox

Facebook Activity

White Papers, Webcasts, & Resources