Building our massive storage Media Tank

Building our massive storage Media Tank

Summary: We continue our massive Media Tank story by answering the questions almost everyone asked: what's inside? Read on, and we'll tell you all about it.

SHARE:
TOPICS: Storage
14

Choosing the right mobo got the first six drive interfaces

When looking for a motherboard, I had one simple requirement: lots and lots of SATA ports. Okay, I had a second requirement: relatively inexpensive. I wasn’t about to go buy a multi-thousand buck enterprise-quality motherboard. That would blow the whole budget in one go. I still needed to build a second backup Tank (and we were saving to buy our house).

I wound up settling on the ASUS M4A88T-M motherboard (now discontinued), which as you’ll notice sports six (count ‘em, six!) SATA ports. The board also has USB 3.0 (which was nice for future growth), HDMI, and a bunch of other yada yada. The nice thing was that the entire board (six SATA ports and all), was $94.

ASUS mobo
Notice the SATA ports at lower right (image courtesy Newegg)

Processor didn’t matter much, so I threw a hundred buck Athlon into it, along with 4GB of RAM. I was running 32-bit XP, so RAM also didn’t matter much.

The drive cages

I’ll come back to the drive interfaces in a minute, but first let’s talk about the drive cages. There was a physical issue: how many drives could I fit into one mid-tower case? As it turned out, I found a set of very slick drive bays, the iStarUSA BPU Hot-Swap Cages. Each cage holds five hard drives, and fits where you’d normally put three 5.25-inch drives (think CD-ROM or DVD-ROM drive).

These beasts were $115, and – if I could find a case with six open, full-size bays, I could use two of them. That’s how I got to my ten drive requirement for the Media Tank. Each drive screws into a sliding carrier and can slide in and out of the Tank body without opening the whole thing up.

Drive cage
Drive cage (image courtesy Newegg)

One note: I actually bought four bays (one set for the main Tank and one set for the backup Tank). One of the drive slots in the backup Tank just doesn’t work. It’s unfortunate, but it was just such a hassle putting all these parts together that I’ve just ignored that drive slot for now. If it ever becomes a storage issue, I’ll deal with it.

Extra SATA ports

By now, you’ve probably done a tiny little bit of math. You’ve calculated that with ten drive bays, and only six SATA ports, there’s a shortfall of four SATA ports. I needed to add ports.

This time it was off to Amazon, where I scored two StarTech.com 2 Port PCI Express internal SATA II controller cards for under $25 each.

Each card uses up a single PCI Express port and as luck (and my purchasing choices) would have it, the ASUS mobo I picked up had two PCI slots. Two 2-port SATA II cards would buy me my extra four ports.

These cards are also designed to work as RAID devices, but I just configured them to give me ports. I now had SATA ports for each of my drive slots.

Next up, the case, power and the price/performance curve...

Topic: Storage

About

David Gewirtz, Distinguished Lecturer at CBS Interactive, is an author, U.S. policy advisor, and computer scientist. He is featured in the History Channel special The President's Book of Secrets and is a member of the National Press Club.

Kick off your day with ZDNet's daily email newsletter. It's the freshest tech news and opinion, served hot. Get it.

Talkback

14 comments
Log in or register to join the discussion
  • Keep 'em coming

    Most interesting stuff I've read on ZDNet in a while. I have an Aspire Easystor H340 that does the trick for now, but I'll eventually outgrow it (or it will die at some point), so I'm taking notes here.
    MichelR666
  • Awesome!

    I want to build one kinda like yours David. Is it really that hard to just take the case cover off and snap a few pics? Nothing too extreme depending on where the tank sits.
    Please?
    JustWow2000
  • I will keep my advice short...

    For storage, never, ever use anything but ZFS!
    If you value your data, that is. :)
    danbi
    • That is poor advice

      So we are fortunate that is was short.
      John Zern
  • XP, David?

    I'm generally not one of the people around here who participate in OS wars or anything, but if you're making a huge dedicated storage array whose life's purpose is to share folders, why not use one of the many excellent appliance operating systems?

    My home storage server runs NAS4Free, and runs it very well. FreeNAS, OpenFiler, NexentaStor, and OpenMediaVault are all explicitly designed for the very purpose for which you're assembling the hardware. Additionally, some of the distributions above run on ZFS, which is among the best file systems available for highly resilient storage.

    I know you said that Linux finds its way to annoy you in one form or another, and I completely concur with your decision to not install Ubuntu/Fedora/Cent and try to coax it into not making a mess. However, purpose-built Linux appliances are generally more stable and user friendly, and in nearly every case uses a browser based control panel instead of requiring the use of a command prompt. I've never used it out of necessity on my box.

    Check 'em out before you opt for XP. Windows may be familiar, but there is decisive optimization for storage in NAS4Free/FreeNAS/OpenFiler/NexentaStor/OpenMediaVault. Truth be told, the amount of work it would take to mold XP into a storage server is roughly the same amount of work it would take to take a lap around the UIs of these projects.
    Joey
    voyager529@...
    • Nope

      I have never experienced Linux to be more stable than NTFS-based machines. I've had EXT3-based Linux machines (which is what, years ago, we started with as a file server) crash to unrecoverability, where the NT server we ran ran for something like 5 years without a restart.

      ZFS may be well done, but it's complex and persnickety. NTFS just works. I've never, ever lost a system to NTFS, but had a variety of Linux machines fail in completely unrecoverable and nasty ways.

      The Tank is a good example. Even though it's grown, it's been rock-solid robust for the last three years. That's because of NTFS. XP, for this purpose, is merely a shell around the NTFS and SMB environment.
      David Gewirtz
      • ZFS

        Let's just say, that ZFS is not an Linux thing. Linux might have some good spots, but filesystems is not one of these.

        ZFS was designed by SUN in Solaris and is best available in Solaris, it's derivatives, like OpenIndiana etc and, FreeBSD. There is Linux port of ZFS but it is still not very well integrated. There is also an OS X port of ZFS, which too, is not very well integrated. All of these platforms will do fine with ZFS for storage (even Linux and OS X). To my knowledge, these is no usable ZFS port for anything Windows.

        ZFS is by far the best possible platform for storage. It integrated both device manager, caching, volume manager, block device and POSIX filesystem layers. ZFS ensures reliability by using end-to-end cryptographic checksums for every block it writes, plus plenty of redundancy of metadata to recover from many different data corruption scenarios. In fact, if your "computer" hardware, such as CPU, memory is "good", ZFS will take care of your data consistency.

        One of the original design goals of ZFS was to take care of the ever increasing size of disk drives and the more or less constant amount of error correction that is provided. For example, consumer disks provide sort of 10^14 error rate. This means, that for every 12.5TB of data you read, you will inevitably have at least one bit wrong. That is, with any other file system, reading your entire "tank" data will provide you with at least one file that is read wrong. Now, consider you will process that file and write it back.. with the wrong data. And hopefully you get the idea.
        Going with the much more expensive enterprise drives gives you just 10^15 error rate, which means you will garble your data after just 10 full reads...

        Doesn't matter if it's NTFS, FAT32, EXT3 or UFS. Or HFS+. As long as your huge file storage doesn't do integrated end-to-end cryptographic checking for *everything* your data is silently corrupt. You should have kept your paper receipts :)

        You think it's rock solid, only because you have't yet discovered the data corruption.
        Been there, done that. Never be naive with storage again.
        danbi
      • In Agreement

        I'm in agreement with you David. For a while, I drank the purple, sweet Linux juice only to find that it would let me down. Granted, most of my experience is with Red Hat and all of it's variants such as CentOS and Fedora.

        Starting with Windows XP/Server 2003, my issues have been very small. With the advent of Vista/Server 2008 and all later versions (OS versions 6.0, 6.1, and recently 6.2) losing data to a NTFS Windows' share has been a nonissue--even on a failed Dell PowerVault MD1000/3000.

        If I ever take on a personal project--and even a professional one in which I have controlling interest--I will use Windows Server backends for the storage and let OSX and Linux clients and servers play nicely with it.
        DarienHawk67
      • I agree

        When building my home storage server I really wanted to go with ZFS. Since my NIC was not supported by OpenIndiana I got cornered into Linux and went with Ubuntu Server.

        It works great for me, but I fully agree, with you David, that for an all Windows network it would be easier to get XP fully optimized than all of the fun that I've had with Samba.
        swoarrior
    • Those appliance OS's.....

      Such as OpenFiler, are usually Red Hat based systems. I have used OpenFiler many times and it has never failed on any server I installed. Using a good raid controller, David's Tank can be built with the same costs and would be much more reliable too.

      But XP??? Come on David......
      linux for me
  • Were These Full Retail Copies Of XP?

    Because you're not allowed to install OEM XP licences on a machine for your own use.
    ldo17
    • Fully compliant

      Over the course of the years, we bought a tremendous number of XP licenses, which were on machines taken out of service. It is entirely within licensing parameters to move a license purchased from one hardware machine to another.

      I very rarely bought machines with OEM XP licenses on them. During the XP era, with the exception of a few laptops, we built most of our machines and bought separate XP licenses. We've done the same with Win7, including my super-honker laptop, which I bought without an OS and then bought and installed my own.
      David Gewirtz
  • Use Server 2008 R2/2012 Eval

    As I am pretty sure you already know, you can legitimately use Widows Server 2012 (or 2008 R2) 180-day eval edition. With a single, fully MSFT supported command line, you can have your fully authorized and activated "server" running for a very long time. Note that I am not talking about any hacks, cracks, etc. The server can be fully patched and updated with all of the latest WGA technologies.

    The Eval server should still be very active by the time you decide to build the Mark [x].
    DarienHawk67
  • Time for an upgrade ?

    Nice article, but you might want to start thinking about an upgrade. XP is old, and it's SMB stack is old and slow. If you were to upgrade to 2008, or 2012, you would get SMB2, and some serious networking improvements. I would also recommend some level of RAID protection, just in case one of those drives die. Also, a backup strategy for this beast might be in order, as a nifty flood, or fire, could eradicate your known universe.
    Another thought... external 8 bay tower, with internal hardware RAID in the tower, connected over USB3, stuffed with 2 or 3TB drives... Then you could use any stock PC as the NAS gateway.
    Iozone