ie8 fix

Build a RAID 6 array for $100/TB

By | September 1, 2009, 10:36am PDT

Summary: Build your own cloud-style storage for $100/TB that makes Amazon’s S3 look pricey. Perfect for ripping 10,000 DVDs to disk!

Imagine storage that didn’t cost much more than bare drives. High density storage with RAID 6 - double-fault - protection, reasonable bandwidth and web-friendly HTTPS access.

And really, really cheap.

Not your enterprise’s RAID array
Raw disk cost is only 5-10% of an enterprise RAID system’s cost. The rest goes for corporate jets, sales commissions, tradeshows, sheetmetal, 2 Intel x86 mobos, obscene profits and some pale and blinking engineers in a windowless lab who make it work.

But what if you don’t want 4-color brochures or the barely-clad booth babes. What if you just want cheap economical and reliable storage?

You aren’t running the global financial system - what’s left of it anyway - or a 500 person call center. But you want enough redundancy so it will stay up until morning.

Meet the Storage Pod
You aren’t the only one. Backblaze, a new online backup provider, designed the Storage Pod for their own use and are sharing it with everyone. They aren’t selling it - that’s where the build comes from - so they aren’t trying to get rich off you.

Here’s what it looks like:

Here’s an exploded diagram with a simplified BOM:

And then there’s the (free) software. 64-bit Debian Linux, IBM’s open source JFS file system and HTTPS access. Simply stated each file gets a URL. Put a web server in front of it and serve the world - or just your home.

The Storage Bits take
Many applications just need a big bucket that doesn’t cost $5,000/TB. This is it.

You can build it yourself, but it is probably more complex than a high-end gamer system. Download the 3D SolidWorks files and have Protocase build you 1 or 500 of the boxes.

But the density is good, the performance is reasonable, the availability is decent and the price is right. This is a DC-3, not a 747. It is all you need for the right application.

And at $100/TB you can mirror all your data 2 or 3 or 4 times if you need more availability - and still be way less than half the cost of name brand arrays. Get the details from the Backblaze blog.

Comments welcome, of course. BTW, I’m trying out their free trial Mac online backup - at least one of the founders worked at Apple - and I’ll let you know how it goes. I don’t have a business relationship with them either, in case you’re wondering.

Kick off your day with ZDNet's daily e-mail newsletter. It's the freshest tech news and opinion, served hot. Get it.

Topics

Robin Harris has been messing with computers for over 30 years and selling and marketing data storage for over 20 in companies large and small.

Disclosure

Robin Harris

Robin Harris is a president of TechnoQWAN, a consulting and analyst firm in northern Arizona. He also writes StorageMojo.com, a blog which accepts advertising from companies in the storage industry, and has a 25 year history with IT vendors. He has many industry contacts, many of whom are friends and all of whom he has opinions about. Robin has relationships with many companies in the technology industry. Every company he writes about may have sought to influence his opinion through carefully-crafted marketing messages and self-serving white papers, gifts ranging from desk calendars, t-shirts, lunches and trips as well as analyst or consulting assignments. He also invests in some technology companies. He may accept payment for services in stock as well. Robin discloses financial investments in or client relationships with companies named in Storage Bits. To help readers sort out the gold from the dross in his writings, Robin tries to communicate his reasons as clearly as he can. If you agree, you are intelligent and discerning. If you disagree, well, you disagree. In all cases, Robin encourages readers to subject everything they read, see or hear on the internet or from politicians to some simple questions: * What assumptions are implicit in the world view and judgments of the author? * What, if any, is the factual basis for the opinions the author expresses? * Is it reasonable, logical and clear? Your critical faculties: use ‘em or lose ‘em!

Biography

Robin Harris

Harris has been messing with computers for over 30 years and selling and marketing data storage for over 20 in companies large and small. He introduced a couple of multi-billion dollar storage products (DLT, the first Fibre Channel array) to market, as well as a many smaller ones. Earlier he spent 10 years marketing servers and networks. After leaving corporate life he founded TechnoQWAN, a consulting and analyst firm. He also developed StorageMojo into one of the top storage industry blogs.

Robin writes, consults, coaches and lives among the mountains of northern Arizona.

24
Comments

Join the conversation!

Just In

RE: Build a RAID 6 array for $100/TB
FAULKNE 13th Oct
Good day to confirm this comment I would appreciate T h e b e s t o f Z D N e t d e l i v e r e d your website very nice to everyone Yes, Oracle is the only one with shared-disk architecture, but that is there advantage. It means you can add or remove nodes and the database lives on. In a shared nothing architecture, if you lose a node, you lose the system. I'm sure Oracle appreciates EMC highlighting their advantage.I also desire to signal in your RSS feeds. Thank you as soon as once again and maintain up the great operate Awesome post! Thank you very much || thanks for nice content this is really benefit to me.
0 Votes
+ -
Is that per terabyte, or
chrome_slinky@... 1st Sep 2009
per 1 trillion bytes. Sorry, I just had to.
0 Votes
+ -
I want one!
BillDem 1st Sep 2009
This would be the ideal replacement for my pair of MediaSmart servers and external 8 drive enclosure.
0 Votes
+ -
Why not OpenSolaris and ZFS? Both for free download & use.

OpenSolaris has kernel CIFS, too, so this would be a heckuva NAS unit.

--
Dave
0 Votes
+ -
Needs more cowbell ! /eom
Arapey 1st Sep 2009
eom
0 Votes
+ -
At last
johnfenjackson@... Updated - 1st Sep 2009
Real design work ... instead of DROBO and HP Mediasmart WHS corporate monetising mediocrity.
0 Votes
+ -
What monster....
xXSpeedzXx 2nd Sep 2009
I like it!!
0 Votes
+ -
Where can I get the case built?
Randalllind 2nd Sep 2009
Damn I would love that just to have.
0 Votes
+ -
RE: Where can I get the case built?
pctech326 Updated - 2nd Sep 2009
The company that makes the cases was mentioned in the article. It's in the second paragraph of the "The Storage Bits take" section, but here is the link as it wasn't given - http://www.protocase.com/
0 Votes
+ -
RE: Build a RAID 6 array for $100/TB
bradknowles 2nd Sep 2009
Good analogy. This is a DC-3 that you put together yourself, having had no previous experience in building or flying aircraft, and your construction components are rubber bands, aluminum foil, and bailing wire. Once you've got the sucker in the air then you're going to figure out that you've got to change the engines in mid-flight and add the landing gear that you forgot to put on before take-off.


For years now, Curtis Preston (author of the O'Reilly book "Using SANs and NAS") has said:

Raw disks are cheap. Storage is expensive.

To people who don't understand that statement, I would add the analogy:

Raw carbon is cheap. Diamonds are expensive.


Alternatively, let's start with rocks and sand, and try to figure out how we're going to turn that into tungsten filament and glass, so that we can try many thousands of different ways *not* to make a lightbulb.

That's what Edison did. Do you want to do the same, or do you want to take the fruits of his labor and apply that lightbulb (or some other light-generating source) to some other activity?
0 Votes
+ -
Depends on how big the diamond is
Robin Harris 2nd Sep 2009
Brad,

Google demonstrated years ago that "storage" doesn't have to be
expensive. Numerous other companies have extended that insight to
the rest of us. Blazeback continues that fine tradition.

Your comments remind me of techies who derided PCs and NetWare
because they weren't up to the standards of minicomputers and
mainframes. How did that work out?

Storage is, without a doubt, the hardest part of computing, because it
is the only piece with a long-term anti-entropic mission. Storage is
fighting the Universe, and the Universe has a lot of resources.

Just as for the last 10 years you could buy a powerful multi-core
server and run (some) free enterprise class apps on a free OS for very
little money, that day is here for storage. Backblaze is using their
storage in production and it works in their application.

It isn't for every app, but as data cools there are more and more apps
that need the capacity without the cost. Home and soho users are
definitely there today.

Robin

0 Votes
+ -
These things look kind've modular. What if an entity/company were to build these and have them distributed across the US/World. They could pay Billie-Sue Homemaker $100/month to plug it into their high speed connection.

Imagine a scenario where an enterprising person could sell anonymous storage space to the mafia or malware company.

They could guarantee that the data would be encrypted and distributed across several pods. The people housing the pods would never have to know what was being stored on them. Data would be hard to track down because it would be travelling to many locations. Drawbacks would include lack of oversight for each pod and lots of latency.

I'm imagining a distributed array of redundant storage on a large scale. The more numerous the pods, the more redundant. Hell, why doesn't our government have one of these in every post office in the country?
0 Votes
+ -
Check out Cleversafe
Robin Harris 2nd Sep 2009
They use advanced erasure codes to create secure storage on public
networks.

Very similar to your idea.

Robin
0 Votes
+ -
RE: Build a RAID 6 array for $100/TB
g-ssg-22738810691057158710505623722271 2nd Sep 2009
I am not quite sure how you arrived at the 100/TB number I can attest that, the concept works. Minus the actual drive cost at 219 per 2tb drive, the cost I charged was about 225 per TB. Still better than the 5000 per TB which I have seen in the past. This rig also included a hot spare and the capability/possibility to grow.
0 Votes
+ -
I would do it with OpenSolaris or FreeBSD
alex.forencich 2nd Sep 2009
and use the ZFS filesystem. It's vastly superior to RAID-6 and, since we're already working with software RAID, doesn't add any extra overhead. And it's expandable, simply by replacing drives.
0 Votes
+ -
Maybe it would work now.
Robin Harris 3rd Sep 2009
I understand there were problems with OpenSolaris support of the Silicon
Image chips.

Robin
0 Votes
+ -
disk scrubbing, encrypted storage
plmuon Updated - 14th Apr 2010
It looks like they are using software raid, and not a hardware solution that includes regular disk scrubbing. Also, the data are stored unencrypted (decrypted after transfer).

So it seems not very secure to me in two aspects:
1. Your confidential data could be read by 3rd parties; I would prefer both encrypted transfer and encrypted storage.
2. Without disk scrubbing you will get bit errors sooner or later tha can go undetected for a long time. Even raid-6 may run into lost data after a while. ZFS inlcudes mechanisms against such silent data loss, but JFS does not (afaik). Did they implement some proprietary mechanism to protect against this?
0 Votes
+ -
I also desire to signal in your RSS feeds. Thank you as soon as once again and maintain up the great operate! nccma cooler
0 Votes
+ -
I used to be more than happy to seek out this internet-site.I wanted to thanks in your time for this glorious read!! I positively enjoying each little bit of it and I have you bookmarked to check out new stuff you weblog post. this thread is amazing i like your work and i appreciate you that you have share a useful stuff thanks for sharing the i shop abatwa
0 Votes
+ -
I used to be more than happy to seek out this internet-site.I wanted to thanks in your time for this glorious read!! I positively enjoying each little bit of it and I have you bookmarked to check out new stuff you weblog post.Bookmarking now thanks please consider a follow up post. power sa shop
0 Votes
+ -
I think the representation of this article is actually superb one. This is my first visit to your site. Thanks a lot and keep sharing the information. Keep updating the information for all of us. Thanks ZDNet Government was launched as the brand's first industry vertical, with a mission to cater to IT professionals in the public secto I agree with your post. However, do you have any sources I can cite for my paper wheel car com bury
0 Votes
+ -
Well welcome, hopefully you can become a vital member of the community and really help to push far ahead of google. Which Im sure the development team would love. This will of course earn you alot points too and get you on the leaders board. z d n e t t h a n k Im not sure i come to an agreement with you on every level, howevor it absolutely was a good posting, many thanks for taking the time to put up your ideas.
0 Votes
+ -
Thanks nice info z d n e t I really liked your current article write more..let me add you to its favorite The articles you have on zdnet s i t e are always so enjoyable to read. Good work and I bookmarked it.
0 Votes
+ -
Fantastic news about the new release.I positively enjoying each little bit of it and I have you b o o k m a r k e d to check out new stuff you weblog post.Im not sure i come to an agreement with you on every level, howevor it absolutely was a good posting, many thanks for taking the time to put up your ideas
0 Votes
+ -
Good day to confirm this comment I would appreciate T h e b e s t o f Z D N e t d e l i v e r e d your website very nice to everyone Yes, Oracle is the only one with shared-disk architecture, but that is there advantage. It means you can add or remove nodes and the database lives on. In a shared nothing architecture, if you lose a node, you lose the system. I'm sure Oracle appreciates EMC highlighting their advantage.I also desire to signal in your RSS feeds. Thank you as soon as once again and maintain up the great operate Awesome post! Thank you very much || thanks for nice content this is really benefit to me.

Join the conversation!

Formatting +
BB Codes - Note: HTML is not supported in forums
  • [b] Bold [/b]
  • [i] Italic [/i]
  • [u] Underline [/u]
  • [s] Strikethrough [/s]
  • [q] "Quote" [/q]
  • [ol][*] 1. Ordered List [/ol]
  • [ul][*] · Unordered List [/ul]
  • [pre] Preformat [/pre]
  • [quote] "Blockquote" [/quote]
ie8 fix

The best of ZDNet, delivered

ZDNet Newsletters

Get the best of ZDNet delivered straight to your inbox

Facebook Activity

White Papers, Webcasts, & Resources
ie8 fix