Linux and Open Source

Steven J. Vaughan-Nichols & Paula Rooney

The coming Hadoop shakeout

By | July 6, 2010, 6:08am PDT

Summary: Enterprises see clouds as replacements for mainframes and server farms, so there is a real market here. But is the market big enough to allow for all this diversity, or is a shakeout overdue?

With most open source projects, commercialization is straightforward.

The creators of the software get together with some business types.They put out a shingle, they sell support to what they wrote. They succeed or they fail.

But sometimes a project comes along that is so wildly popular everyone and his Aunt Sally wants a piece of the action.

That seems to be the case with Apache Hadoop, the Java framework for distributed applications inspired by Google, created by Doug Cutting, built by Yahoo and now seen as the basis for most cloud computing.

The Hadoop ecosystem now includes a half-dozen commercial Hadoop implementers, as well as boosters, hangers-on, supporters, and skeptics who wonder whether there is a commercial market here at all.

Hadoop creator Doug Cutting is now at Cloudera, but there is also Hadoop software available from Karmasphere, Datameer, Talend, Microstrategy, and Appistry.

Then there’s the Amazon cloud, IBM, and Yahoo, all depending on Hadoop as the heart of their cloud strategies. And Google. And so on.

Enterprises see clouds as replacements for mainframes and server farms, so there is a real market here. But is the market big enough to allow for all this diversity, or is a shakeout overdue?

I don’t have a clear answer to that.

Hadoop is a key ingredient in every enterprise strategy I’ve seen this year. It’s becoming a sort of Linux for the cloud, a lingua franca the whole industry is moving toward. If Hadoop is shaking out the whole industry is.

On the other hand how many start-ups can an open source project support, really?

Discuss.

Kick off your day with ZDNet's daily e-mail newsletter. It's the freshest tech news and opinion, served hot. Get it.

Topics

Dana Blankenhorn has been a business journalist for 30 years, a tech freelancer since 1983.

Disclosure

Dana Blankenhorn

Dana Blankenhorn has been a journalist, writer and part-time futurist for over 30 years.

At the present moment I run only a personal blog in addition to my ZDNet open source blog.

DanaBlankenhorn.Com has the subtitle The War Against Oil. In the past I have used it to write about political history, e-commerce, personal matters, some ideas related to open source, and The World of Always On, which is the idea of using sensors, motes and RFID to turn WiFi links into platforms for applications which live in the air.

My IRA account at Schwab holds a few tech shares, most notably some Intel and Applied Materials, but there are no open source companies in it. I don’t even own any CBS stock.

Biography

Dana Blankenhorn

Dana Blankenhorn has been a business journalist for nearly 25 years and has covered the online world professionally since 1985. He founded the Interactive Age Daily for CMP Media, and has written for the Chicago Tribune, Advertising Age's "NetMarketing" supplement, and dozens of other publications over the years.

The discussion hasn’t started yet. Why don’t you begin it?

Formatting +
BB Codes - Note: HTML is not supported in forums
  • [b] Bold [/b]
  • [i] Italic [/i]
  • [u] Underline [/u]
  • [s] Strikethrough [/s]
  • [q] "Quote" [/q]
  • [ol][*] 1. Ordered List [/ol]
  • [ul][*] · Unordered List [/ul]
  • [pre] Preformat [/pre]
  • [quote] "Blockquote" [/quote]
ie8 fix

The best of ZDNet, delivered

ZDNet Newsletters

Get the best of ZDNet delivered straight to your inbox

Facebook Activity

White Papers, Webcasts, & Resources
ie8 fix