Understanding Microsoft's big-picture plans for Hadoop and Project Isotope

Understanding Microsoft's big-picture plans for Hadoop and Project Isotope

Summary: With codename "Project Isotope," Microsoft is packaging up analytics tools and services for its coming Hadoop on Windows Azure and Windows Server distributions and making them available to users of all kinds.

SHARE:

Microsoft announced this past fall plans to create Hadoop distributions for Windows Azure and Windows Server. And just last week, Microsoft opened up the Community Technology Preview for Hadoop on Windows Azure.

But thanks to a new Channel 9 webcast (part of the December 13 "Learning Windows Azure" day-long show), we now know lots more about what the Softies are thinking regarding their Hadoop futures. Here's what I learned by watching this 11-minute video:

  • Project Isotope is the codename Microsoft is using for the Apache Hadoop on Windows Azure and Windows Server work. (Thanks to a loyal reader for the tip-off to the codename.) But Isotope is more than the distributions that the Softies are building with Hortonworks. Isotope also refers to the whole "tool chain" of supporting big-data analytics offerings that Microsoft is packaging up around the distributions.
  • Microsoft formed a team a year ago to begin work on Project Isotope. The General Manager, Project Founder and Technical Architect behind Isotope is Alexander Stojanovic. Dave Vronay, a leader in the Microsoft Advanced Technology Group in Beijing, also is part of the Isotope team. Isotope was born from Microsoft's work on cloud-scale analytics.
  • Microsoft is planning to make Hadoop on Windows Azure generally available in March 2012.
  • Microsoft is planning to make Hadoop on Windows Server (referred to by Stojanovic as the "enterprise" version of the project) generally available in June 2012. This version will include integration of the Hadoop File System with Active Directory, giving users global single sign-on for not just their e-mail, but also for analytics. (Now we know a bit more of the behind-the-scenes regarding those hints by various Microsoft execs regarding Active Directory and the cloud.)
  • After making the two Hadoop versions generally available, Microsoft is planning to release updates to them every three months (as service updates on Azure and as service packs for the on-premises version).
  • The Isotope team also is working with the System Center team to deeply integrate System Center Operations Manager with Hadoop on Windows Server (and maybe also on Windows Azure -- I'm not clear on that part), giving users unified command and control capabilities across the two platforms.
  • The Isotope team also is working with other teams inside Microsoft, like its datajs team, which is building the JavaScript framework for Isotope.

The coming Hadoop distributions for Azure and Windows Server are not all that interesting in and of themselves. It's the tools and the data that make them potentially useful and lucrative. The Isotope team is working on enabling bidirectional integration between the core Hadoop File System and tools like Sqoop and Flume. (Sqoop provides integration between HDFS and relational data services; Flume provides access to lots of log data from sensor networks and such).

Microsoft's big-picture concept is Isotope is what will give all kinds of users, from technical to "ordinary" productivity workers, access from inside data-analysis tools they know -- like Microsoft's own SQL Server Analysis Services, PowerPivot and Excel on their PCs -- to data stored in Windows Servers and/or Windows Azure. (The Windows Azure Marketplace fits in here, as this is the place that third-party providers can publish free or paid collections of data which users will be able to download/buy.)

With Isotope, "we've turned the OSS (open source software) model of open collaborative development and made it part of our internal ecosystem at Microsoft," Stojanovic said, while "insuring we've safeguarded it from an internal IP perspective."

If you have 11 minutes and care about Microsoft's Hadoop/big data strategy, check out the Channel 9 video for yourself:

Topics: Microsoft, Hardware, Operating Systems, Servers, Software, Windows

About

Mary Jo has covered the tech industry for 30 years for a variety of publications and Web sites, and is a frequent guest on radio, TV and podcasts, speaking about all things Microsoft-related. She is the author of Microsoft 2.0: How Microsoft plans to stay relevant in the post-Gates era (John Wiley & Sons, 2008).

Kick off your day with ZDNet's daily email newsletter. It's the freshest tech news and opinion, served hot. Get it.

Talkback

3 comments
Log in or register to join the discussion
  • RE: Understanding Microsoft's big-picture plans for Hadoop and Project Isotope

    Sounds like the big picture is embrace, extend and extinguish. This might work for softies when dealing with MS only customers but for those already using Hadoop, and therefore partial to OSS, this will be DOA. No of them will want to get locked into Microsoft.
    curph
  • RE: Understanding Microsoft's big-picture plans for Hadoop and Project Isotope

    Interesting video. I blogged about this, and where it might fit into the bigger picture of Microsoft's cloud BI strategy last week: http://cwebbbi.wordpress.com/2011/12/16/bringing-it-all-together-in-the-cloud-and-excel/

    As I said in that post, I think Data Explorer could have an important role to play here; this even more recent post on the Data Explorer team blog shows how it can push operations down to the data source and it doesn't take much imagination to see how it could work in this way with Isotope too:
    http://blogs.msdn.com/b/dataexplorer/archive/2011/12/19/where-oh-where-is-my-mashup-running.aspx
    cpwebb
  • RE: Understanding Microsoft's big-picture plans for Hadoop and Project Isotope

    Why should I, an IT person in a non-Fortune 500 company care about Hadoop?
    Fetch049