ie8 fix

Windows Azure futures: Turning the cloud into a supercomputer

By | February 2, 2011, 1:34pm PST

Summary: I haven’t written much about longer-term Azure futures. Until this week, which just so happens to be the one-year anniversary of Microsoft’s cloud platform.

February 1 is considered the “one year” anniversary of Microsoft’s Azure cloud platform (even though February 2 is the actual date that billing was “turned on”).

Last year, Microsoft said it had 10,000 Azure customers; this week officials are saying they have 31,000, though they are refusing to say how many of these are paying customers, how many are divisions of Microsoft, etc.

As I noted last year, Microsoft has been slowly and steadily adding new features to Azure. But I haven’t written much about longer-term Azure futures. Until today.

Bill Hilf, General Manager of the Technical Computing Group (TCG) at Microsoft, isn’t part of the Azure team. But he and his band are doing work on technologies that ultimately may have substantial bearing on the future of Microsoft’s cloud platform. The TCG has a server operating system team, a parallelization team and a team “with the idea of connecting a consumer to a cloud service,” according to Hilf.

The TCG late last year stated its intentions to allow customers to provision and manage Windows Server 2008 R2 HPC nodes in Windows Azure from within on-premises server clusters as part of Service Pack 1 of HPC Server 2008 R2. But Hilf and his team want to go beyond this and turn the cloud into a supercomputer, as Hilf explained to me last week. “We want to take HPC out of niche access,” he said.

This isn’t going to happen overnight, even though the biggest Azure customers today are the ones using HPC on-premises at the current time, Hilf said. HPC and “media” (like the rendering done by customers like Pixar) are currently the biggest workloads for the cloud, Hilf said.

To bridge HPC and Azure, Hilf has a multi-pronged strategy in mind. One of the prongs is Dryad.

Dryad is Microsoft’s competitor to Google MapReduce and Apache Hadoop
. In the early phase of its existence, Dryad was a Microsoft Research project dedicated to developing ways to write parallel and distributed programs that can scale from small clusters to large datacenters. Both the Bing and the Xbox Live teams have used Dryad in building their back-end datacenters.

There’s a DryadLINQ compiler and runtime that is related to the project. Microsoft released builds of Dryad and DryadLINQ code to academics for noncommercial use in the summer 2009. Microsoft moved Dryad from its research to its Technical Computing Group this year.

“Dryad, in its first iteration, is really for on-premises,” Hilf told me during an interview last week. “Eventually, we’ll roll Dryad up into Azure, as even more data is put in the cloud.”

Go to the next page for more on how Microsoft’s parallel stack comes into play

Mary Jo has covered the tech industry for more than 25 years for a variety of publications and Web sites, and is a frequent guest on radio, TV and podcasts, speaking about all things Microsoft-related. She is the author of Microsoft 2.0: How Microsoft plans to stay relevant in the post-Gates era (John Wiley & Sons, 2008).

Disclosure

Mary-Jo Foley

Freelance journalist/blogger Mary Jo Foley has nothing to disclose. WYSIWYG (what you see is what you get). I do not own Microsoft stock or stock in any of its partners or competitors. I have no business ventures that are sponsored by/funded by Microsoft or any of its partners or competitors.

Biography

Mary-Jo Foley

Mary Jo Foley has covered the tech industry for 25 years for a variety of publications, including ZDNet, eWeek and Baseline. She has kept close tabs on Microsoft strategy, products and technologies for the past 10 years. In the late 1990s, she penned the award-winning "At The Evil Empire" column for ZDNet, and more recently the Microsoft Watch blog for Ziff Davis.

Got a tip? Send her an email with your rants, rumors, tips and tattles. Confidentiality guaranteed.

Related Discussions on TechRepublic

Did you know you can take part in these discussions with your ZDNet membership?
35
Comments

Join the conversation!

Just In

Im happy that you wrote about it.
alimula90 Updated - 19th May
This is definitely a topic thats close to me so Im happy that you wrote about it. Im also happy that you did the subject some justice. Not only do you know a great deal about it, you know how to present in a way that people will want to read more. Im so happy to know someone like you exists on the web
Search Engine Optimization
Azure seems to be very quietly making significant inroads and I suspect it is going to be huge technology. WP7 and Azure are an intriguing combo also.
charging that America was repeating the mistakes of the past, throwing money at the problem and hoping to God we do not resort to racial profiling ??? and she suggested that increased security against one group could potentially be more dangerous.minnesota cna training
0 Votes
+ -
I think that is the right idea
P. Douglas Updated - 2nd Feb 2011
I believe as a general rule of thumb: if a task on a PC takes 1 or more hours to complete, consider offering to do the task via a cloud service. This should be the attitude of ISVs that create video processing software, development packages such as FORTRAN, etc. These guys should be offering from within their applications, to have certain data processing take place in the cloud, in a fraction of the time it normally takes on a PC, or alone on company servers.

Also instead of threatening the jobs of IT guys with the idea of gutting IT departments, and replacing them with public clouds, help these guys out by offering a slew of public cloud services, that make their lives easier, and allow them and the companies they work for, to do things they couldn't do before, due to lack of funds, resources, etc.
@P. Douglas: Great call on the IT cloud services. IMHO, the cloud offers the greatest benefit to the small to mid size businesses or IT consultants. Small busnisses either hire a 3rd party consultant firm (usually a small local one) or have an extremely tech savvy in-house guy to handle their IT for them. Either way, the small business doesn't have the financial ability to use enterprise level cloud services or IT infrastructure, so your point is spot on.
Information is truly extraordinary, I am very interested to read this post.. online bachelors degree
online doctorate degree
online associates degree
online undergraduate certificate
Be thankful for that.
IAO
IAO Accreditation
I adore what you have got right here.
WEVAC University
@Qube-It Nice Things in your content which i need.....Thanks for that...
Logo Design Contest
These guys should be offering from within their applications, to have certain data processing take place in the cloud, in a fraction of the time it normally takes on a PC, or alone on company servers. Belford university
accredited high school diploma
@JonathanTrott I read many blogs related to windows but i don't like any one...but your discussion about window is relevant and different to other that's why i like your blog...keep it up!
Buy Assignments Help Online||Coursework Help UK Online||Dissertation Writing Service UK||UK Assignment Writing Services Online||Buy UK Essays Online||Statistics Help
0 Votes
+ -
Pixar is a reference customer...
dazzlingd 2nd Feb 2011
Got to love the irony.

Pixar, previously owned by Steve Jobs, now owned by Disney with Steve as the #1 shareholder, using Microsoft's cloud for movie rendering...
0 Votes
+ -
@dazzlingd
Last time I checked Pixar had a huge Linux farm and some Macs running Renderman. There are actually job posts for Linux render farms admins from last year.
I know they did POC with Azure, but that does not mean they use it for production. Does anyone have more precise information? Perhaps they do not like Amazon, because this would be the natural place for Renderman to be.
That brings another point- it will be challenging for Azure to compete, because it has no Linux option unlike Amazon and others. I have heard some future plans for virtualization and running Linux images, perhaps someone knows more about that.
Finally, Azure is well behind Amazon in terms of public sets (for example 1000 genomes, Ensembl, etc.). They should do better if they expect to stay relevant in the science area.
0 Votes
+ -
@kirovs@... I don't know how this ties into their Linux farm, but according to the press release on the Microsoft website, Pixar use Azure for on-demand compute cycles using their RenderMan platform.

I also remember seeing a video showing how James Cameron used Azure to render the CGI scenes in Avatar. I believe he uses RenderMan too, so there must be a link somewhere between both platforms.

Interestingly enough, if you search for Pixar and Microsoft you will find several links to projects that Pixar and Microsoft Research have done together which shows a long established relationship.

I guess that puts to rest the old meme of Microsoft and Steve Jobs hate each other. That will disappoint a lot of the deluded fanboys from both camps...
0 Votes
+ -
@dazzlingd@...
What you say make things even more complicated in my opinion- Avatar was rendered on a supercomputer running RedHat (or Ubunutu?) Linux in New Zealand (WETA Digital). Here is a link:
http://www.junauza.com/2010/01/technology-behind-avatar-movie.html
So I am still not quite sure where Azure comes into the picture...
But thanks for the explanation- I guess when there is peak demand they move load to Azure...
0 Votes
+ -
Azure is a winner for-zure....
Mike Cox 2nd Feb 2011
A few years ago, I put some of my top, Top, TOP MCSD's on this Azure project. I had them working 24x7x365 getting our on premises applications cloud enabled. Once we deployed the apps to the cloud, I fired all of them and saw immediate ROI. "To the cloud!".
@Mike Cox

Is this the real you? Where is your rep?
0 Votes
+ -
TRUE!
nomoreds 16th Mar 2011
The cloud is the future people!




source:
fakesteveballmer.blogspot.com
dumb dumb the cloud is not in the usa it is over seas not one is in the usa and it will not save your files on your computer at all and it has been hacked already it has been on tv news for mouths and microsoft is not doing any thing about it AGAIN YOUR FILES ARE NOT SAVED ON YOUR COMPUTER THEY ARE SAVED OVER SEAS SOME WHERE AND YOU CAN NOT TELL WHERE AT ALL AND ANY ONE CAN ACCESS YOUR FILES AT WILL THE NEWS SAID HACKERS GET IN EACH DAY SO YOU CAN BELIV THE MICROSOFT AND OTHERS THAT IT IS SAFE ALL YOU WOULD AND IF YOU LOSE YOUR PASSWORD KISS YOUR FILES AND PIC'S GOODBY FOR GOOD
0 Votes
+ -
RE: Windows Azure futures: Turning the cloud into a supercomputer
jackson1984-24316069205748857739440257893812 9th Oct
I admire the valuable details you produce into your article content or weblog posts. I am going to bookmark your weblog as well as nfl jersey have my minor types have a appearance at up right here regularly.
0 Votes
+ -
RE: Windows Azure futures: Turning the cloud into a supercomputer
tomlin21-24319035676893835085146735905770 11th Oct
Maintain the great operate, nfljerseys I like your making.
Very interesting and informative blog. Hope we get some updates Die Steel
@flypig0089 i agree with you... Mary good article i really love it. I have reading this article is awesome so good work.... Keep working.... Writing Services || UK Essay Help || Essay Writing Service
0 Votes
+ -
RE: Windows Azure futures: Turning the cloud into a supercomputer
dfwekrdfe35-24353603514803697860648270628153 Updated - 10th Nov
Which projected does one assume if you find yourself providing software solely spot ? I simply definitively much like the carry out. Many thanks for this current. pittsburgh steelers jerseys,michael vick jersey,peyton manning jersey,walter payton jersey,desean jackson jersey, I've got would allow you to gram calorie take note of, you'd land up i am only everyplace doing this. I managed to get two or three your individual page having all sorts of world-wide-web sheet and was indeed the truth is obsessed with begin amount of desire and even thinking about increased.
0 Votes
+ -
Great post
alimula91 24th Mar
Great post, what you said is really helpful to me. I can not Agree With You Anymore. I Have Been talking with my friend about, he though it is really interesting as well. Keep up your good work With, I would come back to you.

Atlanta General Contractor | Atlanta Bathroom Remodeling
0 Votes
+ -
Nice information
alimula91 24th Mar
Nice information, many thanks to the author. It is incomprehensible to me now, but in general, the usefulness and significance is overwhelming. Thanks again and good luck!

Dunlop Motorcycle Tires|Bridgestone Motorcycle Tires
0 Votes
+ -
Thanks for writing this
alimula91 24th Mar
Thanks for writing this. I really feel as though I know so much more about this than I did before. Your blog really brought some things to light that I never would have thought about before reading it. You should continue this, Im sure most people would agree youve got a gift.

Atlanta Wedding Reception Hall|Atlanta Garden Weddings
0 Votes
+ -
This is a very intriguing post
alimula91 24th Mar
This is a very intriguing post, I was looking for this knowledge. Just so you know I found your web site when I was searching for blogs like mine, so please check out my site sometime and leave me a comment to let me know what you think

Tuxedo Rentals |Groom Tuxedo
0 Votes
+ -
This site is excellent
alimula91 24th Mar
This site is excellent and so is how the subject matter was explained. I also like some of the comments too.Waiting for next post.

Tuxedo Rentals |Wedding Tuxedos
0 Votes
+ -
I like this blog
alimula91 24th Mar
I like this blog. It is a rich content topic. It helps me solve a lot of problems. It updates at a very fast rate, and provides for me many opportunities. I think it can help me to solve many problems, thank you

Atlanta General Contractor |Atlanta General Contractor
0 Votes
+ -
A very nice post it is
alimula91 24th Mar
A very nice post it is. I have been seeking this type of knowledge for a long time and by posting this article you have made my work so much easier. This site always gives me outstanding knowledge

Neurosurgeon in Kentucky |Kentucky Neurosurgeon
0 Votes
+ -
Excellent site
alimula91 Updated - 24th Mar
Excellent site, keep up the good work my colleagues would love this. I read a lot of blogs on a daily basis and for the most part, people lack substance but, I just wanted to make a quick comment to say Im glad I found your blog. Thanks

Car Battery Prices in Dubai|Car Battery in Dubai
0 Votes
+ -
Well I personally
alimula91 24th Mar
Well I personally don't know this guy but one things for sure. He already paid his mistakes in jail and now it's finally over and he can now start a new life. I hope so that he will not go back to the wrong steps anymore. Life is precious and we shouldn't waste it.

Send Flowers to Pakistan|Send Flowers to Karachi
0 Votes
+ -
Great blog
alimula91 24th Mar
Great blog article about the Great blog article about this topic, I have been lately in your blog once or twice now. I just wanted to say hi and show my thanks for the information provided.

Home Alarm Systems|Wireless Security Systems
0 Votes
+ -
Technology Magic
sweetode Updated - 23rd Apr
Technology is getting great day by day. I thinks windows will sure gain the power in this techno world again.

Flowers to Pakistan
0 Votes
+ -
Im happy that you wrote about it.
alimula90 Updated - 19th May
This is definitely a topic thats close to me so Im happy that you wrote about it. Im also happy that you did the subject some justice. Not only do you know a great deal about it, you know how to present in a way that people will want to read more. Im so happy to know someone like you exists on the web
Search Engine Optimization

Join the conversation!

Formatting +
BB Codes - Note: HTML is not supported in forums
  • [b] Bold [/b]
  • [i] Italic [/i]
  • [u] Underline [/u]
  • [s] Strikethrough [/s]
  • [q] "Quote" [/q]
  • [ol][*] 1. Ordered List [/ol]
  • [ul][*] · Unordered List [/ul]
  • [pre] Preformat [/pre]
  • [quote] "Blockquote" [/quote]
ie8 fix
Click Here

The best of ZDNet, delivered

ZDNet Newsletters

Get the best of ZDNet delivered straight to your inbox

Facebook Activity

White Papers, Webcasts, & Resources
ie8 fix