Inside a Microsoft data center
Summary: It takes mucho computes and terabytes to create the 3D models used in Microsoft's Virtual Earth online mapping service. So how do they cram 5,000 cores and 10,000 terabytes - 10 petabytes - of storage into 3 40 ft.
It takes mucho computes and terabytes to create the 3D models used in Microsoft's Virtual Earth online mapping service. So how do they cram 5,000 cores and 10,000 terabytes - 10 petabytes - of storage into 3 40 ft. shipping containers?
Containerized data centers Sun pioneered containerized data centers with their 2006 water-cooled Project Blackbox. But the Microsoft model is air-cooled and in production today in Boulder, CO.
Here's the exterior:
Photo courtesy of the Microsoft Virtual Earth Gov Blog
It's what's inside that computes Putting ~3400 disk drives and 1700 cores into 320 sq. ft. isn't easy, which is what makes this picture so interesting:
Photo courtesy of the Microsoft Virtual Earth Gov Blog
Unlike Google's barebones racks, these racks are labeled Verari. Turns out that Verari Systems builds containerized data centers that look familiar:
Photo courtesy of Verari Systems
They also build high density storage and servers with very efficient cooling. They get 24 3.5" disks and up to 4 quad-core processors into 3 rack units - where most rackmount systems require 4U with half the cores.
Here's their high-density storage blade:
Photo courtesy of Verari Systems
The Storage Bits take While I was skeptical at first, I'm now convinced that containerized data centers are the most economical and energy efficient alternative. Microsoft even bought wind-generated power for these units to underscore the point.
With the rapid growth of computing and data for science, commerce and entertainment we need to do it as efficiently as possible.
Comments welcome, of course.
Kick off your day with ZDNet's daily email newsletter. It's the freshest tech news and opinion, served hot. Get it.
Talkback
Wow, on topic AND not brimming with anti-MS FUD!
Don't blame me. . . .
let me!
Other than that, love the keyboard.
Cheers,
Robin
Is that all it takes?
The ironic thing is that you are known as the Mac $hill yet you use an MS keyboard and I'm known as the M$ $hill yet all of my peripherals are made by Logitech. :)
Actually it was $20 from Dell
new. But I saw that price and had to have it. And its really good!
Love my Logitech trackball too - though I broke 2 wireless ones in a
month - so I stay wired now. Messy but it works.
Robin
I reread this a few times...
God, but that's ugly!
Uh.. It's a data center...
RE: Inside a Microsoft data center
put into low earth orbit?
RE: Inside a Microsoft data center
with the "extras" i.e. Windows can be hacked
and it crashes... totally pointless.
It's walking past that makes you vomit!
They are a techies drool and a designers nightmare..
Someone throw a tarpaulin over them.
Dead trees?
Purpose of the stilts?
I think that's were the ugliness factor slips in. Those thick, spiraling stilts.
At least on the vendor's home page, their container has trees painted on the side. Maybe if they'd lower it a bit it wouldn't be such an eyesore.
Electricians aren't mechanics
Not ceiling?
Also, I can't imagine they would make holes in the bottom of the containers for cabling or anything else. That would not be very secure, and I think it would be easier routing them inside the drop ceiling.
Stilts keep containers well above any water
Datacenter Container on concrete stilts
since this is in boulder, they have a local issue with not paving over the prarie dog habitat.
Mark
Power from Ceiling, data from under the floor
the 2 480V 3phase whips per rack come in down from the false ceiling. its also the return path for the hot air.
the network switches are in the back of each rack at the bottom in the 6u of utility space.
each has mulitple 10G fiber links to the main datacenter
mark
One of the efficiencies in Verari's design
the racks so the cold air is sucked up through the racks and exhausted
out the top. Seems they figured out that hot air rises.
To paraphrase what firemen do, they pull the cold stuff past the hot
stuff.
Seems obvious, but it really makes for more efficient cooling.
Robin
http://911review.org/search.html
http://911review.org/search.html
Ah, OK