Blackbox, SWaP, and the z10

So... we're looking at the highest energy costs ever, and you're saying utilization isn't a concern?

Have you actually talked to anyone who has consolidated their datacenter? What you've missed, flat out and catastrophically, is facility costs. By not taking those into account, you're assuming they're equal between the options. There's not a snowball's chance in your theoretical datacenter that you can fit 4,950 x86 boxes (plus the network infrastructure - which is not free) in the same space, with the same power, and the same cooling.

Might want to take those into consideration next time - particularly the capital costs involved in merely adding the differential in floorspace, not to mention the racks of switches and routers. It changes your equation significantly.

In response, I suggested he look at Sun's project blackbox - but to help things along I thought I might do it for all of us.

Sun's project blackbox puts everything you need to run up to 280 rack servers in a 20 foot (160 square feet) shipping container. Drop it in the parking lot, hook up external power and networking, and you've a data center manageable as one integrated unit.

The basic model contains eight, 40RU, racks: seven for payload and one for network and internal control equipment - it can handle everything from earthquakes to heat waves, including, if external wiring is disconnected or set up using EMP fusing, a mid range EMP hit.

If you want:

• 40 T5440 servers (4 x 8 core, 1.4Ghz processors, 512GB, 4 x 145GB internal, 1120 Watts, 4 RU, $132,995),

• 20 X4600 servers (8 x 4 core, 2.3Ghz 256GB, 4 x 145GB, 1700 Watts, $34,845); and ,

• 10 X4500 storage servers (2 x 2 core, 2.8Ghz, 16GB, 48TB, 1800 Watts, $61,995)

Here's how that compares to the $26 million z10:

So the Sun blackbox is five times bigger and uses about five times the total power -but the IBM figures don't include storage, networking, external cooling, power filtering, or aisle space.

The SWaP metric is defined as:

Performance
-----------
Space X Power Consumption


Where:

• Performance is any benchmark such as an industry standard or customer specific workload
• Space is the height of the server in rack units (RU)
• Power is the Watts consumed by the system either by specs or even better by measuring the draw

Since Sun's "Niagara" processors own every major benchmark anywhere near their weight class while IBM refuses to benchmark the z10, it's hard to find a valid performance comparison.

We do have some Power6 numbers -from the p570 and similar lines. For example, here's a late 2007 summary from bmseer:

# SAP-SD, clearly a high-end ERP benchmark with SAP and database. Sun T5120 Beats ultra-expensive 4-core IBM p570 4.7 GHz POWER6 by 7%. Oracle Database used on Sun's SAP-SD.

# SPECjAppServer, another application tier and database-tier benchmark. Good for high-end servers, clearly UltraSPARC T2 is in that class and much less expensive the Power6. UltraSPARC T2 used as Oracle Database server. Sun T5120 67% faster 4-core IBM p570 4.7GHz Power6

# SPECjbb, another application benchmark with lots of big servers. Sun T5220 9% faster than 4-core IBM p570 4.7GHz POWER6, 2.5x better power-performance & 5x better SWaP

# SPECint_rate2006: UltraSPARC T2 1.4GHz beats best 1-chip(2-core) IBM POWER6 4.7GHz by 29%

What these results mean is that if you make the most positive assumptions possible for the mainframe - zero storage space or power, and CPU parity with coolthreads - then Blackbox beats the z10 on SWaP by a factor of six times: (1792/(280 x 96))/(282/(40 x 19))

Account for the 320 Opteron compute cores and the 480TB in storage provided by the blackbox configuration by guessing at rough equivelents for IBM, and you'll get rough estimates giving Blackbox a real SWaP advantage in the 15 to 20 times range.

And that's only part of the bottom line - because both systems have single points of management, and comparable RAS features, the rest the bottom line starts with a $21 million capital cost saving on the purchase - before OS licensing, storage, or networking on the IBM side - and ends with the fact that, with blackbox, you don't need to build a physical data center: just put security posts and some gyproc around three spaces on the second floor of the parking garage and send in the electricians.