Tale of two data center strategies: Apple vs. Facebook
Summary: Apple's upcoming iCloud service revolves around a data center in Maiden N.C. and specifics about the innards of this computing powerhouse are few and far between, but what details are emerging look vastly different than what you'll find at Facebook.
Apple's upcoming iCloud service revolves around a data center in Maiden N.C. and specifics about the innards of this computing powerhouse are few and far between. But the details that are emerging about Apple's data center look vastly different than those build-your-own creations from the likes of Google and Facebook.
As noted following WWDC, Apple's data center slides appeared to feature a dose of Hewlett-Packard boxes---along with some gear from Teradata. Apple's most recent job listings for Maiden N.C. highlight the data center environment, which will look familiar to most technology executives. Like a good ice cream shop, there are flavors of just about everything.
From the job listings for Maiden openings:
"Our data center environment consists of Mac OS X, IBM/AIX, Sun/Solaris, and Linux systems. Though this position is focused primarily on Red Hat Linux and Oracle Enterprise Linux, you should also understand SAN, RAID, file system, and IP networking technology."
"Candidate will be responsible for storage on IBM/AIX, Sun/Solaris, and Linux operating systems working with IBM Enterprise storage including DS technologies, Netapp(FCP and NAS) and EMC storage systems."
"Should be familiar with director class SAN switches, preferably Brocade working with DCFM, as well as various workgroup SAN switches...A strong Sun background in relation to SAN. Tivoli Storage Manager with IBM Tape hardware and/or other Enterprise level backup/restore software."
Skills needed include "modifying and rebuilding the Linux kernel," "scripting in an administration languages such as Perl, any shell or C programming," configuration of Apache, PHP, MySQL and "at least one of the following virtualization technologies: KVM, Xen and VMware."
Other data center openings call for an SAP project managers, analysts and leads. Database architects require skills in the following.
- RDBMS: Oracle, Teradata, MySQL, DB2;
- NoSQL DB: Hadoop, HDFS, mongoDB, Cassandra;
- Columnar DB: Vertica, SAP Hana.
When you digest these various job openings, Apple looks a lot like other enterprises---a big heterogeneous environment with a bit of everything. In some respects, Apple's environment isn't all that surprising. For starters, Apple has a massive supply chain and that typically means a lot of Oracle and SAP. Meanwhile, all those data warehouse items are related to the fact that Apple is a large retailer in its own right. Toss in a cloud service and the need for analytics and you even get a mention of SAP Hana in the job listings.
The big question here is what entities helped out with the Maiden data center integration. Accenture would be a likely candidate, but an outfit like Lockheed Martin or Unisys wouldn't be all that surprising either. Apple may have rolled its own data center without integration help. Rest assured, Apple's data center is a tightly managed affair. After all, iCloud can't be a rebranded MobileMe.
Now contrast this relatively secretive Apple environment with a large enterprise that's a bit more simple: Facebook.
In April, Facebook held a data center confessional. It launched the Open Compute Project that outlined its server designs---Facebook makes its own stripped down gear---and specs for everything from lighting to cooling.
The move was notable to watch for two reasons. First, companies don't cough up data center designs due to worries about competitive advantage. And then there's the reaction that Facebook's move received.
Webheads---folks that love scale---were giddy about Facebook's move. Enterprise insiders scoffed a bit and noted that Facebook's scale-up architecture makes sense for what it needs to do, but other businesses are more complicated.
Facebook's biggest requirement is uptime. Supply chain, retail store integration and all those things Apple needs to manufacture things are not needed in Facebook's world.
Now some of the backchannel chatter about Facebook may have been sour milk. No one wants to hear chest thumping over data center PUE ratings. Facebook CEO Mark Zuckerberg said: "You can build servers and design them or get the products that the mass manufacturers put out. A lot of the stuff put out wasn’t in line with what we needed."
Now contrast Facebook's penchant for ditching vanity plastic with Apple's pictures of its data center. There's a lot of vanity plastic there. Can you imagine an aesthetics guru like Steve Jobs standing in front of Facebook's no-frills servers (right)?
Probably not. Fortunately, there are many ways to build data centers and meet objectives.
Kick off your day with ZDNet's daily email newsletter. It's the freshest tech news and opinion, served hot. Get it.
Talkback
On cost, Apple will not compete with FB and Google datacenters.
I was fascinated by FB's Open Compute project as it took a play straight from Google's playbook: find your competitors strength and open source the technology. Google ran their datacenters last quarter for a tad over $700,000,000 USD. Dude, that is impressive for as many datacenters Google has. Google's primary barrier against its competition is its ability to run its datacenters lots cheaper than its competition.
I love FB's approach of no plastic flare. These things are not customer facing products and are under tight lock and key. Concentrate on the maintenance loop and power consumption. Keep the prices low. Teach your competitor's competitors to do the same.
RE: Tale of two data center strategies: Apple vs. Facebook
Consider editing a document. You edit it on one device and the latest version appears on another. The data travels to the cloud then onto the second device. But then apple can delete the version on the cloud to free up space. Apple sets a 5Gb limit per user. reality is likely to be closer to 5 Mb.
The iCloud will evolve, and it will retain data in the cloud,
Not how Apple's iCloud works.
iCloud stores a full copy including backups of devices.
RE: Tale of two data center strategies: Apple vs. Facebook
"Thus apple's cloud is millions of ipods and iPads. It's a peer-to-peer cloud not a central leviathan like google. "
Probably not the case for MP3s which is a large portion of data.
If you think about it, data is stored in iOS devices BUT not necessarily mirrored in the cloud iOS device per iOS device, i.e. if there are 1000 devices with say 3GB MP3s, the iCloud storage does not store 3,000 GB of data.
Theoretically Apple only needs to store the universal set of MP3s and then associate a particular iOS device to that MP3 file number. This association doesn't need too much hard disk space, probably just 100 bytes of data per song/device. For 20,000 songs, thats just 2,000,000 bytes or 2MB of data/iOS device.
So 2MB of data and NOT 3GB per iOS device.
@ a_yen: Music is a small part of iCloud.
It also includes device backups. For example: You walk in and see your 4 year old taking a hammer to your iPhone. Upon replacing with a new unit, the new unit will init from iCloud pulling in all Apps (those would be pointers to the Apps), music (also just pointers to a copy) and application data/contacts/stored books/documents/bookmarks... This could be in the GB depending on what you have up there.
RE: Tale of two data center strategies: Apple vs. Facebook
But the whole point of iCloud is each user has multiple devices (otherwise its useless). If my 4 year old destroys my iPhone, iCloud can upload all the data from my iPad which has been kept in sync. Or, it might upload from my PC which is another of my devices. given that PC or Mac counts as a device most people will own at least two devices which can be used to back up each other.
What I'm saying is speculation but it would be crazy if Apple couldn't leverage some of the data on its iOS devices. If they are really going to store everything in the cloud, there's no need to sell iPhones with 64 Gb!
@ The Star King: you need a canonical copy.
And that is the cloud. Backup is one feature on iCloud. iCloud goes beyond having multiple devices but that is one important part.
Star King: An 64GB device sells for a lot more than one with less
RE: Tale of two data center strategies: Apple vs. Facebook
As a techie,
Do what you do and do it best.
[edit for grammer]
Do they really expect one person to know all that?
possible precursor, as well...
...my money is on it being testing and admin staff (since remote access can be done from any system, I don't see the management PCs running windows, and desktop Linux is less likely compared to running the "easier" desktop OS)
Just out of curiosity
Microsoft is known to dog food their server products.
It is what caused the Danger upgrade to be botched so badly. They had a great server system based on Linux and totally botched the transition to Windows based servers.
RE: Tale of two data center strategies: Apple vs. Facebook
RE: Tale of two data center strategies: Apple vs. Facebook
<a href="http://www.yuregininsesi.com" title="seslichat">sesli chat</a> <a href="http://www.yuregininsesi.com" title="seslisohbet">sesli sohbet</a>