Hadoop on your PC: Cloudera's CDH4 virtual machine

Hadoop on your PC: Cloudera's CDH4 virtual machine

Summary: Want to learn Hadoop without building your own cluster or paying for cloud resources? Then download Cloudera's Hadoop distro and run it in a virtual machine on your PC. I'll show you how.

TOPICS: Big Data

 |  Image 1 of 10

  • Thumbnail 1
  • Thumbnail 2
  • Thumbnail 3
  • Thumbnail 4
  • Thumbnail 5
  • Thumbnail 6
  • Thumbnail 7
  • Thumbnail 8
  • Thumbnail 9
  • Thumbnail 10
  • Everyone's talking Big Data and Hadoop, but how can you start to learn the technology if you have to set up a whole cluster first? This isn't just about the servers, but also the Hadoop software itself, and various companion products like Hive and Pig.  If you're Windows person without Linux/Unix skills, this may be more daunting still.  But there is a solution.

    Cloudera, maker of perhaps the most widely-deployed Hadoop distribution, offers a a pre-built, training-appropriate, 1-node Hadoop cluster in virtual machine (VM) form, and it's free.  In this gallery, I'll show you the step-by-step of how to download, configure and use the VM, and how to get at the various Hadoop distro components within it.

    To start, visit Cloudera's Web site to download the CDH4 (Cloudera Distribution including Apache Hadoop, version 4) VM, as shown here.  The VM image is available in VMWare, Virtual Box and KVM formats.  Our work here is done under VMWare.

    If you're using Windows Server Hyper-V, you can download the VMWare image and convert it to VHD format.  Windows 7 Virtual PC won't work as it only supports 32-bit VMs and the CDH4 image is a 64-bit VM.

  • If you're not running the full-fledged VMWare product, never fear.  Just download the free VMWare player, then use it to run the CDH4 image.

Topic: Big Data

Andrew Brust

About Andrew Brust

Andrew J. Brust has worked in the software industry for 25 years as a developer, consultant, entrepreneur and CTO, specializing in application development, databases and business intelligence technology.

Kick off your day with ZDNet's daily email newsletter. It's the freshest tech news and opinion, served hot. Get it.


1 comment
Log in or register to join the discussion
  • Looking for such option for quite some time.

    Thanks for providing this info.