Hadoop on your PC: Cloudera's CDH4 virtual machine

Hadoop on your PC: Cloudera's CDH4 virtual machine

Summary: Want to learn Hadoop without building your own cluster or paying for cloud resources? Then download Cloudera's Hadoop distro and run it in a virtual machine on your PC. I'll show you how.

SHARE:
TOPICS: Big Data
1

 |  Image 8 of 10

  • Thumbnail 1
  • Thumbnail 2
  • Thumbnail 3
  • Thumbnail 4
  • Thumbnail 5
  • Thumbnail 6
  • Thumbnail 7
  • Thumbnail 8
  • Thumbnail 9
  • Thumbnail 10
  • Used to a file system GUI?  Don't feel like typing commands like "lsr" and "mkdir" at the shell prompt?  Never fear, because Hue's browser-based HDFS user interface is here.  Just click the file cabinet icon in Hue's toolbar to get there.

    Shown above is Hive's root folder.  Clicking on the "warehouse" link would let you view the files which are queryable as tables in Hive.

  • Click the Job Designer icon (4th from the left in Hue's toolbar), then the Create Mapreduce Design button, and up comes a screen that lets you run a jar-based MapReduce job.  Give the job a name and a description, specify the jar file, add properties (parameters) and property values, then click Save.

    You'll be automatically redirected to the Job Designs screen where you can click the Submit button for the job design you just built.  You can also click the Create Streaming Design button to design a job whsoe mapper and reducer code is written in a language other than Java.

  • Click the Hue Shell Toolbar button to get to browser-based command line shells for Pig and HBase.  Below the toolbar, you'll find one clickable link for each.  The Pig shell (called "Grunt") is shown here.  At this prompt you can enter Pig Latin commands interactively or run .pig scripts.


Topic: Big Data

Andrew Brust

About Andrew Brust

Andrew J. Brust has worked in the software industry for 25 years as a developer, consultant, entrepreneur and CTO, specializing in application development, databases and business intelligence technology.

Kick off your day with ZDNet's daily email newsletter. It's the freshest tech news and opinion, served hot. Get it.

Related Stories

Talkback

1 comment
Log in or register to join the discussion
  • Looking for such option for quite some time.

    Thanks for providing this info.
    jinishans