This page is out of date. I’m working on Hadoop again (as of Dec. 2014). As and when time permits, I plan to update all Hadoop information to be up to date with current distributions.

Introduction

I am currently working with Ubuntu 12.04 LTS. Therefore all of the instructions,
file locations, etc. below will only work with Ubuntu.

Install Prerequisities

• Install Java JDK 6.0 update 26 on Ubuntu 12.04 LTS

Install Hadoop

Install Cloudera Distribution Hadoop (CDH4)

1. Install Cloudera Hadoop (CDH4) with YARN (MRv2) in Pseudo mode on Ubuntu 12.04 LTS
2. Install Sqoop 1.4.1 for CHD4 on Ubuntu 12.04 LTS
3. Install Zookeeper for Cloudera Hadoop (CHD4) in Pseudo mode on Ubuntu 12.04 LTS
4. Install HBase 0.92.1 for Cloudera Hadoop (CHD4) in Pseudo mode on Ubuntu 12.04 LTS

Install Additional Packages

• Install Pig 0.9.2 for CDH4 on Ubuntu 12.04 LTS x64

Pig Programming

• How to add numbers with Pig

Configuration and Administration of Hadoop

• Start/Stop Hadoop Services
• Change the Hadoop MapReduce v2 (YARN) ShuffleHandler Port

HDFS Commands

• in process

User Commands

• in process

Administration Commands

• hdfs dfsadmin -report

HBase

• HBase Command Line Tutorial

Hadoop Files and Directories

• Zookeeper 3.4.3 Files and Directories (CDH4)
• HBase 0.92.1 Files and Directories (CDH4)

Environment Setup

• Create a .bash_aliases file

Linux Text Processing Utilities

sed

• What is sed?
• Find and Replace Text with sed