Month: August 2012

Convert CDH4 from YARN (MRv2) to MRv1

comments 2
Uncategorized

Introduction I had configured only YARN in my original post on how to Install Cloudera Hadoop (CDH4) with YARN (MRv2) in Pseudo mode on Ubuntu 12.04 LTS. Importantly, YARN is not ready for production yet, so we’ll go ahead and install MRv1 to get some production development done. Stop the YARN Daemons We first have to stop all daemons associated with YARN only packages. sudo service hadoop-yarn-resourcemanager stop sudo service hadoop-yarn-nodemanager stop sudo service hadoop-mapreduce-historyserver […]

HBase Command Line Tutorial

comments 8
Hadoop / HBase

Introduction Start the HBase Shell All subsequent commands in this post assume that you are in the HBase shell, which is started via the command listed below. hbase shell You should see output similar to: 12/08/12 12:30:52 WARN conf.Configuration: hadoop.native.lib is deprecated. Instead, use io.native.lib.available HBase Shell; enter 'help<RETURN>' for list of supported commands. Type "exit<RETURN>" to leave the HBase Shell Version 0.92.1-cdh4.0.1, rUnknown, Thu Jun 28 18:13:01 PDT 2012 Create a Table We will […]

Debugging HBase: org.apache.hadoop.hbase.master.AssignmentManager: Unable to find a viable location to assign region -ROOT

comments 2
Hadoop

Introduction I ran into an annoying error in HBase due to the localhost loopback. The solution was simple, but took some trial and error. Error I was following the HBase logs with the following command: tail -1000f /var/log/hbase/hbase-hbase-master-freshstart.log The following error kept poping up in the log file. org.apache.hadoop.hbase.master.AssignmentManager: Unable to find a viable location to assign region -ROOT Solution sudo vi /etc/hosts I changed: 127.0.0.1       localhost 127.0.1.1       freshstart to: #127.0.0.1      localhost #127.0.1.1      freshstart 192.168.2.15   freshstart 127.0.0.1      localhost 192.168.2.15 is my […]