Introduction hdfs dfsadmin -report outputs a brief report on the overall HDFS filesystem. It’s a userful command to quickly view how much disk is available, how many datanodes are running, and so on. Command Run the command with sudo -u hdfs prefixed to ensure you don’t get a permission denied error. CDH4 runs the namenode …
I’ve been “trying” to use Google Wallet for a couple of weeks now, and I’ve pretty much given up. When it works it’s great…but that’s the problem. You never know when it’ll actually work. First, it’s anybody’s guess if an in-store reader will even work. The same reader may work in the morning, then completely …
Introduction HBase is a tabular-oriented database that runs on top of HDFS. It is modeled on Google’s BigTable. In this post, I’m going to install HBase in Pseudo mode, so please use these instructions for setting up a developer’s workstation, not for a production cluster. When should you use HBase HBase should be used when …
Introduction Starting and stopping services is a common part of Hadoop administration. Hadoop Region Server Start a Region Server sudo service hbase-regionserver start Stop a Region Server sudo service hbase-regionserver stop Check the Status of a Region Server sudo service hbase-regionserver status
Introduction Zookeeper provides cluster management for Hadoop. In this post, I’m going to install Zookeeper in Pseudo mode, so please use these instructions for setting up a developer’s workstation, not for a production cluster. Installation The zookeeper package should already be installed, but we’ll double check. sudo apt-get install zookeeper Next, we’ll install the Zookeeper …
Introduction You will need to know the location of binaries, configuration files, and libraries when working with HBase. Directories Configuration /etc/hbase/conf is the location for all of HBase’s configuration files. HBase uses Debian Alternatives, so there are a number of symlinks to the configuration files. /etc/hbase/conf is a symlink to /etc/alternatives/hbase-conf. /etc/alternatives/hbase-conf is a symlink …
Introduction You will need to know the location of binaries, configuration files, and libraries when working with Zookeeper. Zookeeper 3.4.3 is a part of Cloudera Distribution Hadoop (CDH4). Directories /etc/zookeeper/conf /etc/zookeeper/conf is the location for all of Zookeeper’s configuration files. Zookeeper uses Debian Alternatives, so there are a number of symlinks to the configuration files. …
Introduction Google Drive is a combination of cloud storage and local disk synchronization services. Google Drive allows you to use Google’s servers as your primary file storage, and then sync those files to one or more devices. Supported devices include Windows (XP, Vista, 7), Mac OS X, iPad, iPhone, and Android (tables and phones). Google …
Introduction sed provides a quick and easy way to find and replace text via it’s search command (‘s’). Sample File Copy and paste the following text into a file named practice01.txt. Author: Akbar S. Ahmed Date: July 1, 2012 Subject: Sed sed is an extremely useful Unix/Linux/*nix utility that allows you to manipulate a text …
Introduction sed is short for Stream EDitor, which is a utility that allow you to parse and transform text one line at a time. sed is a useful tool, along with grep and awk, when manipulating text files. It is also often overlooked when working with Hadoop, although the use of sed, awk and grep …
AkbarAhmed.com 