Cloudera CDH/CDP 및 Hadoop EcoSystem, Semantic IoT등의 개발/운영 기술을 정리합니다. gooper@gooper.com로 문의 주세요.
출처 : http://www.spikyjohn.com/cribsheets/20130609_hadoopinstall.html
Just the command lines to get hadoop 2 installed on Ubuntu. These are all cribbed from the following source notes, and I am preserving them here for my own benefit so I can quickly repeat what I did. Note many of these instructions are also in the main hadoop docs from apache.
Source material |
Use Michael-noll's guide for version 1 & ssh Or this one for Hadoop 2 |
Create the hadoop user and ssh |
sudo apt-get install openssh-server openssh-client sudo addgroup hadoop If you cannot ssh to localhost without a passphrase, execute the following
commands: Testing your SSH |
Get hadoop all set up |
As the hduser, after downloading the tar tar -xvf hadoop-2.0.5-alpha.tar.gz export HADOOP_MAPRED_HOME=${HADOOP_PREFIX}
|
Stolen entirely from JJ, but with path changed for my Ubuntu |
Stolen from http://jugnu-life.blogspot.com/2012/05/hadoop-20-install-tutorial-023x.html Please click on his blog. Login again so bash has paths above. In Hadoop 2.x version /etc/hadoop is the default conf directory. We need to modify / create following property files in the /etc/hadoop directory cd ~ Edit core-site.xml with following contents <configuration> Edit hdfs-site.xml with following contents <configuration> <property> <property> <property> </configuration> The path Path should be specified as URI <configuration> <property> <property> </configuration> The path file:/home/hduser/workspace/hadoop_space/hadoop23/mapred/system
AND Path should be specified as URI Edit yarn-site.xml with following contents <configuration> Format the namenode # hdfs namenode –format Say Yes and let it complete the format Time to start the daemons # hadoop-daemon.sh start namenode You can also start both of them together by # start-dfs.sh Start Yarn Daemons # yarn-daemon.sh start resourcemanager You can also start all yarn daemons together by # start-yarn.sh Time to check if Daemons have started Enter the command # jps Time to launch UI Open the localhost:8088 to see the Resource Manager page Done :) Happy Hadooping :) |