1 部署环境
127.0.0.1
localhost.localdomain
localhost
::1
localhost6.localdomain6 localhost6
16.158.49.201 hadoop.node1
16.158.49.202 hadoop.node2
3 添加hadoop用户(每台)
useradd hadoop
密码:
passwd hadoop
4 配置master到nodeX无密码ssh
a su - hadoop
b ssh-keygen -t
rsa(hadoop.master),一路回车
c cat
~/.ssh/id_rsa.pub >>
~/.ssh/authorized_keys
d scp ~/.ssh/authorized_keys
hadoop@hadoop.node1:~/.ssh/authorized_keys
scp ~/.ssh/authorized_keys
hadoop@hadoop.node2:~/.ssh/authorized_keys
note:
如果没执行过ssh命令,可能会出现~/.ssh不存在的错误,在那台机器上执行一遍就好了。
5 安装jdk(每台)
a 解压缩jdk压缩包到
/usr/java/下面(root)
b vi /etc/profile
增加:
#jdk
JAVA_HOME=/usr/java/jdk1.7.0_45
CLASSPATH=.:$JAVA_HOME/lib.tools.jar
PATH=$JAVA_HOME/bin:$PATH
export JAVA_HOME
CLASSPATH PATH
c source /etc/profile
d java -version
java version
"1.7.0_45"
Java(TM) SE Runtime
Environment (build 1.7.0_45-b18)
Java HotSpot(TM) Server
VM (build 24.45-b08, mixed mode)
6 安装hadoop(hadoop用户做以下操作,只在master上操作)
a
解压缩hadoop压缩包到/home/hadoop下面,解压后路径为/home/hadoop/hadoop-2.2.0
b 修改环境变量:
vi ~/.bashrc
增加:
# User specific aliases
and functions
#Hadoop variables
export
JAVA_HOME=/usr/java/jdk1.7.0_45
export
HADOOP_INSTALL=/home/hadoop/hadoop-2.2.0
export
HBASE_HOME=/home/hadoop/hbase-0.96.0-hadoop2
export
PATH=$PATH:$HADOOP_INSTALL/bin
export
PATH=$PATH:$HADOOP_INSTALL/sbin
export
PATH=$PATH:$HBASE_HOME/bin
export
HADOOP_MAPRED_HOME=$HADOOP_INSTALL
export
HADOOP_COMMON_HOME=$HADOOP_INSTALL
export
HADOOP_HDFS_HOME=$HADOOP_INSTALL
export
YARN_HOME=$HADOOP_INSTALL
###end of paste
c 修改slaves,指定namenode
vi
~/hadoop-2.2.0/etc/hadoop/slaves
hadoop.node1
hadoop.node2
d 修改core-site.xml
e
修改hdfs-site.xml
f
修改mapred-site.xml
g
修改yarn-site.xml
7
创建dfs/name,dfs/data,mapred/local,mapred/system目录
8 scp
-r ~/hadoop-2.2.0 hadoop@hadoop.node1:~/hadoop-2.2.0
scp
-r ~/hadoop-2.2.0 hadoop@hadoop.node2:~/hadoop-2.2.0
9
以hadoop用户,在hadoop.master上启动hdfs和yarn
hdfs namenode
-format
start-dfs.sh
start-yarn.sh
10 jps验证
hadoop.master上
NameNode
SecondaryNameNode
ResourceManager
hadoop.nodeX上
DataNode
NodeManager