MAC 安装HADOOP～小记
hadoop集群支持单机模式,伪分布模式和完全分布模式。看也知道 我要装的只能是伪分布式咯。
大神攻略1:
http://www.cnblogs.com/gamix/archive/2012/12/02/insta
ll-hadoop-on-mac-osx-lion.html
大神攻略2:http://andy-ghg.iteye.com/blog/1165453
STEP 1
确认JAVA的安装
如前一篇文章所述,重装系统后我重装了JAVA。在终端可以查看下
版本~
JAVA
-version
java version "1.6.0_65"
Java(TM) SE Runtime Environment (build
1.6.0_65-b14-462-11M4609)
Java HotSpot(TM) 64-Bit Server VM (build 20.65-b04-462, mixed
mode)
STEP 2 下载软件
LINK:http://hadoop.apache.org/releases.html
吸取之前的经验教训,我果断下载了STABLE的版本,希望不会出现
什么悲剧(这绝对不是在立FLAG!!!)
1
Aug, 2013: Release 1.2.1 (stable) available
STEP 3
配置环境变量
export
HADOOP_HOME= /Users/请填入你的用户名/hadoop
export PATH=$PATH:$HADOOP_HOME/bin
STEP 4 配置hadoop-env.sh(在conf文件夹里面) 去掉注释,填入自己的java_home的路径(我这个是系统默认安的
路径,可以从显示简介那里直接拷~)
# The java implementation to use. Required.
export
JAVA_HOME=/System/Library/Java/JavaVirtualMachines/1.6.0.jdk/Co ntents/Home
STEP 5
配置其他三个文件
坑爹的渣浪不让写XML的代码555
core-site xml（关于LOCALHOST的VALUE,教材上木有填,大神1填的8020.到底是多少啊。。。）
hdfs-site.xml
mapred-site.xml（大神1Value填的8021）
STEP 6 设置SSH 在系统偏好设置的共享里面允许远程登陆。 额,总觉得不太放心啊,还是用的时候再开开吧~
STEP 7
运行Hadoop
输入
$HADOOP_HOME/bin/hadoop namenode -format
输出结果如下:
Warning: $HADOOP_HOME is deprecated.
14/02/12 22:10:59 INFO namenode.NameNode: STARTUP_MSG: 14/02/12
22:10:59 INFO util.GSet: Computing capacity for map BlocksMap
14/02/12 22:10:59 INFO util.GSet: VM type = 64-bit 14/02/12
22:10:59 INFO util.GSet: 2.0% max memory = 1039859712 14/02/12
22:10:59 INFO util.GSet: capacity = 2^21 = 2097152 entries
14/02/12 22:10:59 INFO util.GSet: recommended=2097152,
actual=2097152
2014-02-12 22:11:00.200 java[33617:1203] Unable to load realm info
from SCDynamicStore
14/02/12 22:11:00 INFO namenode.FSNamesystem:
14/02/12 22:11:00 INFO namenode.FSNamesystem:
supergroup=supergroup
14/02/12 22:11:00 INFO namenode.FSNamesystem:
isPermissionEnabled=true
14/02/12 22:11:00 INFO namenode.FSNamesystem:
dfs.block.invalidate.limit=100
14/02/12 22:11:00 INFO namenode.FSNamesystem:
isAccessTokenEnabled=false accessKeyUpdateInterval=0 min(s),
accessTokenLifetime=0 min(s)
14/02/12 22:11:00 INFO namenode.FSEditLog:
dfs.namenode.edits.toleration.length = 0
14/02/12 22:11:00 INFO namenode.NameNode: Caching file names
occuring more than 10 times
14/02/12 22:11:00 INFO common.Storage: Image file
/tmp/hadoop-yuzehua/dfs/name/current/fsimage of size 113 bytes
saved in 0 seconds.
fsOwner=yuzehua
14/02/12 22:11:00 INFO namenode.FSEditLog: closing edit log: position=4, editlog=/tmp/hadoop-yuzehua/dfs/name/current/edits 14/02/12 22:11:00 INFO namenode.FSEditLog: close success: truncate to 4, editlog=/tmp/hadoop-yuzehua/dfs/name/current/edits 14/02/12 22:11:00 INFO common.Storage: Storage directory /tmp/hadoop-yuzehua/dfs/name has been successfully formatted. 14/02/12 22:11:00 INFO namenode.NameNode: SHUTDOWN_MSG:
然后输入 $HADOOP_HOME/bin/start-all.sh
会被要求输入三次密码
输出结果如下:
Warning: $HADOOP_HOME is deprecated.
starting namenode, logging to
/Users/yuzehua/hadoop/libexec/../logs/hadoop-yuzehua-namenode-
bogon.out
Password:
localhost: starting datanode, logging to
/Users/yuzehua/hadoop/libexec/../logs/hadoop-yuzehua-datanode-
bogon.out
Password:
localhost: starting secondarynamenode, logging to
/Users/yuzehua/hadoop/libexec/../logs/hadoop-yuzehua-secondary
namenode-bogon.out
starting jobtracker, logging to
/Users/yuzehua/hadoop/libexec/../logs/hadoop-yuzehua-jobtracke
r-bogon.out
Password:
localhost: starting tasktracker, logging to
/Users/yuzehua/hadoop/libexec/../logs/hadoop-yuzehua-tasktrack
er-bogon.out
打开了若干窗口。。。
STEP 8 测试连接 终于到最后一步啦,按照大神的指示
打开连接地址http://localhost:50070
打开地址http://localhost:50030/
配置总算是成功了。。。红军万里长征第一步啊~~~
来自 “ ITPUB博客 ” ，链接：https://blog.itpub.net/10465273/viewspace-1119568/ ，如需转载，请注明出处，否则将追究法律责任。
