ITPub博客

首页 > 大数据 > Hadoop > CentOS6.5基于Hadoop用户的Yarn伪分布式部署(a Single Node Cluster)

CentOS6.5基于Hadoop用户的Yarn伪分布式部署(a Single Node Cluster)

原创 Hadoop 作者:13545163656 时间:2018-05-20 18:06:44 0 删除 编辑
yran on a single node cluster
官网参考:
http://hadoop.apache.org/docs/r2.8.4/hadoop-project-dist/hadoop-common/SingleCluster.html


1.修改mapred-site.xml文件,没有创建
[hadoop@hadoop001 hadoop]$ pwd
/opt/software/hadoop-2.8.1/etc/hadoop
[hadoop@hadoop001 hadoop]$ cp mapred-site.xml.template mapred-site.xml

[hadoop@hadoop001 hadoop]$ vim mapred-site.xml   -- 添加<property>

  1. <configuration>
  2.         <property>
  3.            <name>mapreduce.framework.name</name>
  4.            <value>yarn</value>
  5.         </property>
  6. </configuration>


2.修改etc/hadoop/yarn-site.xml


  1. <configuration>
  2.         <property>
  3.           <name>yarn.nodemanager.aux-services</name>
  4.           <value>mapreduce_shuffle</value>
  5.         </property>
  6. </configuration>

3.Start Stop ResourceManager daemon and NodeManager daemon

[hadoop@hadoop001 sbin]$ ./start-yarn.sh
[hadoop@hadoop001 sbin]$ ./stop-yarn.sh


4.初次启动项目yarn启动失败,查看启动该日志
[hadoop@hadoop001 sbin]$ jps
18704 Jps
13767 SecondaryNameNode
13595 DataNode
13454 NameNode
[hadoop@hadoop001 sbin]$ cat /opt/software/hadoop-2.8.1/logs/yarn-hadoop-resourcemanager-hadoop001.out
[Fatal Error] mapred-site.xml:24:1: The end-tag for element type "property" must end with a '>' delimiter.

检查发现发现mapred-site.xml里>缺少 > 结束箭头 


5.再次启动yarn 启动成功
[hadoop@hadoop001 sbin]$ ./start-yarn.sh
starting yarn daemons
starting resourcemanager, logging to /opt/software/hadoop-2.8.1/logs/yarn-hadoop-resourcemanager-hadoop001.out
192.168.0.129: starting nodemanager, logging to /opt/software/hadoop-2.8.1/logs/yarn-hadoop-nodemanager-hadoop001.out
[hadoop@hadoop001 sbin]$ jps
18883 NodeManager        
18918 Jps
13767 SecondaryNameNode
18776 ResourceManager
13595 DataNode
13454 NameNode

6.启动控制台启动端口8088

  • ResourceManager - http://localhost:8088/   




来自 “ ITPUB博客 ” ,链接:https://blog.itpub.net/31441024/viewspace-2154780/ ,如需转载,请注明出处,否则将追究法律责任。

请登录后发表评论 登录
全部评论

注册时间:2017-03-05

  • 博文量
    70
  • 访问量
    97992