hdp版本：
执行：hdp-select status hadoop-client | sed 's/hadoop-client - \(.*\)/\1/'
2.4.0.0-169
zeppelin安装（摘录官网）：
(Optional) Installing Zeppelin Manually
The Zeppelin Technical Preview is available as an HDP package compiled against Spark 1.6.
To install the Zeppelin Technical Preview manually (instead of using Ambari), complete the following steps as user root.
-
Install the Zeppelin service:
yum install zeppelin -
Make a copy of zeppelin-env.sh:
cd /usr/hdp/current/zeppelin-server/lib cp conf/zeppelin-env.sh.template conf/zeppelin-env.sh
-
In the zeppelin-env.sh file, export the following three values.
Note: you will use PORT to access the Zeppelin Web UI. corresponds to the version of HDP where you are installing Zeppelin; for example, 2.4.0.0-169.export HADOOP_CONF_DIR=/etc/hadoop/conf export ZEPPELIN_PORT=9995 export ZEPPELIN_JAVA_OPTS="-Dhdp.version="
-
To obtain the HDP version for your HDP cluster, run the following command:
hdp-select status hadoop-client | sed 's/hadoop-client - (.*)/1/'
-
Copy hive-site.xml to Zeppelin’s conf directory:
cd /usr/hdp/current/zeppelin-server/lib cp /etc/hive/conf/hive-site.xml conf/
- Remove “s” from the values of hive.metastore.client.connect.retry.delay and hive.metastore.client.socket.timeout, in the hive-site.xml file in zeppelin/conf dir. (This will avoid a number format exception.)
-
Create a root user in HDFS:
su hdfs hdfs dfs -mkdir /user/root hdfs dfs -chown root /user/root
To launch Zeppelin, run the following commands:
cd /usr/hdp/current/zeppelin-server/lib bin/zeppelin-daemon.sh start
访问：http://ZEPPELIN_HOST:9995
zeppelin spark配置：
1）点击Interpreters ：
master yarn-client spark.home /usr/hdp/current/spark-client spark.yarn.jar /usr/hdp/current/spark-client/lib/spark-assembly-1.6.0.2.4.0.0-169-hadoop2.7.1.2.4.0.0-169.jar spark.driver.extraJavaOptions -Dhdp.version=2.4.0.0-169 spark.yarn.am.extraJavaOptions -Dhdp.version=2.4.0.0-169 spark.executor.instances executor个数（默认2个）
2）conf/zeppelin-env.sh配置：
export HADOOP_CONF_DIR=/etc/hadoop/conf export SPARK_HOME=/usr/hdp/2.4.0.0-169/spark export ZEPPELIN_PORT=9995 export ZEPPELIN_JAVA_OPTS="-Dhdp.version=2.4.0.0-169"
new note ...
来自 “ ITPUB博客 ” ，链接：https://blog.itpub.net/29754888/viewspace-2132689/ ，如需转载，请注明出处，否则将追究法律责任。
上一篇：
Scala 多继承 & 依赖注入
请登录后发表评论
登录
全部评论
