试验环境为Win7上用VMware搭建三个虚拟机环境,系统为Red Hat Enterprise 5。
三个节点的的IP、hostname分别为:
192.168.1.220 biao.oracle.com biao
192.168.1.221 biao1.oracle.com biao1
192.168.1.222 biao2.oracle.com biao2
biao节点RAM为3GB,biao1、biao2RAM为1GB其中biao2克隆于biao1。将biao设置为master,biao1、biao2为slaves
宿主环境:
CPU:Inter(R) Core(TM) i5 M560 2.67GHz
RAM:6GB
ip:192.168.1.100
jdk版本为:jdk1.6.0_29
Hadoop版本为:hadoop-0.20.2.tar.gz
Hive版本为:hive-0.8.1.tar.gz
MySQL版本为:mysql-5.5.17-winx64.zip
Hadoop已成功部署在虚拟机三个节点上,Hive将安装在master节点biao上,MySQL将安装在宿主Win7上,以构成”远程管理”。
MySQL安装配置参考:Win7下MySQL解压缩版安装配置
Hadoop的安装配置参考:Hadoop完全分布式集群部署
1.安装
下载地址:http://apache.dataguru.cn/hive/hive-0.8.1/
拷贝安装文件并解压:
|
3
|
[grid@biao ~]$ cp /mnt/hgfs/Install\ Program/work/hive-0.8.1.tar.gz ~/
|
|
5
|
[grid@biao ~]$ tar -zxvf hive-0.8.1.tar.gz
|
2.拷贝连接驱动jar到hive-0.8.1/lib/目录下
|
1
|
[grid@biao ~]$ cp mysql-connector-java-5.1.18-bin.jar ~/hive-0.8.1/lib/
|
3.配置hive-0.8.1/bin/hive-config.sh
加入配置:
|
1
|
export HIVE_HOME=/develop/hadoop/hive-0.8.1
|
|
2
|
export HADOOP_HOME=/develop/hadoop/hadoop-0.20.2/
|
|
3
|
export JAVA_HOME=/usr/local/jdk1.6.0_29/
|
4.配置hive-site.xml
copy hive-0.8.1/conf/hive-default.xml.template 保存为 hive-0.8.1/conf/hive-site.xml
|
1
|
[grid@biao ~]$ cp ~/hive-0.8.1/conf/hive-default.xml.template ~/hive-0.8.1/conf/hive-site.xml
|
修改以下六项配置:
|
5
|
controls whether to connect to remove metastore server or open a new metastore server in Hive Client JVM
|
|
11
|
javax.jdo.option.ConnectionURL
|
|
15
|
JDBC connect string for a JDBC metastore
|
|
21
|
javax.jdo.option.ConnectionDriverName
|
|
25
|
Driver class name for a JDBC metastore
|
|
31
|
javax.jdo.option.ConnectionUserName
|
|
35
|
username to use against metastore database
|
|
41
|
javax.jdo.option.ConnectionPassword
|
|
45
|
password to use against metastore database
|
5.测试
首先要确保hadoop及mysql服务已启动成功
启动hive并简单测试:
|
1
|
[grid@biao ~]$ ~/hive-0.8.1/bin/hive
|
|
2
|
Logging initialized using configuration in jar:file:/develop/hadoop/hive-0.8.1/lib/hive-common-0.8.1.jar!/hive-log4j.properties
|
|
3
|
Hive history file=/tmp/grid/hive_job_log_grid_201212011602_2078012862.txt
|
|
11
|
Time taken: 11.736 seconds
|
|
17
|
Time taken: 0.881 seconds
|
|
19
|
hive> create table t1(id int, name string);
|
|
23
|
Time taken: 1.377 seconds
|
HWI查看:
至此,Hive远程模式搭建完毕。
原文链接:http://www.wubiaoblog.com/archives/1144
来自 “ ITPUB博客 ” ,链接:https://blog.itpub.net/29754888/viewspace-1220327/
,如需转载,请注明出处,否则将追究法律责任。