Hadoop 2.8 +Mysql 搭建Hive2.x.x

安装mysql (ubuntu):

sudo apt-get install mysql-server

去 https://dev.mysql.com/downloads/connector/j/ 下载mysql的java驱动放到hive的lib目录里去

如果是deb安装包的话，装完后， 一般jar文件会被放在例如/usr/share/java/mysql-connector-java-8.0.11.jar

hive配置文件 conf/hive-site.xml 

<configuration> <property> <name>hive.metastore.local</name> <value>true</value> </property> <property> <name>javax.jdo.option.ConnectionURL</name> <value>jdbc:mysql://127.0.0.1:3306/hive?useSSL=false</value> </property> <property> <name>javax.jdo.option.ConnectionDriverName</name> <value>com.mysql.cj.jdbc.Driver</value> </property> <property> <name>javax.jdo.option.ConnectionUserName</name> <value>hive</value> </property> <property> <name>javax.jdo.option.ConnectionPassword</name> <value>mysql</value> </property> </configuration>

1. MySQL的链接字符串要加 useSSL=false

2. hive.downloaded.resources.dir  这个配置项一定要当心, 退出hive时会清空这个目录

3. 新的jdbc驱动jdbc.driver的属性值从com.mysql.jdbc.Driver换为com.mysql.cj.jdbc.Driver.

4 &符号在ＸＭＬ的转义是&

在Mysql中创建metastore:

从hive2.0开始要执行hive bin目录下的schematool来创建metastore(别忘了现在mysql中create database)

./schematool -dbType mysql -initSchema

环境变量:

在/etc/source确保有如下环境变量(根据实际情况调整路径):

export HADOOP_HOME=/home/rav009/hadoop-2.8.0 export PATH=$HADOOP_HOME/bin/:$PATH export HIVE_HOME=~/hive/apache-hive-2.x.x-bin export PATH=$HIVE_HOME/bin:$PATH