博客
关于我
强烈建议你试试无所不能的chatGPT,快点击我
ubuntu安装hive
阅读量:4587 次
发布时间:2019-06-09

本文共 7980 字,大约阅读时间需要 26 分钟。

1.安装mysql,可参考下面链接

2.安装hive,之前,先在mysql上创建一个hive,数据库,并在hive数据库中建立表user

create database hive;use hive;create table user(Host char(20),User char(10),Password char(20));

3.进入mysql,赋予权限,密码自己改

mysql -u root -pinsert into user(Host,User,Password) values("localhost","hive",password("123"));FLUSH PRIVILEGES;GRANT ALL PRIVILEGES ON *.*  TO 'hive'@'localhost' IDENTIFIED BY 'hive';FLUSH PRIVILEGES;

4.解压hive安装包之后,配置环境

sudo gedit /etc/profile
#hiveexport HIVE_HOME=/home/sendi/apache-hive-1.1.1-binexport PATH=$PATH:$HIVE_HOME/bin

5.修改hive/conf下的几个template模板,

cp hive-env.sh.template hive-env.shcp hive-default.xml.template hive-site.xml

6.配置hive-env.sh文件,指定HADOOP_HOME

HADOOP_HOME=/home/sendi/hadoop-2.6.0

7.修改hive-site.xml文件,指定MySQL数据库驱动、数据库名、用户名及密码

javax.jdo.option.ConnectionURL
jdbc:mysql://localhost:3306/hive?createDatabaseIfNotExist=true
JDBC connect string for a JDBC metastore
javax.jdo.option.ConnectionDriverName
com.mysql.jdbc.Driver
Driver class name for a JDBC metastore
javax.jdo.option.ConnectionUserName
hive
username to use against metastore database
javax.jdo.option.ConnectionPassword
hive
password to use against metastore database
hive.metastore.local
true

8.修改hive/bin下的hive-config.sh文件,设置JAVA_HOME,HADOOP_HOME

export JAVA_HOME=/usr/lib/jdk/jdk1.7.0_67export HADOOP_HOME=/home/sendi/hadoop-2.6.0export HIVE_HOME=/home/sendi/apache-hive-1.1.1-bin

9.下载mysql-connector-java-5.1.27-bin.jar文件,并放到$HIVE_HOME/lib目录下

10.在HDFS中创建/tmp和/user/hive/warehouse并设置权限

hadoop fs -mkdir /tmphadoop fs -mkdir /user/hive/warehousehadoop fs -chmod g+w /tmphadoop fs -chmod g+w /user/hive/warehouse

11.启动hive

12.启动时,可能会遇到下面的问题

Logging initialized using configuration in jar:file:/hive/apache-hive-1.1.0-bin/lib/hive-common-1.1.0.jar!/hive-log4j.propertiesSLF4J: Class path contains multiple SLF4J bindings.SLF4J: Found binding in [jar:file:/hadoop-2.5.2/share/hadoop/common/lib/slf4j-log4j12-1.7.5.jar!/org/slf4j/impl/StaticLoggerBinder.class]SLF4J: Found binding in [jar:file:/hive/apache-hive-1.1.0-bin/lib/hive-jdbc-1.1.0-standalone.jar!/org/slf4j/impl/StaticLoggerBinder.class]SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory][ERROR] Terminal initialization failed; falling back to unsupportedjava.lang.IncompatibleClassChangeError: Found class jline.Terminal, but interface was expected        at jline.TerminalFactory.create(TerminalFactory.java:101)        at jline.TerminalFactory.get(TerminalFactory.java:158)        at jline.console.ConsoleReader.
(ConsoleReader.java:229) at jline.console.ConsoleReader.
(ConsoleReader.java:221) at jline.console.ConsoleReader.
(ConsoleReader.java:209) at org.apache.hadoop.hive.cli.CliDriver.getConsoleReader(CliDriver.java:773) at org.apache.hadoop.hive.cli.CliDriver.executeDriver(CliDriver.java:715) at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:675) at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:615) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.apache.hadoop.util.RunJar.main(RunJar.java:212)

 

13.原因是hadoop目录下存在老版本jline,解决方法:

1.进入hive的lib目录,把新版本的jline复制到hadoop的一下目录

/home/sendi/hadoop-2.6.0/share/hadoop/yarn/lib

2把hadoop就版本的jline删掉

14.如果还遇到以下问题:

jiahong@jiahongPC:~/apache/apache-hive-1.1.1-bin$ hive15/09/05 21:29:28 WARN conf.HiveConf: HiveConf of name hive.metastore.local does not existLogging initialized using configuration in jar:file:/home/jiahong/apache/apache-hive-1.1.1-bin/lib/hive-common-1.1.1.jar!/hive-log4j.propertiesSLF4J: Class path contains multiple SLF4J bindings.SLF4J: Found binding in [jar:file:/home/jiahong/apache/hadoop-2.6.0/share/hadoop/common/lib/slf4j-log4j12-1.7.5.jar!/org/slf4j/impl/StaticLoggerBinder.class]SLF4J: Found binding in [jar:file:/home/jiahong/apache/apache-hive-1.1.1-bin/lib/hive-jdbc-1.1.1-standalone.jar!/org/slf4j/impl/StaticLoggerBinder.class]SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]Exception in thread "main" java.lang.RuntimeException: java.lang.IllegalArgumentException: java.net.URISyntaxException: Relative path in absolute URI: ${system:java.io.tmpdir%7D/$%7Bsystem:user.name%7D    at org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.java:472)    at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:671)    at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:615)    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)    at java.lang.reflect.Method.invoke(Method.java:606)    at org.apache.hadoop.util.RunJar.run(RunJar.java:221)    at org.apache.hadoop.util.RunJar.main(RunJar.java:136)Caused by: java.lang.IllegalArgumentException: java.net.URISyntaxException: Relative path in absolute URI: ${system:java.io.tmpdir%7D/$%7Bsystem:user.name%7D    at org.apache.hadoop.fs.Path.initialize(Path.java:206)    at org.apache.hadoop.fs.Path.
(Path.java:172) at org.apache.hadoop.hive.ql.session.SessionState.createSessionDirs(SessionState.java:515) at org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.java:458) ... 8 moreCaused by: java.net.URISyntaxException: Relative path in absolute URI: ${system:java.io.tmpdir%7D/$%7Bsystem:user.name%7D at java.net.URI.checkPath(URI.java:1804) at java.net.URI.
(URI.java:752) at org.apache.hadoop.fs.Path.initialize(Path.java:203) ... 11 morejiahong@jiahongPC:~/apache/apache-hive-1.1.1-bin$ hadoop dfs - ls /DEPRECATED: Use of this script to execute hdfs command is deprecated.Instead use the hdfs command for it.

15.修改hive-site.xml文件,修改之前要在hdfs上建立相应的文件夹,内容如下:

hive.exec.scratchdir
/tmp/hive
HDFS root scratch dir for Hive jobs which gets created with write all (733) permission. For each connecting user, an HDFS scratch dir: ${hive.exec.scratchdir}/<username> is created, with ${hive.scratch.dir.permission}.
hive.exec.local.scratchdir
/tmp/hive/local
Local scratch space for Hive jobs
hive.downloaded.resources.dir
/tmp/hive/resources
Temporary local directory for added resources in the remote file system.

16.先启动hadoop,再启动hive

 

sendi@sendijia:~/hadoop-2.6.0$ hiveLogging initialized using configuration in jar:file:/home/sendi/apache-hive-1.1.1-bin/lib/hive-common-1.1.1.jar!/hive-log4j.propertiesSLF4J: Class path contains multiple SLF4J bindings.SLF4J: Found binding in [jar:file:/home/sendi/hadoop-2.6.0/share/hadoop/common/lib/slf4j-log4j12-1.7.5.jar!/org/slf4j/impl/StaticLoggerBinder.class]SLF4J: Found binding in [jar:file:/home/sendi/apache-hive-1.1.1-bin/lib/hive-jdbc-1.1.1-standalone.jar!/org/slf4j/impl/StaticLoggerBinder.class]SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]hive>

 

转载于:https://www.cnblogs.com/aijianiula/p/4730236.html

你可能感兴趣的文章
MindManager中读图工具的使用
查看>>
利用GridView 插入、删除、修改、分页的综合实例代码---转!!!
查看>>
2016年3月11日Android学习日记
查看>>
Android弹出Toast工具类总结
查看>>
吴恩达机器学习笔记(十) —— 推荐系统
查看>>
Linux下Ant安装与配置
查看>>
实验二 用机器指令和汇编指令编程
查看>>
大数据系列之kafka监控kafkaoffsetmonitor安装
查看>>
常用正则表达式
查看>>
Java基础知识
查看>>
Identity Server4学习系列三
查看>>
我的一些学习资源
查看>>
第二届i春秋挖洞大赛的一些感想
查看>>
YAML 语言教程
查看>>
ios开发之C语言基础
查看>>
Cocos Console命令总结
查看>>
网页回到顶部 GoTop 按钮自动隐藏
查看>>
循环语句
查看>>
数据结构与算法(7) -- 二叉查找树
查看>>
【校招面试 之 C/C++】第7题 C++构造函数不能是虚函数的原因
查看>>