2019獨(dú)角獸企業(yè)重金招聘Python工程師標(biāo)準(zhǔn)>>>

環(huán)境準(zhǔn)備：

hadoop環(huán)境搭建

安裝mysql

hive環(huán)境搭建

hadoop環(huán)境搭建參考：http://my.oschina.net/u/2311010/blog/508139

安裝mysql

卸載自帶的mysql?

rpm?-qa?|?grep?mysql rpm?-e?mysql-libs-5.1.71-1.el6.x86_64??--nodeps

????2.yum安裝mysql

yum?install?-y?mysql-server?mysql?mysql-devel

????3.啟動(dòng)mysql服務(wù)，添加mysql用戶

service?mysqld?start/usr/bin/mysqladmin?-u?root?password?hadoop /usr/bin/mysqladmin?-u?root?-h?master?password?hadoopmysql?-uroot?-hmaster?-phadoop創(chuàng)建用戶hive@master（密碼hive）并分配權(quán)限CREATE?USER?'hive'?IDENTIFIED?BY?'hive'; GRANT?ALL?PRIVILEGES?ON?*.*?TO?'hive'@'master'?WITH?GRANT?OPTION; flush?privileges;用戶名hive登錄mysql?-h?master?-uhive set?password?=?password('hive'); 建立?Hive?專用的元數(shù)據(jù)庫 create?database?hive; 查看MYSQL數(shù)據(jù)庫中所有用戶 SELECT?DISTINCT?CONCAT('User:?''',user,'''@''',host,''';')?AS?query?FROM?mysql.user; 查看用戶是否設(shè)置了密碼select?user,host,password?from?mysql.user;

????4.hive環(huán)境搭建

修改hive的配置文件，位置在hive/conf/hive-site.xml。幾個(gè)較為重要的metastore配置屬性見下表：

hive.metastore.warehouse.dir	相對(duì)于fs.default.name的目錄，托管表存儲(chǔ)在這里
javax.jdo.option.ConnectionURL	metastore數(shù)據(jù)庫的JDBC URL
javax.jdo.option.ConnectionDriverName	JDBC驅(qū)動(dòng)器的類名
javax.jdo.option.ConnectionUserName	JDBC用戶名
javax.jdo.option.ConnectionConnectionPassword	JDBC密碼

進(jìn)入到hive的配置文件目錄下，找到hive-default.xml.template，另存為hive-site.xml并修改參數(shù)。Hive 系統(tǒng)會(huì)加載兩個(gè)配置文件一個(gè)默認(rèn)配置文件“hive-default.xml”，另一個(gè)就是用戶自定義文件“hive-site.xml”。當(dāng)“hive-site.xml”中的配置參數(shù)的值與“hive-default.xml”文件中不一致時(shí)，以用戶自定義的為準(zhǔn)。所以可將不需要的參數(shù)都刪除掉，只留下下面所示的內(nèi)容。

<?xml?version=”1.0″?> <?xml-stylesheet?type=”text/xsl”?href=”configuration.xsl”?> <configuration> <property> <name>javax.jdo.option.ConnectionURL</name> <value>jdbc:mysql://master:3306/hive?characterEncoding=UTF-8</value> </property> <property> <name>javax.jdo.option.ConnectionDriverName</name> <value>com.mysql.jdbc.Driver</value> </property> <property> <name>javax.jdo.option.ConnectionUserName</name> <value>hive</value> </property> <property> <name>javax.jdo.option.ConnectionPassword</name> <value>hive</value> </property> <property><name>hive.querylog.location</name><value>/usr/local/hive/iotmp</value><description>Location?of?Hive?run?time?structured?log?file</description></property><property><name>hive.exec.local.scratchdir</name><value>/usr/local/hive/iotmp</value><description>Local?scratch?space?for?Hive?jobs</description></property><property><name>hive.downloaded.resources.dir</name><value>/usr/local/hive/iotmp</value><description>Temporary?local?directory?for?added?resources?in?the?remote?file?system.</description></property> </configuration>

????5.拷貝jdbc驅(qū)動(dòng)包

把MySQL的JDBC驅(qū)動(dòng)包復(fù)制到Hive的lib目錄下（mysql-connector-java）

?6.修改環(huán)境變量

vi?~/.bashrcexport?HIVE_HOME=/app/Servers/apache-hive-1.2.1-bin export?PATH=$JAVA_HOME/bin:$HADOOP_HOME/bin:$HIVE_HOME/bin:$PATH

啟動(dòng)hive

hive [hadoop@master?conf]$?hive jarLogging?initialized?using?configuration?in?jar:file:/app/Servers/apache-hive-1.2.1-bin/lib/hive-common-1.2.1.jar!/hive-log4j.properties hive>?show?databases; OK default Time?taken:?1.458?seconds,?Fetched:?1?row(s) hive>

轉(zhuǎn)載于:https://my.oschina.net/u/2311010/blog/625339

總結(jié)

以上是生活随笔為你收集整理的hive环境搭建的全部?jī)?nèi)容，希望文章能夠幫你解決所遇到的問題。

如果覺得生活随笔網(wǎng)站內(nèi)容還不錯(cuò)，歡迎將生活随笔推薦給好友。