hadoop的web ui的8088端口打不开一例
首先jps看下,得到:
25013 Master
8599 SecondaryNameNode
8200 NameNode
8377 DataNode
9902 Jps
?
可以發(fā)現(xiàn)沒有resourcemanager,也就是說yarn沒有啟動.
log路徑:
/home/appleyuchi/bigdata/hadoop-2.7.7/logs/yarn-appleyuchi-resourcemanager-Desktop.log
log中報(bào)錯如下:
2020-04-27 15:13:36,416 INFO org.apache.hadoop.yarn.server.resourcemanager.ResourceManager: registered UNIX signal handlers for [TERM, HUP, INT]
2020-04-27 15:13:36,606 INFO org.apache.hadoop.conf.Configuration: found resource core-site.xml at file:/home/appleyuchi/bigdata/hadoop-2.7.7/etc/hadoop/core-site.xml
2020-04-27 15:13:36,704 INFO org.apache.hadoop.security.Groups: clearing userToGroupsMap cache
2020-04-27 15:13:36,746 INFO org.apache.hadoop.conf.Configuration: found resource yarn-site.xml at file:/home/appleyuchi/bigdata/hadoop-2.7.7/etc/hadoop/yarn-site.xml
2020-04-27 15:13:36,767 INFO org.apache.hadoop.service.AbstractService: Service ResourceManager failed in state INITED; cause: org.apache.hadoop.yarn.exceptions.YarnRuntimeException: Invalid configuration! Invalid value of yarn.resourcemanager.ha.rm-ids. Current value is null
HA mode requires atleast two RMs
org.apache.hadoop.yarn.exceptions.YarnRuntimeException: Invalid configuration! Invalid value of yarn.resourcemanager.ha.rm-ids. Current value is null
HA mode requires atleast two RMs
?? ?at org.apache.hadoop.yarn.conf.HAUtil.throwBadConfigurationException(HAUtil.java:43)
?? ?at org.apache.hadoop.yarn.conf.HAUtil.verifyAndSetRMHAIdsList(HAUtil.java:94)
?? ?at org.apache.hadoop.yarn.conf.HAUtil.verifyAndSetConfiguration(HAUtil.java:80)
?? ?at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.serviceInit(ResourceManager.java:228)
?? ?at org.apache.hadoop.service.AbstractService.init(AbstractService.java:163)
?? ?at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.main(ResourceManager.java:1187)
2020-04-27 15:13:36,769 INFO org.apache.hadoop.yarn.server.resourcemanager.ResourceManager: Transitioning to standby state
2020-04-27 15:13:36,769 INFO org.apache.hadoop.yarn.server.resourcemanager.ResourceManager: Transitioned to standby state
2020-04-27 15:13:36,769 FATAL org.apache.hadoop.yarn.server.resourcemanager.ResourceManager: Error starting ResourceManager
org.apache.hadoop.yarn.exceptions.YarnRuntimeException: Invalid configuration! Invalid value of yarn.resourcemanager.ha.rm-ids. Current value is null
HA mode requires atleast two RMs
?? ?at org.apache.hadoop.yarn.conf.HAUtil.throwBadConfigurationException(HAUtil.java:43)
?? ?at org.apache.hadoop.yarn.conf.HAUtil.verifyAndSetRMHAIdsList(HAUtil.java:94)
?? ?at org.apache.hadoop.yarn.conf.HAUtil.verifyAndSetConfiguration(HAUtil.java:80)
?? ?at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.serviceInit(ResourceManager.java:228)
?? ?at org.apache.hadoop.service.AbstractService.init(AbstractService.java:163)
?? ?at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.main(ResourceManager.java:1187)
2020-04-27 15:13:36,771 INFO org.apache.hadoop.yarn.server.resourcemanager.ResourceManager: SHUTDOWN_MSG:?
/************************************************************
SHUTDOWN_MSG: Shutting down ResourceManager at Desktop/192.168.0.103
************************************************************/
調(diào)試的過程中還碰到下面的錯誤:
Invalid configuration! yarn.resourcemanager.hostname.rm1 or yarn.resourcemanager.address.rm1 needs to be set in a HA configuration.
org.apache.hadoop.yarn.exceptions.YarnRuntimeException: Invalid configuration! yarn.resourcemanager.hostname.rm1 or yarn.resourcemanager.address.rm1 needs to be set in a HA configuration.
****************************
2020-04-27 16:11:57,674 INFO org.apache.hadoop.service.AbstractService: Service org.apache.hadoop.yarn.server.resourcemanager.EmbeddedElectorService failed in state INITED; cause: org.apache.hadoop.yarn.exceptions.YarnRuntimeException: Embedded automatic failover is enabled, but yarn.resourcemanager.zk-address is not set
org.apache.hadoop.yarn.exceptions.YarnRuntimeException: Embedded automatic failover is enabled, but yarn.resourcemanager.zk-address is not se
最終會牽涉到Zookeeper,zookeeper要求運(yùn)行的最低集群配置是3臺,由于手頭只有兩臺,所以沒法搞.
?
所以最終解決方案是不要在yarn-site.xml中開啟yarn.resourcemanager.ha.enabled:
<configuration> <!-- <property><name>yarn.resourcemanager.ha.enabled</name><value>true</value> </property> -->?
總結(jié)
以上是生活随笔為你收集整理的hadoop的web ui的8088端口打不开一例的全部內(nèi)容,希望文章能夠幫你解決所遇到的問題。
- 上一篇: 长白头发的原因 肾气不足:后脑勺长白发
- 下一篇: window怎么连接mysql