FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.mr.MapRedTask
FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.mr.MapRedTask. Could not find status of job:job_1637104181115_796482:28:27’
終端報(bào)錯(cuò)日志見(jiàn)上,信息較少,需要在yarn上查看更多日志信息
INFO [Thread-68] org.apache.hadoop.service.AbstractService: Service JobHistoryEventHandler failed in state STOPPED; cause: org.apache.hadoop.yarn.exceptions.YarnRuntimeException: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.FSLimitException$PathComponentTooLongException): The maximum path component name limit of job
xx.jhist_tmp in directory /tmp/hadoop-yarn/staging/history/done_intermediate/ide is exceeded: limit=255 length=258
其中xx.jhist_tmp超長(zhǎng), 這部分是根據(jù)hive的jobname來(lái)決定的,默認(rèn)是從hql中的開頭和結(jié)尾截取一部分,如果sql開頭或結(jié)尾有中文注釋的話,會(huì)被截取進(jìn)來(lái),并進(jìn)行url編碼,導(dǎo)致超長(zhǎng)。hive在historyserver無(wú)法獲得這個(gè)job的狀態(tài),報(bào)開頭的錯(cuò)誤。
同事在用hive臨時(shí)表時(shí)遇到了這個(gè)錯(cuò),就是因?yàn)?with tab as太短,把后面的中文注釋截取進(jìn)來(lái)了,去掉中文注釋后問(wèn)題解決。
with user_info as ( --注冊(cè)量: 注冊(cè)信息還有種解決辦法,增加job_name長(zhǎng)度
set hive.jobname.length=10總結(jié)
以上是生活随笔為你收集整理的FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.mr.MapRedTask的全部?jī)?nèi)容,希望文章能夠幫你解決所遇到的問(wèn)題。
- 上一篇: Execution Error, ret
- 下一篇: Hive错误之 Execution Er