美文网首页
Hadoop问题

Hadoop问题

作者: 予早 | 来源:发表于2017-06-10 09:55 被阅读0次

version: 2.7.3

Kill a hadoop job:

yarn application -kill $ApplicationId

You can get a list of all ApplicationId's doing:

yarn application -list

MapReduce jobs get stuck in Accepted state:

A job stuck in accepted state on YARN is usually because of free resources are not enough. You can check it at http://resourcemanager:port/cluster/scheduler:

if Memory Used + Memory Reserved >= Memory Total, memory is not enough
if VCores Used + VCores Reserved >= VCores Total, VCores is not enough

It may also be limited by parameters such as maxAMShare.
See more: http://stackoverflow.com/questions/20200636/mapreduce-jobs-get-stuck-in-accepted-state

查看scheduler发现Memory Total为0,htop发现内存已被chrome几乎用尽,关闭chrome,重启了yarn,完美运行job

相关文章

网友评论

      本文标题:Hadoop问题

      本文链接:https://www.haomeiwen.com/subject/xdmztxtx.html