记录ALiYun EMR常用服务的手动启动和停止命令(hdfs/yarn/mr-jobhistory/zk/spark-history)
生活随笔
收集整理的這篇文章主要介紹了
记录ALiYun EMR常用服务的手动启动和停止命令(hdfs/yarn/mr-jobhistory/zk/spark-history)
小編覺得挺不錯的,現在分享給大家,幫大家做個參考.
說明:在ssh,用root用戶登錄到header(master)機器上,手工執行以下命令進行業務調試。
常用命令:
1. env ?(忘記是大寫ENV,還是小寫env,來查看環境變量)
2. cat /etc/hosts (查看EMR集群機器的hostname ip配置)
3. 在header機器上,切換到hadoop用戶后,可以 ssh@emr-worker-1 直接登錄到worker-1機器上,因為集群的機器,hadoop用戶已經配置互相信任關系。
啟動:
###start zk su hadoop -c "/usr/lib/zookeeper-current/bin/zkServer.sh start" for i in `seq 1 2`; dosu hadoop -c "ssh emr-worker-${i} /usr/lib/zookeeper-current/bin/zkServer.sh start"; done###start hdfs su hdfs -c "/usr/lib/hadoop-current/sbin/hadoop-daemon.sh start namenode" su hdfs -c "/usr/lib/hadoop-current/sbin/hadoop-daemon.sh start secondarynamenode" for i in `seq 1 2`; dosu hdfs -c "ssh emr-worker-${i} /usr/lib/hadoop-current/sbin/hadoop-daemon.sh start datanode"; done###start yarn su hadoop -c "/usr/lib/hadoop-current/sbin/yarn-daemon.sh start resourcemanager" for i in `seq 1 2`; dosu hadoop -c "ssh emr-worker-${i} /usr/lib/hadoop-current/sbin/yarn-daemon.sh start nodemanager"; donesu hadoop -c "/usr/lib/hadoop-current/sbin/yarn-daemon.sh start proxyserver"###start mapreduce historyserver su hadoop -c "/usr/lib/hadoop-current/sbin/mr-jobhistory-daemon.sh start historyserver"###stop spark su hadoop -c "/usr/lib/spark-current/sbin/stop-history-server.sh"###stop mapreduce historyserver su hadoop -c "/usr/lib/hadoop-current/sbin/mr-jobhistory-daemon.sh stop historyserver"###stop yarn su hadoop -c "/usr/lib/hadoop-current/sbin/yarn-daemon.sh stop proxyserver"for i in `seq 1 2`; dosu hadoop -c "ssh emr-worker-${i} /usr/lib/hadoop-current/sbin/yarn-daemon.sh stop nodemanager"; done su hadoop -c "/usr/lib/hadoop-current/sbin/yarn-daemon.sh stop resourcemanager"###stop hdfs for i in `seq 1 2`; dosu hdfs -c "ssh emr-worker-${i} /usr/lib/hadoop-current/sbin/hadoop-daemon.sh stop datanode"; done su hdfs -c "/usr/lib/hadoop-current/sbin/hadoop-daemon.sh stop secondarynamenode" su hdfs -c "/usr/lib/hadoop-current/sbin/hadoop-daemon.sh stop namenode"###stop zk su hadoop -c "/usr/lib/zookeeper-current/bin/zkServer.sh stop" for i in `seq 1 2`; dosu hadoop -c "ssh emr-worker-${i} /usr/lib/zookeeper-current/bin/zkServer.sh stop"; done
總結
以上是生活随笔為你收集整理的记录ALiYun EMR常用服务的手动启动和停止命令(hdfs/yarn/mr-jobhistory/zk/spark-history)的全部內容,希望文章能夠幫你解決所遇到的問題。
- 上一篇: php输出缓存控制
- 下一篇: mysql保留2位小数字段如何设置 浮点