解决Exception in thread “main“ org.apache.spark.SparkException: When running with master ‘yarn‘ either
生活随笔
收集整理的這篇文章主要介紹了
解决Exception in thread “main“ org.apache.spark.SparkException: When running with master ‘yarn‘ either
小編覺得挺不錯的,現在分享給大家,幫大家做個參考.
Exception in thread “main” org.apache.spark.SparkException: When running with master ‘yarn’ either HADOOP_CONF_DIR or YARN_CONF_DIR must be set in the environment.
spark-env.sh
export HADOOP_CONF_DIR=/opt/bigdata/hadoop-2.9.2/etc/hadoop/ export YARN_CONF_DIR=/opt/bigdata/hadoop-2.9.2/etc/hadoop/總結
以上是生活随笔為你收集整理的解决Exception in thread “main“ org.apache.spark.SparkException: When running with master ‘yarn‘ either的全部內容,希望文章能夠幫你解決所遇到的問題。
- 上一篇: Spark配置属性整理(非常全面)
- 下一篇: Spark HistoryServer日