sparkStreaming+kafka SparkException: java.nio.channels.ClosedChannelException异常报错
生活随笔
收集整理的這篇文章主要介紹了
sparkStreaming+kafka SparkException: java.nio.channels.ClosedChannelException异常报错
小編覺得挺不錯的,現在分享給大家,幫大家做個參考.
在運行sparkStreaming+kafka的時候報錯 java io報錯,
如果broker-list的端口不對或者kafka服務端未啟動,會遇到以下錯誤:
Exception in thread "main" org.apache.spark.SparkException: java.nio.channels.ClosedChannelExceptionat org.apache.spark.streaming.kafka.KafkaCluster$$anonfun$checkErrors$1.apply(KafkaCluster.scala:366)at org.apache.spark.streaming.kafka.KafkaCluster$$anonfun$checkErrors$1.apply(KafkaCluster.scala:366)at scala.util.Either.fold(Either.scala:97)at org.apache.spark.streaming.kafka.KafkaCluster$.checkErrors(KafkaCluster.scala:365)at org.apache.spark.streaming.kafka.KafkaUtils$.getFromOffsets(KafkaUtils.scala:222)at org.apache.spark.streaming.kafka.KafkaUtils$.createDirectStream(KafkaUtils.scala:484)at com.xxx.spark.main.xxx.createStream(xxx.scala:223)at com.xxx.spark.main.xxx.createStreamingContext(xxx.scala:72)at com.xxx.spark.main.xxx$$anonfun$getOrCreateStreamingContext$1.apply(xxx.scala:47)at com.xxx.spark.main.xxx$$anonfun$getOrCreateStreamingContext$1.apply(xxx.scala:47)at scala.Option.getOrElse(Option.scala:120)at org.apache.spark.streaming.StreamingContext$.getOrCreate(StreamingContext.scala:864)at com.xxx.spark.main.xxx.getOrCreateStreamingContext(xxx.scala:47)at com.xxx.spark.main.xxx$.main(xxx.scala:34)at com.xxx.spark.main.xxx.main(xxx.scala)解決方式:檢查kafka服務器端口是否正常,如果已經啟動kafka把進程殺掉,kill 進程號? 重新啟動
kafka設置一鍵啟停? ?https://blog.csdn.net/qq_43412289/article/details/100633902?
總結
以上是生活随笔為你收集整理的sparkStreaming+kafka SparkException: java.nio.channels.ClosedChannelException异常报错的全部內容,希望文章能夠幫你解決所遇到的問題。
- 上一篇: IQ00手机的锁屏充电怎么开
- 下一篇: Vivo X7 plus手机闹钟在哪里调