flink的DAG可视化使用(visualizer的使用)
生活随笔
收集整理的這篇文章主要介紹了
flink的DAG可视化使用(visualizer的使用)
小編覺得挺不錯的,現在分享給大家,幫大家做個參考.
根據官方文檔[1]
來做一些實驗吧,代碼采用[2]中代碼
步驟如下:
| ① | mvn clean scala:compile compile package |
| ② | nc -lk 9999 flink run -c wordcount_increstate /home/appleyuchi/桌面/Flink_Code/flink_state/checkpoint/Scala/target/datastream_api-1.0-SNAPSHOT.jar |
提交到集群的時候,會在終端返回一個json
{"nodes" : [ {"id" : 1,"type" : "Source: Socket Stream","pact" : "Data Source","contents" : "Source: Socket Stream","parallelism" : 1}, {"id" : 2,"type" : "Flat Map","pact" : "Operator","contents" : "Flat Map","parallelism" : 2,"predecessors" : [ {"id" : 1,"ship_strategy" : "REBALANCE","side" : "second"} ]}, {"id" : 3,"type" : "Map","pact" : "Operator","contents" : "Map","parallelism" : 2,"predecessors" : [ {"id" : 2,"ship_strategy" : "FORWARD","side" : "second"} ]}, {"id" : 4,"type" : "Map","pact" : "Operator","contents" : "Map","parallelism" : 2,"predecessors" : [ {"id" : 3,"ship_strategy" : "FORWARD","side" : "second"} ]}, {"id" : 6,"type" : "aggregation","pact" : "Operator","contents" : "aggregation","parallelism" : 2,"predecessors" : [ {"id" : 4,"ship_strategy" : "HASH","side" : "second"} ]}, {"id" : 7,"type" : "Sink: Print to Std. Out","pact" : "Data Sink","contents" : "Sink: Print to Std. Out","parallelism" : 2,"predecessors" : [ {"id" : 6,"ship_strategy" : "FORWARD","side" : "second"} ]} ] }把這個json復制到https://flink.apache.org/visualizer/中,即可得到下圖:
?
Reference:
[1]Execution Plans
[2]Flink增量Checkpoint實驗
總結
以上是生活随笔為你收集整理的flink的DAG可视化使用(visualizer的使用)的全部內容,希望文章能夠幫你解決所遇到的問題。
- 上一篇: 网易大神APP怎么查看光遇开始玩的时间(
- 下一篇: 剑网3九隐峰在哪