Storm 疑难杂症。
生活随笔
收集整理的這篇文章主要介紹了
Storm 疑难杂症。
小編覺得挺不錯的,現在分享給大家,幫大家做個參考.
疑難解答: 這個頁面列出了一些人們在使用storm時遇到的問題和他們的解決方案。 worker 進程 啟動時沒有堆棧信息。 可能的情形: Topology 只在一臺機器的不同worker中運行,但是在多節點上運行會遇到問題或崩潰。 解決方法: 你可能配置錯了子網,在其中節點不能通過hostname(機器名)定位其他的節點。ZeroMQ ?有時不能解析主機的時候不能處理數據。有兩種解決辦法。 1.在/etc/hosts 中做hostname 和 ip 的映射 2.假設內部DNS服務器,這樣節點都能通過hostname定位其他節點。 節點之間不能夠通信 可能的現象: 每一個spout tuple 都失敗 進程不工作 解決方法: storm 不能使用ipv6 工作。你需要強制使用ipv4 添加?-Djava.net.preferIPv4Stack=true 到 supervisor 子選項上,然后 重啟supervisor。 你可能配置錯了子網 具體請看上一條:worker 進程 啟動時沒有堆棧信息。 topology 不久之后就停止處理tuple 現象: 處理工作一段時間內是正常的,然后突然停止了。spout tuple 開始全部失敗。 解決辦法: 這是使用了ZeroMQ 2.1.10的問題。回退到版本ZeroMQ 2.1.7。 不是所有的supervisor都出現在Storm UI 上 現象: 有些supervisor進程在Storm UI 上看不到 刷先后很多supervisor 改變 解決辦法: 確定 supervisor的本地文件夾是獨立的 (例如,,不是一個通過NFS分享的本地文件夾) 試著刪除本地文件夾,然后重啟。Supervisor 創建一個獨有的id,然后把它存儲在本地。 當這個id被復制到其他節點上,storm就會變得茫然了。
“Multiple defaults.yaml found” error
現象: 當你用“storm jar”部署 topology是,你會得到這個錯誤 解決辦法: 極有可能是你把 Strom的jar包也打包到你的topology jar包中了。 當打包你的topology jar 時,不要包含 storm 的jars ,storm 將會通過classpath 把他們放到里面。“NoSuchMethodError” when running storm jar
現象: 當運行storm jar 時 你得到一個模糊的”NoSuchMethodError” 解決辦法: 你這在部署的topology的運行環境與你打包topology時用的storm不是一個版本。確定你編譯topology用的storm的版本與你用的storm的客戶端是同一個版本。 附英文原文: https://github.com/nathanmarz/storm/wiki/TroubleshootingTroubleshooting
- Page History
Troubleshooting
This page lists issues people have run into when using Storm along with their solutions.
Worker processes are crashing on startup with no stack trace
Possible symptoms:
- Topologies work with one node, but workers crash with multiple nodes
Solutions:
- You may have a misconfigured subnet, where nodes can’t locate other nodes based on their hostname. ZeroMQ sometimes crashes the process when it can’t resolve a host. There are two solutions:
- Make a mapping from hostname to IP address in /etc/hosts
- Set up an internal DNS so that nodes can locate each other based on hostname.
Nodes are unable to communicate with each other
Possible symptoms:
- Every spout tuple is failing
- Processing is not working
Solutions:
- Storm doesn’t work with ipv6. You can force ipv4 by adding?-Djava.net.preferIPv4Stack=true?to the supervisor child options and restarting the supervisor.
- You may have a misconfigured subnet. See the solutions for?Worker processes are crashing on startup with no stack trace
Topology stops processing tuples after awhile
Symptoms:
- Processing works fine for awhile, and then suddenly stops and spout tuples start failing en masse.
Solutions:
- This is a known issue with ZeroMQ 2.1.10. Downgrade to ZeroMQ 2.1.7.
Not all supervisors appear in Storm UI
Symptoms:
- Some supervisor processes are missing from the Storm UI
- List of supervisors in Storm UI changes on refreshes
Solutions:
- Make sure the supervisor local dirs are independent (e.g., not sharing a local dir over NFS)
- Try deleting the local dirs for the supervisors and restarting the daemons. Supervisors create a unique id for themselves and store it locally. When that id is copied to other nodes, Storm gets confused.
“Multiple defaults.yaml found” error
Symptoms:
- When deploying a topology with “storm jar”, you get this error
Solution:
- You’re most likely including the Storm jars inside your topology jar. When packaging your topology jar, don’t include the Storm jars as Storm will put those on the classpath for you.
“NoSuchMethodError” when running storm jar
Symptoms:
- When running storm jar, you get a cryptic “NoSuchMethodError”
Solution:
- You’re deploying your topology with a different version of Storm than you built your topology against. Make sure the storm client you use comes from the same version as the version you compiled your topology against.
轉載于:https://www.cnblogs.com/qgxiaoguang/archive/2013/02/17/2914462.html
總結
以上是生活随笔為你收集整理的Storm 疑难杂症。的全部內容,希望文章能夠幫你解決所遇到的問題。
- 上一篇: 动视暴雪靠《暗黑破坏神:不朽》等手游赚翻
- 下一篇: 时速350公里 中国高铁首次出口海外:雅