Apache Kafka(二)- Kakfa 安装与启动
安裝并啟動Kafka
1.下載最新版Kafka(當前為kafka_2.12-2.3.0)并解壓:
> wget http://mirror.bit.edu.cn/apache/kafka/2.3.0/kafka_2.12-2.3.0.tgz
> tar zxvf kafka_2.12-2.3.0.tgz
?
2. 檢查Java 環境是否正確:
> cd kafka_2.12-2.3.0
> bin/kafka-topics.sh
?
若是無法成功執行,則檢查 Java 環境是否正確配置(此例中使用Java 8)
?
3. 將kafka執行腳本目錄加入環境變量:
> vi ~/.bash_profile
> export PATH="$PATH:/home/hadoop/kafka_2.12-2.3.0/bin"
?
4. 啟動Zookeeper
> zookeeper-server-start.sh config/zookeeper.properties
?
?
?
查看 config/zookeeper.properties 文件,可以看到基本配置:
# the directory where the snapshot is stored.
dataDir=/tmp/zookeeper
# the port at which the clients will connect
clientPort=2181
# disable the per-ip limit on the number of connections since this is a non-production config
maxClientCnxns=0
?
其中需要將dataDir修改為非/tmp 目錄,以將數據持久化,例如:
dataDir=/home/hadoop/kafka_2.12-2.3.0/data/zookeeper
?
然后重啟zookeeper:
> zookeeper-server-start.sh config/zookeeper.properties
?
之后可以在dataDir目錄下查看到zookeeper數據目錄:
> pwd
/home/hadoop/kafka_2.12-2.3.0/data/zookeeper/version-2
?
5. 啟動Kafka
首先修改 conf/server.properties 文件,可以看到日志文件地址為:
# A comma separated list of directories under which to store log files
log.dirs=/tmp/kafka-logs
?
修改此路徑為非/tmp目錄,以落盤log數據,例如:
log.dirs=/home/hadoop/kafka_2.12-2.3.0/data/kafka-logs
?
然后啟動Kafka:
> kafka-server-start.sh config/server.properties
?
?
?
查看 data/kafka-logs,可以看到以下文件:
> ls
cleaner-offset-checkpoint??? meta.properties?????????????????? replication-offset-checkpoint
log-start-offset-checkpoint? recovery-point-offset-checkpoint
?
轉載于:https://www.cnblogs.com/zackstang/p/11310946.html
總結
以上是生活随笔為你收集整理的Apache Kafka(二)- Kakfa 安装与启动的全部內容,希望文章能夠幫你解決所遇到的問題。
- 上一篇: CSharp关键字----using
- 下一篇: POJ 3687 Labeling Ba