Kafka环境搭建

1、下载安装包到software

curl -O https://archive.apache.org/dist/kafka/0.10.0.0/kafka_2.11-0.10.0.0.tgz

2、解压到~/application

tar -zxvf kafka_2.11-0.10.0.0.tgz -C ~/application

3、添加系统环境变量

sudo vim ~/.bash_profile
# Setting Path for Kafka
export KAFKA_HOME=~/application/kafka_2.11-0.10.0.0
export PATH=$PATH:$KAFKA_HOME/bin
source ~/.bash_profile

**

单结点单broker

**

4、配置Kafka

cd ~/application/kafka_2.11-0.10.0.0/conf

#修改server-properties.sh
vim server-properties.sh
    host.name=127.0.0.1
    log.dirs=~/application/tmp/kafka
    zookeeper.connect=127.0.0.1:2181

5、Kafka启动/停止

cd ~/application/kafka_2.11-0.10.0.0/bin
./kafka-server-start.sh -daemon $KAFKA_HOME/config/server.properties

6、创建topic

cd ~/application/kafka_2.11-0.10.0.0/bin
./kafka-topics.sh --create -zookeeper 127.0.0.1:2181 --replication-factor 1 --partitions 1 --topic test_kafka
注意：指定zookeeper

7、查看topic相关命令

cd ~/application/kafka_2.11-0.10.0.0/bin
#查看所有topic
./kafka-topics.sh --list -zookeeper 127.0.0.1:2181

#查看所有topic的详细信息
./kafka-topics.sh --describe -zookeeper 127.0.0.1:2181

#查看指定topic的详细信息
./kafka-topics.sh --describe -zookeeper 127.0.0.1:2181 --topic test_kafka

8、启动topic生产者

cd ~/application/kafka_2.11-0.10.0.0/bin
./kafka-console-producer.sh --broker-list 127.0.0.1:9092 --topic test_kafka
注意：指定broker

9、启动topic消费者

cd ~/application/kafka_2.11-0.10.0.0/bin
#只消费最新接收的消息
./kafka-console-consumer.sh --zookeeper 127.0.0.1:2181 --topic test_kafka
#从头消费
./kafka-console-consumer.sh --zookeeper 127.0.0.1:2181 --topic test_kafka --from-beginning
注意：指定zookeeper