Linux安装(Java、Zookeeper、Kafka)

野性酷女 2022-02-24 02:37 344阅读 0赞

# 虚拟机搭建 #

[https://blog.csdn.net/qq\_37598011/article/details/88960035][https_blog.csdn.net_qq_37598011_article_details_88960035]

# 安装Java环境 #

[https://www.oracle.com/technetwork/java/javase/downloads/jdk8-downloads-2133151.html][https_www.oracle.com_technetwork_java_javase_downloads_jdk8-downloads-2133151.html]

![watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3FxXzM3NTk4MDEx_size_16_color_FFFFFF_t_70][]\\

下载完成后，上传压缩包：

解压：

tar zxvf jdk-8u201-linux-x64.tar.gz

![20190402202838256.png][]

记下jdk目录，输入:

pwd

![20190402203544555.png][]

使用Vi编辑器，设置环境变量:

sudo vi /etc/profile

export JAVA_HOME=/myText/jdk1.8.0_201
    export CLASSPATH=.:$JAVA_HOME/lib/dt.jar:$JAVA_HOME/lib/tools.jar
    export PATH=$PATH:$JAVA_HOME/bin

![watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3FxXzM3NTk4MDEx_size_16_color_FFFFFF_t_70 1][]

环境生效：

source /etc/profile

![20190402203829569.png][]

# 安装zookeeper #

[http://apache.fayea.com/zookeeper/][http_apache.fayea.com_zookeeper]

wget http://apache.fayea.com/zookeeper/zookeeper-3.4.14/zookeeper-3.4.14.tar.gz

下载后上传至linux：

解压：

tar -zxvf zookeepre-3.4.13.tar.gz

cd zookeeper-3.4.13
    
    mkdir data

![watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3FxXzM3NTk4MDEx_size_16_color_FFFFFF_t_70 2][]

进入conf文件夹：

cd conf/

将zoo\_sample.cfg复制一份并重命名为zoo.cfg：

cp zoo_sample.cfg zoo.cfg

修改zoo.cfg中dataDir路径为刚刚创建的data：

vim zoo.cfg

![watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3FxXzM3NTk4MDEx_size_16_color_FFFFFF_t_70 3][]

进入bin目录:

cd ../bin/

启动zkServer.sh:

./zkServer.sh start

OK~再看看状态：

![20190402205740569.png][]

输入jps：

![20190402205756522.png][]

# 安装Kafak #

[http://apache.01link.hk/kafka/2.2.0/][http_apache.01link.hk_kafka_2.2.0]![watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3FxXzM3NTk4MDEx_size_16_color_FFFFFF_t_70 4][]

wget http://apache.01link.hk/kafka/2.2.0/kafka_2.11-2.2.0.tgz

解压：

tar -zxvf kafka_2.11-2.2.0.tgz

修改server.properties文件(我的配置如下):

vim server.properties

broker.id=0
    
    ############################# Socket Server Settings #############################
    
    listeners=PLAINTEXT://192.168.78.133:9092
    
    num.network.threads=3
    num.io.threads=8
    socket.send.buffer.bytes=102400
    socket.receive.buffer.bytes=102400
    socket.request.max.bytes=104857600
    
    
    ############################# Log Basics #############################
    log.dirs=/data/kafka-logs
    num.partitions=1
    num.recovery.threads.per.data.dir=1
    
    ############################# Internal Topic Settings  #############################
    offsets.topic.replication.factor=1
    transaction.state.log.replication.factor=1
    transaction.state.log.min.isr=1
    
    ############################# Log Flush Policy #############################
    
    # The number of messages to accept before forcing a flush of data to disk
    #log.flush.interval.messages=10000
    
    # The maximum amount of time a message can sit in a log before we force a flush
    #log.flush.interval.ms=1000
    
    ############################# Log Retention Policy #############################
    
    log.retention.hours=168
    log.segment.bytes=1073741824
    log.retention.check.interval.ms=300000
    
    ############################# Zookeeper #############################
    zookeeper.connect=192.168.78.133:2181
    zookeeper.connection.timeout.ms=6000
    
    ############################# Group Coordinator Settings #############################
    
    group.initial.rebalance.delay.ms=0

进入bin目录后，启动kafak:

bin/kafka-server-start.sh config/server.properties &

![watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3FxXzM3NTk4MDEx_size_16_color_FFFFFF_t_70 5][]

检测2181与9092端口：

netstat -tunlp|egrep "(2181|9092)"

![20190402211357164.png][]

单机测试：

提供者：

bin/kafka-console-producer.sh --broker-list 192.168.234.128:9092 --topic test

消费者：

bin/kafka-console-consumer.sh --zookeeper 192.168.234.128:2181 --topic test --from-beginning

![20190402211756918.png][]

![watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3FxXzM3NTk4MDEx_size_16_color_FFFFFF_t_70 6][]

**注意！！！！（高版本可能会报错：）**

![watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3FxXzM3NTk4MDEx_size_16_color_FFFFFF_t_70 7][]

这时候需要用如下命令：

bin/kafka-console-consumer.sh --bootstrap-server localhost:9092 --topic test --from-beginning

![2019040911370061.png][]

OK！

[https_blog.csdn.net_qq_37598011_article_details_88960035]: https://blog.csdn.net/qq_37598011/article/details/88960035
[https_www.oracle.com_technetwork_java_javase_downloads_jdk8-downloads-2133151.html]: https://www.oracle.com/technetwork/java/javase/downloads/jdk8-downloads-2133151.html
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3FxXzM3NTk4MDEx_size_16_color_FFFFFF_t_70]: /images/20220224/f45ec25e587e4651ba70685ab97213a2.png
[20190402202838256.png]: /images/20220224/62ed61e860734a3b850042b7a5f9379c.png
[20190402203544555.png]: /images/20220224/5cd4f347d5c04ef48749f4b9b1ecb5bc.png
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3FxXzM3NTk4MDEx_size_16_color_FFFFFF_t_70 1]: /images/20220224/e9010966ad77406bbbb45559d87709e6.png
[20190402203829569.png]: /images/20220224/d09cab57b3a54ce981ab153b7a315b32.png
[http_apache.fayea.com_zookeeper]: http://apache.fayea.com/zookeeper/
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3FxXzM3NTk4MDEx_size_16_color_FFFFFF_t_70 2]: /images/20220224/d999bd5f018245519ca74b80375b33f5.png
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3FxXzM3NTk4MDEx_size_16_color_FFFFFF_t_70 3]: /images/20220224/42cfcdfd61a14c258b80a5ed53a7052b.png
[20190402205740569.png]: /images/20220224/d5ff4b808e53492897936e5b2766a474.png
[20190402205756522.png]: /images/20220224/27fd3ba26a75403da6ac3aa7eb79918e.png
[http_apache.01link.hk_kafka_2.2.0]: http://apache.01link.hk/kafka/2.2.0/
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3FxXzM3NTk4MDEx_size_16_color_FFFFFF_t_70 4]: /images/20220224/4b9807f9a1eb4e9cb4c57c722cb4529f.png
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3FxXzM3NTk4MDEx_size_16_color_FFFFFF_t_70 5]: /images/20220224/3c7a96f8d38a42198746c193ae700a1f.png
[20190402211357164.png]: /images/20220224/7bdbb2828df84b05ae48b8067eb922bc.png
[20190402211756918.png]: /images/20220224/c00589067d4443ea9f697b00a41d65f1.png
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3FxXzM3NTk4MDEx_size_16_color_FFFFFF_t_70 6]: /images/20220224/9bf64ce10a654e39847869d7e3530b5f.png
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3FxXzM3NTk4MDEx_size_16_color_FFFFFF_t_70 7]: /images/20220224/068486c84de44164ab8457b4da124db6.png
[2019040911370061.png]: /images/20220224/1413899d432d404f9cd6925af64a42c7.png