在K8s下部署Kafka集群

最新推荐文章于 2025-05-05 18:13:40 发布

芸灵fly

最新推荐文章于 2025-05-05 18:13:40 发布

阅读量4.4k

点赞数 2

CC 4.0 BY-SA版权

分类专栏： Kubernetes 消息中间件文章标签： K8s Zookeeper Kafka

本文链接：https://blog.csdn.net/weixin_38187317/article/details/107000052

本文详细记录了在Kubernetes(K8s)环境下部署Zookeeper和Kafka集群的过程，包括遇到的问题及解决方案。在多master设置中，作者强调了KAFKA_ADVERTISED_LISTENERS配置的重要性，指出不正确设置会导致Java程序无法连接。同时，提供了命令行和Java测试的方法以验证Kafka集群的正常运行。

摘要生成于 C知道，由 DeepSeek-R1 满血版支持，前往体验 >

说明

今天来记录一下在K8s下部署Kafka集群，本以为K8s发展到今天已经有很多人踩过坑了，安装个Kafka问题也不大，可自己还是遇到了坑o(╥﹏╥)o，由于我的K8s集群是1master多worker，所以可能多master的情况下配置也不一样，请酌情查看。

快速开始

master_ip:192.168.128.52

先创建一个命名空间，之后全在这操作

kubectl create namespace zookeeper

Zookeeper集群的安装

创建zookeeper-svc.yaml

apiVersion: v1
kind: Service
metadata:
  name: zoo1
  labels:
    app: zookeeper-1
spec:
  ports:
  - name: client
    port: 2181
    protocol: TCP
  - name: follower
    port: 2888
    protocol: TCP
  - name: leader
    port: 3888
    protocol: TCP
  selector:
    app: zookeeper-1
---
apiVersion: v1
kind: Service
metadata:
  name: zoo2
  labels:
    app: zookeeper-2
spec:
  ports:
  - name: client
    port: 2181
    protocol: TCP
  - name: follower
    port: 2888
    protocol: TCP
  - name: leader
    port: 3888
    protocol: TCP
  selector:
    app: zookeeper-2
---
apiVersion: v1
kind: Service
metadata:
  name: zoo3
  labels:
    app: zookeeper-3
spec:
  ports:
  - name: client
    port: 2181
    protocol: TCP
  - name: follower
    port: 2888
    protocol: TCP
  - name: leader
    port: 3888
    protocol: TCP
  selector:
    app: zookeeper-3

创建zookeeper-deployment.yaml

apiVersion: apps/v1
kind: Deployment
metadata:
  name: zookeeper-deployment-1
spec:
  replicas: 1
  selector:
    matchLabels:
      app: zookeeper-1
      name: zookeeper-1
  template:
    metadata:
      labels:
        app: zookeeper-1
        name: zookeeper-1
    spec:
      containers:
      - name: zoo1
        image: zookeeper
        imagePullPolicy: IfNotPresent
        ports:
        - containerPort: 2181
        env:
        -