如何创建容器可以互相通信的docker Composer环境？

Question

我的目的是：

• kafka 生产者并公开 API 来发送消息，在容器中运行
• 在另一个容器中运行的 kafka 消费者
• zookeeper 在另一个容器中运行
• kafka 服务器运行在另一个容器中

对于最后两个我使用https://github.com/conduktor/kafka-stack-docker-compose?tab=readme-ov-file

我尝试使用桥接示例将它们全部添加到同一网络，但它不起作用。我不断从容器日志上的生产者那里收到消息，例如

Id=adminclient-1] Connection to node -1 (localhost/127.0.0.1:9092) could not be established. Broker may not be available.
2024-03-30 08:37:30 2024-03-30T08:37:30.515Z  INFO 1 --- [| adminclient-1] org.apache.kafka.clients.NetworkClient   : [AdminClient clientId=adminclient-1] Node -1 disconnected.

现在我正在尝试 docker compose 方法，但我真的不知道从哪里开始。 应该怎么做才能让他们互相沟通？

version: '1.0'

services:
  zoo1:
    image: confluentinc/cp-zookeeper:7.3.2
    hostname: zoo1
    container_name: zoo1
    ports:
      - "2181:2181"
    environment:
      ZOOKEEPER_CLIENT_PORT: 2181
      ZOOKEEPER_SERVER_ID: 1
      ZOOKEEPER_SERVERS: zoo1:2888:3888

  kafka1:
    image: confluentinc/cp-kafka:7.3.2
    hostname: kafka1
    container_name: kafka1
    ports:
      - "9092:9092"
      - "29092:29092"
      - "9999:9999"
    environment:
      KAFKA_ADVERTISED_LISTENERS: INTERNAL://kafka1:19092,EXTERNAL://${DOCKER_HOST_IP:-127.0.0.1}:9092,DOCKER://host.docker.internal:29092
      KAFKA_LISTENER_SECURITY_PROTOCOL_MAP: INTERNAL:PLAINTEXT,EXTERNAL:PLAINTEXT,DOCKER:PLAINTEXT
      KAFKA_INTER_BROKER_LISTENER_NAME: INTERNAL
      KAFKA_ZOOKEEPER_CONNECT: "zoo1:2181"
      KAFKA_BROKER_ID: 1
      KAFKA_LOG4J_LOGGERS: "kafka.controller=INFO,kafka.producer.async.DefaultEventHandler=INFO,state.change.logger=INFO"
      KAFKA_OFFSETS_TOPIC_REPLICATION_FACTOR: 1
      KAFKA_TRANSACTION_STATE_LOG_REPLICATION_FACTOR: 1
      KAFKA_TRANSACTION_STATE_LOG_MIN_ISR: 1
      KAFKA_JMX_PORT: 9999
      KAFKA_JMX_HOSTNAME: ${DOCKER_HOST_IP:-127.0.0.1}
      KAFKA_AUTHORIZER_CLASS_NAME: kafka.security.authorizer.AclAuthorizer
      KAFKA_ALLOW_EVERYONE_IF_NO_ACL_FOUND: "true"
    depends_on:
      - zoo1
  producer:
    image: producer:1.0
    hostname: producer1
    container_name: producer
    ports:
      - "8080:8080"
  consumer:
    image: consumer:1.0
    hostname: consumer1
    container_name: consumer
    ports:
      - "18080:18080"

我的consumer项目的application.properties是这样的

spring.kafka.producer.bootstrap-servers=localhost:9092
spring.kafka.consumer.group-id=groupid
spring.kafka.producer.key-serializer=org.apache.kafka.common.serialization.StringSerializer
spring.kafka.producer.value-serializer=org.apache.kafka.common.serialization.StringSerializer

Answer 1

您的错误来自kafka AdminClient，它未配置（从配置中删除生产者）。然后，您必须使用正确的广告侦听器和端口，而不是 localhost

spring.kafka.bootstrap-servers=kafka:19092