![]()
Data Engineering/Kafka
파일구조 docker-compose.yml 파일 version: '2.1' services: zookeeper-1: hostname: zookeeper-1 container_name: zookeeper-1 image: zookeeper:3.6 restart: always ports: - 2181:2181 environment: ZOO_MY_ID: 1 ZOO_SERVERS: server.1=zookeeper-1:2888:3888;2181 server.2=zookeeper-2:2888:3888;2181 server.3=zookeeper-3:2888:3888;2181 volumes: - type: bind source: ./data/zk-cluster/zookeeper-1/data target: /data r..
![]()
Data Engineering/Kafka
docker-compose.yml version: '2' services: # wurstmeister/zookeeper:3.4.6 zookeeper: hostname: zookeeper container_name: zookeeper image: wurstmeister/zookeeper:3.4.6 ports: - "2181:2181" # wurstmeister/kafka:2.13-2.8.1 - broker 1 kafka1: hostname: kafka1 container_name: kafka1 image: wurstmeister/kafka:2.13-2.8.1 environment: KAFKA_BROKER_ID: 1 KAFKA_ZOOKEEPER_CONNECT: zookeeper:2181 KAFKA_ADVER..
![]()
Data Engineering/Kafka
docker-compose.yml version: '3' services: # wurstmeister/zookeeper:3.4.6 zookeeper: hostname: zookeeper container_name: zookeeper image: wurstmeister/zookeeper:3.4.6 ports: - "2181:2181" # wurstmeister/kafka:2.13-2.8.1 kafka: hostname: kafka container_name: kafka image: wurstmeister/kafka:2.13-2.8.1 environment: KAFKA_ADVERTISED_LISTENERS: PLAINTEXT://localhost:9092 KAFKA_LISTENERS: PLAINTEXT://..
![]()
Data Engineering/Kafka
docker-compose.yml version: '2' services: # wurstmeister/zookeeper:3.4.6 zookeeper: hostname: zookeeper container_name: zookeeper image: wurstmeister/zookeeper:3.4.6 ports: - "2181:2181" # wurstmeister/kafka:2.13-2.8.1 - broker 1 kafka1: hostname: kafka1 container_name: kafka1 image: wurstmeister/kafka:2.13-2.8.1 environment: KAFKA_BROKER_ID: 1 KAFKA_ZOOKEEPER_CONNECT: zookeeper:2181 KAFKA_ADVER..
![]()
Data Engineering/Kafka
docker-compose.yml version: '3' services: # wurstmeister/zookeeper:3.4.6 zookeeper: hostname: zookeeper container_name: zookeeper image: wurstmeister/zookeeper:3.4.6 ports: - "2181:2181" # wurstmeister/kafka:2.13-2.8.1 kafka: hostname: kafka container_name: kafka image: wurstmeister/kafka:2.13-2.8.1 environment: KAFKA_ADVERTISED_LISTENERS: PLAINTEXT://localhost:9092 KAFKA_LISTENERS: PLAINTEXT://..
![]()
Data Engineering/Kafka
1. 도커 컴포즈 파일 작성 docker-compose.yml version: '3' services: # wurstmeister/zookeeper:3.4.6 zookeeper: hostname: zookeeper container_name: zookeeper image: wurstmeister/zookeeper:3.4.6 ports: - "2181:2181" # wurstmeister/kafka:2.13-2.8.1 kafka: hostname: kafka container_name: kafka image: wurstmeister/kafka:2.13-2.8.1 environment: KAFKA_ADVERTISED_LISTENERS: PLAINTEXT://localhost:9092 KAFKA_LISTENE..
![]()
Data Engineering/Kafka
1. 도커 컴포즈 파일을 작성한다. docker-compse.yml version: '3' services: # wurstmeister/zookeeper:3.4.6 zookeeper: hostname: zookeeper container_name: zookeeper image: wurstmeister/zookeeper:3.4.6 ports: - "2181:2181" # wurstmeister/kafka:2.13-2.8.1 kafka: hostname: kafka container_name: kafka image: wurstmeister/kafka:2.13-2.8.1 environment: KAFKA_ADVERTISED_LISTENERS: PLAINTEXT://localhost:9092 KAFKA_LIST..
![]()
Data Engineering/Kafka
1. 도커 컴포즈 파일 작성 docker-compose.yml 파일을 작성한다 version: '3' services: # wurstmeister/zookeeper:3.4.6 zookeeper: hostname: zookeeper container_name: zookeeper image: wurstmeister/zookeeper:3.4.6 ports: - "2181:2181" # wurstmeister/kafka:2.13-2.8.1 kafka: hostname: kafka container_name: kafka image: wurstmeister/kafka:2.13-2.8.1 environment: KAFKA_ADVERTISED_LISTENERS: PLAINTEXT://localhost:9092 KAFK..
![]()
Data Engineering/Kafka
컨테이너 확인을 위해 도커컴포즈 파일을 만든다 docker-compose.yml version: '3' services: # zookeeper 3.4.6 zookeeper: hostname: zookeeper container_name: zookeeper image: wurstmeister/zookeeper:3.4.6 ports: - "2181:2181" # kafka 2.13-2.8.1 kafka: hostname: kafka container_name: kafka image: wurstmeister/kafka:2.13-2.8.1 environment: KAFKA_ADVERTISED_LISTENERS: PLAINTEXT://localhost:9092 KAFKA_LISTENERS: PLAINTEXT://..
![]()
Data Engineering/Kafka
도커컴포즈 파일을 작성해보자 docker-compose.yml version: '2' services: # wurstmeister/zookeeper:3.4.6 zookeeper: hostname: zookeeper container_name: zookeeper image: wurstmeister/zookeeper:3.4.6 ports: - "2181:2181" # wurstmeister/kafka:2.13-2.8.1 - broker 1 kafka1: hostname: kafka1 container_name: kafka1 image: wurstmeister/kafka:2.13-2.8.1 environment: KAFKA_BROKER_ID: 1 KAFKA_ZOOKEEPER_CONNECT: zookeeper:..
