[Spark] Docker, failed: port is already allocated

Creating zookeeper-navigator ... done
Creating spark-master-1      ... done
Creating spark-master-2      ... done
WARNING: The "spark-slave" service specifies a port on the host. If multiple containers for this service are created on a single host, the port will clash.
Creating zeppelin            ... 
Creating 3_spark-cluster-zookeeper_spark-slave_1 ... 
Creating 3_spark-cluster-zookeeper_spark-slave_1 ... error
Creating 3_spark-cluster-zookeeper_spark-slave_3 ... 
Creating 3_spark-cluster-zookeeper_spark-slave_2 ... done
Creating 3_spark-cluster-zookeeper_spark-slave_3 ... error
WARNING: Host is already in use by another container

Creating zeppelin                                ... done(9178c987f2a92fa9df8c45a94bae05e983953c92695cff32a553c87b21477564): Bind for 0.0.0.0:8090 failed: port is already allocated

ERROR: for 3_spark-cluster-zookeeper_spark-slave_3  Cannot start service spark-slave: driver failed programming external connectivity on endpoint 3_spark-cluster-zookeeper_spark-slave_3 Creating spark-client                            ... done

ERROR: for spark-slave  Cannot start service spark-slave: driver failed programming external connectivity on endpoint 3_spark-cluster-zookeeper_spark-slave_1 (9178c987f2a92fa9df8c45a94bae05e983953c92695cff32a553c87b21477564): Bind for 0.0.0.0:8090 failed: port is already allocated
ERROR: Encountered errors while bringing up the project.

 

problem

  spark-slave:
    # hostname: spark-slave
    # container_name: spark-slave
    image: spark-cluster:0.04
    restart: always
    stdin_open: true
    tty: true
    scale: 3
    ports:
      - 8090:8080
    environment:
      - SPARK_MODE=slave
      - SPARK_MASTER_HOST=spark-master-1
      - SPARK_MASTER_HOST_SUB=spark-master-2
      - SPARK_MASTER_PORT=7077
      - SPARK_MASTER_PORT_SUB=7077
      - SPARK_WORKER_CORES=4
      - SPARK_WORKER_MEMORY=6g
      - SPARK_WORKER_WEBUI_PORT=8080
      - SPARK_CONF_DIR=/home/spark/conf
      - SPARK_LOG_DIR=/home/spark/logs
      - SPARK_LOG_MAX_FILES=5
      - SPARK_PID_DIR=/tmp
    depends_on:
      - spark-master-1
      - spark-master-2
      - zookeeper-1
      - zookeeper-2
      - zookeeper-3

 

solve

  spark-slave:
    # hostname: spark-slave
    # container_name: spark-slave
    image: spark-cluster:0.04
    restart: always
    stdin_open: true
    tty: true
    scale: 3
    ports:
      - 8090-8092:8080
    environment:
      - SPARK_MODE=slave
      - SPARK_MASTER_HOST=spark-master-1
      - SPARK_MASTER_HOST_SUB=spark-master-2
      - SPARK_MASTER_PORT=7077
      - SPARK_MASTER_PORT_SUB=7077
      - SPARK_WORKER_CORES=4
      - SPARK_WORKER_MEMORY=6g
      - SPARK_WORKER_WEBUI_PORT=8080
      - SPARK_CONF_DIR=/home/spark/conf
      - SPARK_LOG_DIR=/home/spark/logs
      - SPARK_LOG_MAX_FILES=5
      - SPARK_PID_DIR=/tmp
    depends_on:
      - spark-master-1
      - spark-master-2
      - zookeeper-1
      - zookeeper-2
      - zookeeper-3