pwd
ls
cat spark--org.apache.spark.deploy.master.Master-1-spark-master.out
root@spark-master:/home/spark/logs# cat spark--org.apache.spark.deploy.master.Master-1-spark-master.out
Spark Command: /usr/lib/jvm/java-8-openjdk-amd64/bin/java -cp /home/spark/conf/:/home/spark/jars/* -Xmx1g org.apache.spark.deploy.master.Master --host spark-master --port 17077 --webui-port 18080
========================================
Using Spark's default log4j profile: org/apache/spark/log4j-defaults.properties
22/04/13 04:17:33 INFO Master: Started daemon with process name: 31@spark-master
22/04/13 04:17:33 INFO SignalUtils: Registering signal handler for TERM
22/04/13 04:17:33 INFO SignalUtils: Registering signal handler for HUP
22/04/13 04:17:33 INFO SignalUtils: Registering signal handler for INT
22/04/13 04:17:33 WARN NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
22/04/13 04:17:33 INFO SecurityManager: Changing view acls to: root
22/04/13 04:17:33 INFO SecurityManager: Changing modify acls to: root
22/04/13 04:17:33 INFO SecurityManager: Changing view acls groups to:
22/04/13 04:17:33 INFO SecurityManager: Changing modify acls groups to:
22/04/13 04:17:33 INFO SecurityManager: SecurityManager: authentication disabled; ui acls disabled; users with view permissions: Set(root); groups with view permissions: Set(); users with modify permissions: Set(root); groups with modify permissions: Set()
22/04/13 04:17:34 INFO Utils: Successfully started service 'sparkMaster' on port 17077.
22/04/13 04:17:34 INFO Master: Starting Spark master at spark://spark-master:17077
22/04/13 04:17:34 INFO Master: Running Spark version 3.2.1
22/04/13 04:17:34 INFO Utils: Successfully started service 'MasterUI' on port 18080.
22/04/13 04:17:34 INFO MasterWebUI: Bound MasterWebUI to 0.0.0.0, and started at http://spark-master:18080
22/04/13 04:17:34 INFO Master: I have been elected leader! New state: ALIVE
'Data Engineering > Spark' 카테고리의 다른 글
[Spark] Spark Cluster 간단하게 만들어보기 (standalone) (0) | 2022.04.13 |
---|---|
[Spark] org.apache.spark.deploy.master.Master running as process 580. Stop it first. (0) | 2022.04.13 |
[Spark] ./spark/sbin/start-worker.sh 실행 옵션 확인하는 방법 (0) | 2022.04.13 |
[Spark] ./spark/sbin/start-master.sh 실행 옵션 확인 (0) | 2022.04.13 |
[Spark] 도커 컨테이너의 열린 포트 확인하는 방법 (0) | 2022.04.13 |