[Airflow] 에어플로우의 로그파일이 존재하지 않을 때

비정상

airflow-worker
*** Log file does not exist: /opt/airflow/logs/dag_id=4_python_operator_context/run_id=scheduled__2022-12-10T11:22:00+00:00/task_id=print_kwargs/attempt=1.log
*** Fetching from: http://airflow-worker:8793/log/dag_id=4_python_operator_context/run_id=scheduled__2022-12-10T11:22:00+00:00/task_id=print_kwargs/attempt=1.log
*** !!!! Please make sure that all your Airflow components (e.g. schedulers, webservers and workers) have the same 'secret_key' configured in 'webserver' section and time is synchronized on all your machines (for example with ntpd) !!!!!
****** See more at https://airflow.apache.org/docs/apache-airflow/stable/configurations-ref.html#secret-key
****** Failed to fetch log file from worker. Client error '403 FORBIDDEN' for url 'http://airflow-worker:8793/log/dag_id=4_python_operator_context/run_id=scheduled__2022-12-10T11:22:00+00:00/task_id=print_kwargs/attempt=1.log'
For more information check: https://httpstatuses.com/403

 

 

정상

airflow-worker
*** Reading local file: /opt/airflow/logs/dag_id=4_python_operator_context/run_id=scheduled__2022-12-10T11:23:00+00:00/task_id=print_kwargs/attempt=1.log
[2022-12-10, 20:24:02 KST] {taskinstance.py:1165} INFO - Dependencies all met for <TaskInstance: 4_python_operator_context.print_kwargs scheduled__2022-12-10T11:23:00+00:00 [queued]>
[2022-12-10, 20:24:02 KST] {taskinstance.py:1165} INFO - Dependencies all met for <TaskInstance: 4_python_operator_context.print_kwargs scheduled__2022-12-10T11:23:00+00:00 [queued]>
[2022-12-10, 20:24:02 KST] {taskinstance.py:1362} INFO - 
--------------------------------------------------------------------------------
[2022-12-10, 20:24:02 KST] {taskinstance.py:1363} INFO - Starting attempt 1 of 1
[2022-12-10, 20:24:02 KST] {taskinstance.py:1364} INFO - 
--------------------------------------------------------------------------------
[2022-12-10, 20:24:02 KST] {taskinstance.py:1383} INFO - Executing <Task(PythonOperator): print_kwargs> on 2022-12-10 11:23:00+00:00
[2022-12-10, 20:24:02 KST] {standard_task_runner.py:54} INFO - Started process 69 to run task
[2022-12-10, 20:24:02 KST] {standard_task_runner.py:82} INFO - Running: ['***', 'tasks', 'run', '4_python_operator_context', 'print_kwargs', 'scheduled__2022-12-10T11:23:00+00:00', '--job-id', '50', '--raw', '--subdir', 'DAGS_FOLDER/4_python_operator_context.py', '--cfg-path', '/tmp/tmp6pkko3va']
[2022-12-10, 20:24:02 KST] {standard_task_runner.py:83} INFO - Job 50: Subtask print_kwargs
[2022-12-10, 20:24:02 KST] {dagbag.py:525} INFO - Filling up the DagBag from /opt/***/dags/4_python_operator_context.py
[2022-12-10, 20:24:02 KST] {task_command.py:384} INFO - Running <TaskInstance: 4_python_operator_context.print_kwargs scheduled__2022-12-10T11:23:00+00:00 [running]> on host ***-worker
[2022-12-10, 20:24:02 KST] {taskinstance.py:1590} INFO - Exporting the following env vars:
AIRFLOW_CTX_DAG_OWNER=ParkGyeongTae
AIRFLOW_CTX_DAG_ID=4_python_operator_context
AIRFLOW_CTX_TASK_ID=print_kwargs
AIRFLOW_CTX_EXECUTION_DATE=2022-12-10T11:23:00+00:00
AIRFLOW_CTX_TRY_NUMBER=1
AIRFLOW_CTX_DAG_RUN_ID=scheduled__2022-12-10T11:23:00+00:00
[2022-12-10, 20:24:02 KST] {logging_mixin.py:117} INFO - <TaskInstance: 4_python_operator_context.print_kwargs scheduled__2022-12-10T11:23:00+00:00 [running]>
[2022-12-10, 20:24:02 KST] {python.py:177} INFO - Done. Returned value was: None
[2022-12-10, 20:24:02 KST] {taskinstance.py:1401} INFO - Marking task as SUCCESS. dag_id=4_python_operator_context, task_id=print_kwargs, execution_date=20221210T112300, start_date=20221210T112402, end_date=20221210T112402
[2022-12-10, 20:24:02 KST] {local_task_job.py:164} INFO - Task exited with return code 0
[2022-12-10, 20:24:02 KST] {local_task_job.py:273} INFO - 0 downstream tasks scheduled from follow-on schedule check