2025年9月5日大约 2 分钟
group::Log message source details: sources=["Could not read served logs: Invalid URL 'http://:8793/log/dag_id=sjzx_xmjcjl/run_id=scheduled__2025-07-23T00:40:00+00:00/task_id=branch_func/attempt=1.log': No host supplied
- journalctl -u airflow.service --since "2025-07-24, 16:15:00" --until "2025-07-24, 16:20:00"
未解决 3.0.2 版本有问题
查看报错日志
出现 Airflow scheduler / local_executor 同时跑了很多任务,打开了大量日志文件、数据库连接、网络 socket,但没及时关闭
7月 23 09:00:00 bd.shingi.cn airflow[3882461]: scheduler | [2025-07-23T09:00:00.162+0800] {local_executor.py:96} ERROR - uhoh
7月 23 09:00:00 bd.shingi.cn airflow[3882461]: scheduler | Traceback (most recent call last):
7月 23 09:00:00 bd.shingi.cn airflow[3882461]: scheduler | File "/root/miniconda3/lib/python3.12/site-packages/airflow/executors/local_executor.py", line 92, in _run_worker
7月 23 09:00:00 bd.shingi.cn airflow[3882461]: scheduler | _execute_work(log, workload)
7月 23 09:00:00 bd.shingi.cn airflow[3882461]: scheduler | File "/root/miniconda3/lib/python3.12/site-packages/airflow/executors/local_executor.py", line 120, in _execute_work
7月 23 09:00:00 bd.shingi.cn airflow[3882461]: scheduler | supervise(
7月 23 09:00:00 bd.shingi.cn airflow[3882461]: scheduler | File "/root/miniconda3/lib/python3.12/site-packages/airflow/sdk/execution_time/supervisor.py", line 1509, in supervise
7月 23 09:00:00 bd.shingi.cn airflow[3882461]: scheduler | client = Client(base_url=server or "", limits=limits, dry_run=dry_run, token=token)
7月 23 09:00:00 bd.shingi.cn airflow[3882461]: scheduler | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
7月 23 09:00:00 bd.shingi.cn airflow[3882461]: scheduler | File "/root/miniconda3/lib/python3.12/site-packages/airflow/sdk/api/client.py", line 679, in __init__
7月 23 09:00:00 bd.shingi.cn airflow[3882461]: scheduler | File "/root/miniconda3/lib/python3.12/site-packages/httpx/_client.py", line 688, in __init__
7月 23 09:00:00 bd.shingi.cn airflow[3882461]: scheduler | File "/root/miniconda3/lib/python3.12/site-packages/httpx/_client.py", line 731, in _init_transport
7月 23 09:00:00 bd.shingi.cn airflow[3882461]: scheduler | File "/root/miniconda3/lib/python3.12/site-packages/httpx/_transports/default.py", line 153, in __init__
7月 23 09:00:00 bd.shingi.cn airflow[3882461]: scheduler | File "/root/miniconda3/lib/python3.12/site-packages/httpx/_config.py", line 40, in create_ssl_context
7月 23 09:00:00 bd.shingi.cn airflow[3882461]: scheduler | File "/root/miniconda3/lib/python3.12/ssl.py", line 707, in create_default_context
7月 23 09:00:00 bd.shingi.cn airflow[3882461]: scheduler | OSError: [Errno 24] Too many open files
7月 23 09:00:00 bd.shingi.cn airflow[3882461]: scheduler | [2025-07-23T09:00:00.162+0800] {local_executor.py:96} ERROR - uhoh
7月 23 09:00:00 bd.shingi.cn airflow[3882461]: scheduler | Traceback (most recent call last):
7月 23 09:00:00 bd.shingi.cn airflow[3882461]: scheduler | File "/root/miniconda3/lib/python3.12/site-packages/airflow/executors/local_executor.py", line 92, in _run_worker
7月 23 09:00:00 bd.shingi.cn airflow[3882461]: scheduler | _execute_work(log, workload)
7月 23 09:00:00 bd.shingi.cn airflow[3882461]: scheduler | File "/root/miniconda3/lib/python3.12/site-packages/airflow/executors/local_executor.py", line 120, in _execute_work
7月 23 09:00:00 bd.shingi.cn airflow[3882461]: scheduler | supervise(
7月 23 09:00:00 bd.shingi.cn airflow[3882461]: scheduler | File "/root/miniconda3/lib/python3.12/site-packages/airflow/sdk/execution_time/supervisor.py", line 1509, in supervise
7月 23 09:00:00 bd.shingi.cn airflow[3882461]: scheduler | client = Client(base_url=server or "", limits=limits, dry_run=dry_run, token=token)
7月 23 09:00:00 bd.shingi.cn airflow[3882461]: scheduler | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
7月 23 09:00:00 bd.shingi.cn airflow[3882461]: scheduler | File "/root/miniconda3/lib/python3.12/site-packages/airflow/sdk/api/client.py", line 679, in __init__
7月 23 09:00:00 bd.shingi.cn airflow[3882461]: scheduler | File "/root/miniconda3/lib/python3.12/site-packages/httpx/_client.py", line 688, in __init__
7月 23 09:00:00 bd.shingi.cn airflow[3882461]: scheduler | File "/root/miniconda3/lib/python3.12/site-packages/httpx/_client.py", line 731, in _init_transport
7月 23 09:00:00 bd.shingi.cn airflow[3882461]: scheduler | File "/root/miniconda3/lib/python3.12/site-packages/httpx/_transports/default.py", line 153, in __init__
7月 23 09:00:00 bd.shingi.cn airflow[3882461]: scheduler | File "/root/miniconda3/lib/python3.12/site-packages/httpx/_config.py", line 40, in create_ssl_context
7月 23 09:00:00 bd.shingi.cn airflow[3882461]: scheduler | File "/root/miniconda3/lib/python3.12/ssl.py", line 707, in create_default_context
7月 23 09:00:00 bd.shingi.cn airflow[3882461]: scheduler | OSError: [Errno 24] Too many open files
ulimit -n
971 ps aux | grep airflow
972 ulimit -n
973 lsof -p 631405 | wc -l