Apache Airflow:无法启动调度程序

问题描述 投票:0回答:1

我不熟悉Python,并通过遵循此tutorial来尝试在Mac中安装气流”>

虽然这两个命令正常工作:

$ airflow initdb

$ airflow网络服务器-p 8080

调度程序命令(气流调度程序)抛出以下错误:

[[2020-02-18 13:18:09,012] {scheduler_job.py:1382}错误-执行execute_helper追溯(最近一次调用最近)时发生异常:

文件“ /Users/mac/Workspace/airflow/airflow_venv/lib/python3.8/site-packages/airflow/jobs/scheduler_job.py”,第1380行,在_execute中self._execute_helper()

文件“ /Users/mac/Workspace/airflow/airflow_venv/lib/python3.8/site-packages/airflow/jobs/scheduler_job.py”,_execute_helper中的第1413行self.processor_agent.start()

文件“ /Users/mac/Workspace/airflow/airflow_venv/lib/python3.8/site-packages/airflow/utils/dag_processing.py”,554行,开始self._process.start()

文件“ /Library/Frameworks/Python.framework/Versions/3.8/lib/python3.8/multiprocessing/process.py”,第121行,开始时self._popen = self._Popen(self)

文件“ /Library/Frameworks/Python.framework/Versions/3.8/lib/python3.8/multiprocessing/context.py”,_Popen中的第224行返回_default_context.get_context()。Process._Popen(process_obj)

文件“ /Library/Frameworks/Python.framework/Versions/3.8/lib/python3.8/multiprocessing/context.py”,_Popen中的第283行返回Popen(process_obj)

文件“ /Library/Frameworks/Python.framework/Versions/3.8/lib/python3.8/multiprocessing/popen_spawn_posix.py”,init

中的第32行super()。init(process_obj)

文件“ /Library/Frameworks/Python.framework/Versions/3.8/lib/python3.8/multiprocessing/popen_fork.py”,第19行,在[[init

中self._launch(process_obj)文件“ /Library/Frameworks/Python.framework/Versions/3.8/lib/python3.8/multiprocessing/popen_spawn_posix.py”,_launch中的第47行reduction.dump(process_obj,fp)

文件“ /Library/Frameworks/Python.framework/Versions/3.8/lib/python3.8/multiprocessing/reduction.py”,60行,转储中ForkingPickler(文件,协议).dump(obj)

AttributeError:无法腌制本地对象'SchedulerJob._execute..processor_factory'

[2020-02-18 13:18:09,035] {helpers.py:322}信息-发送Signals.SIGTERM到GPID无

跟踪(最近一次通话):文件“ / Users / mac / Workspace / airflow / airflow_venv / bin / airflow”,第37行,在args.func(args)文件“ /Users/mac/Workspace/airflow/airflow_venv/lib/python3.8/site-packages/airflow/utils/cli.py”,包装中的第75行返回f(* args,** kwargs)文件“ /Users/mac/Workspace/airflow/airflow_venv/lib/python3.8/site-packages/airflow/bin/cli.py”,1040行,在调度程序中job.run()文件“ /Users/mac/Workspace/airflow/airflow_venv/lib/python3.8/site-packages/airflow/jobs/base_job.py”,221行self._execute()文件“ /Users/mac/Workspace/airflow/airflow_venv/lib/python3.8/site-packages/airflow/jobs/scheduler_job.py”,_execute中的第1384行self.processor_agent.end()文件“ /Users/mac/Workspace/airflow/airflow_venv/lib/python3.8/site-packages/airflow/utils/dag_processing.py”,707行,最后reap_process_group(self._process.pid,log = self.log)文件“ /Users/mac/Workspace/airflow/airflow_venv/lib/python3.8/site-packages/airflow/utils/helpers.py”,reap_process_group中的第324行signal_procs(sig)文件“ /Users/mac/Workspace/airflow/airflow_venv/lib/python3.8/site-packages/airflow/utils/helpers.py”,第293行,在signal_procs中os.killpg(pgid,sig)

TypeError:需要一个整数(got类型NoneType)

有人遇到过类似的问题吗?

我是Python的新手,并通过遵循本教程尝试在Mac中安装气流,这两个命令正常工作:$ airflow initdb $ airflow webserver -p 8080 Scheduler命令(...

python-3.x pip airflow scheduler
1个回答
0
投票
也许存在一些兼容性问题?
© www.soinside.com 2019 - 2024. All rights reserved.