airflow: A platform to programmatically author, schedule, and monitor workflows.
What problem it solves Teams need a maintainable way to define workflows as code, schedule dependent tasks, and monitor running pipelines. Airflow addresses this with code-defined Dags, task execution across workers, command-line tools, and a user interface for visualizing progress and troubleshooting issues. Key features Code-defined workflows — Define pipelines as Python code with dynamic Dag ge…
github.comhttps://github.com/apache/airflow