When working with Airflow, understanding the underlying infrastructure components and how they function can help you develop and run your DAGs, troubleshoot issues, and successfully run Airflow.
An introduction to the Apache Airflow Executors: Celery, Local, and Kubernetes.
Learn about everything you need to use the Apache Airflow metadata database.
One of the biggest strengths of Apache Airflow is its ability to scale to meet the changing demands of your organization. To make the most of Airflow, there are a few key settings that you should consider modifying as you scale up your data pipelines.