Core components
When working with Airflow, understanding the underlying infrastructure components and how they function can help you develop and run your DAGs, troubleshoot issues, and successfully run Airflow.
Executor
An introduction to the Apache Airflow Executors: Celery, Local, and Kubernetes.
Metadata database
Learn about everything you need to use the Apache Airflow metadata database.
Scaling Airflow
One of the biggest strengths of Apache Airflow is its ability to scale to meet the changing demands of your organization. To make the most of Airflow, there are a few key settings that you should consider modifying as you scale up your data pipelines.