Learn how to use the BashOperator to run bash commands and bash scripts. Review examples of how to run scripts in other languages than Python.
Learn how to set up, manage, and maintain different types of connections in Apache Airflow. Use example connection configurations as the basis for your own connections.
Learn how to write DAGs and get tips on how to define an Airflow DAG in Python. Learn all about DAG parameters and their settings.
Learn about hooks and how they should be used in Apache Airflow. See an example of implementing two different hooks in a DAG.
Manage Airflow code
Learn best practices for Airflow project organization, such as when to separate out DAGs into multiple projects and how to manage code used across different projects.
Learn about OpenLineage concepts and benefits of integrating with Airflow.
Learn the basics of operators, which are the building blocks of Airflow DAGs. See an example of how to implement several common operators available in Apache Airflow.
Learn the best practices for executing SQL from your DAG. Get to know Airflow’s SQL-related operators and see how to use Airflow for common SQL use cases.
Get to know Airflow scheduling concepts and different ways to schedule a DAG. Learn how timetables in Airflow 2.2 bring new flexibility to DAG scheduling.
Get an overview of Airflow sensors and see the new sensor-related features included in Airflow 2. Learn best practices for implementing sensors in production.
Learn how to manage dependencies between tasks and TaskGroups in Apache Airflow, including how to set dynamic dependencies.
The Airflow UI
Explore the Airflow UI, which helps you monitor and troubleshoot your data pipelines. Learn about some of its key features and visualizations.
Create and use Airflow variables.