Azure Data Factory
Learn how to orchestrate remote jobs in Azure Data Factory with your Apache Airflow DAGs.
Azure Data Explorer
Learn how to orchestrate Azure Data Explorer queries with your Apache Airflow DAGs.
Azure Container Instances
Learn how to orchestrate containers with Azure Container Instances from your Airflow DAGs.
Use OpenLineage and Marquez to get lineage data from your Airflow DAGs.
dbt is an open-source library for analytics engineering that helps users build interdependent SQL models for in-warehouse data transformation. As ephemeral compute becomes more readily available in data warehouses thanks to tools like Snowflake, dbt has become a key component of the modern data engineering workflow. Now, data engineers can use dbt to write, organize, and run in-warehouse transformations of raw data.
Orchestrate Databricks jobs with your Airflow DAGs.
Follow a step-by-step tutorial for using Airflow to orchestrate the training and testing of a SageMaker model.
Get enhanced observability and compute savings while orchestrating Snowflake jobs from your Airflow DAGs.
Orchestrate Redshift queries from your Airflow DAGs.
Orchestrate Great Expectations data quality checks with your Airflow DAGs.
Orchestrate remote jobs in Talend with your Apache Airflow DAGs.
Learn how to load data into MongoDB with your Apache Airflow DAGs.
Run a parameterized Jupyter notebook using Airflow and the Astro CLI.
Learn how to orchestrate Soda Core data quality checks with your Airflow DAGs.