Amazon Redshift
Orchestrate Redshift queries from your Airflow DAGs.
Amazon SageMaker
Follow a step-by-step tutorial for using Airflow to orchestrate the training and testing of a SageMaker model.
Apache Kafka/Confluent
How to produce to and consume from Kafka topics using the Airflow Kafka provider
Azure Container Instances
Learn how to orchestrate containers with Azure Container Instances from your Airflow DAGs.
Azure Data Explorer
Learn how to orchestrate Azure Data Explorer queries with your Apache Airflow DAGs.
Azure Data Factory
Learn how to orchestrate remote jobs in Azure Data Factory with your Apache Airflow DAGs.
Databricks
Orchestrate Databricks jobs with your Airflow DAGs.
dbt
dbt is an open-source library for analytics engineering that helps users build interdependent SQL models for in-warehouse data transformation. As ephemeral compute becomes more readily available in data warehouses thanks to tools like Snowflake, dbt has become a key component of the modern data engineering workflow. Now, data engineers can use dbt to write, organize, and run in-warehouse transformations of raw data.
Fivetran
Learn how to orchestrate Fivetran syncs using Airflow
Great Expectations
Orchestrate Great Expectations data quality checks with your Airflow DAGs.
Jupyter notebook
Run a parameterized Jupyter notebook using Airflow and the Astro CLI.
Marquez
Use OpenLineage and Marquez to get lineage metadata locally from your Airflow DAGs.
MongoDB
Learn how to load data into MongoDB with your Apache Airflow DAGs.
Snowflake
Get enhanced observability and compute savings while orchestrating Snowflake jobs from your Airflow DAGs.
Soda Core
Learn how to orchestrate Soda Core data quality checks with your Airflow DAGs.
Talend
Orchestrate remote jobs in Talend with your Apache Airflow DAGs.