Orchestrate Redshift queries from your Airflow DAGs.
Follow a step-by-step tutorial for using Airflow to orchestrate the training and testing of a SageMaker model.
How to produce to and consume from Kafka topics using the Airflow Kafka provider
Azure Container Instances
Learn how to orchestrate containers with Azure Container Instances from your Airflow DAGs.
Azure Data Explorer
Learn how to orchestrate Azure Data Explorer queries with your Apache Airflow DAGs.
Azure Data Factory
Learn how to orchestrate remote jobs in Azure Data Factory with your Apache Airflow DAGs.
Orchestrate Databricks jobs with your Airflow DAGs.
dbt is an open-source library for analytics engineering that helps users build interdependent SQL models for in-warehouse data transformation. As ephemeral compute becomes more readily available in data warehouses thanks to tools like Snowflake, dbt has become a key component of the modern data engineering workflow. Now, data engineers can use dbt to write, organize, and run in-warehouse transformations of raw data.
Learn how to orchestrate Fivetran syncs using Airflow
Orchestrate Great Expectations data quality checks with your Airflow DAGs.
Run a parameterized Jupyter notebook using Airflow and the Astro CLI.
Use OpenLineage and Marquez to get lineage metadata locally from your Airflow DAGs.
Learn how to load data into MongoDB with your Apache Airflow DAGs.
Get enhanced observability and compute savings while orchestrating Snowflake jobs from your Airflow DAGs.
Learn how to orchestrate Soda Core data quality checks with your Airflow DAGs.
Orchestrate remote jobs in Talend with your Apache Airflow DAGs.