Integrations | Astronomer Documentation

Amazon Redshift

Orchestrate Redshift queries from your Airflow DAGs.

Amazon SageMaker

Follow a step-by-step tutorial for using Airflow to orchestrate the training and testing of a SageMaker model.

Apache Kafka/Confluent

How to produce to and consume from Kafka topics using the Kafka Airflow provider

Azure Container Instances

Learn how to orchestrate containers with Azure Container Instances from your Airflow DAGs.

Azure Data Explorer

Learn how to orchestrate Azure Data Explorer queries with your Apache Airflow DAGs.

Azure Data Factory

Learn how to orchestrate remote jobs in Azure Data Factory with your Apache Airflow DAGs.

Databricks

Orchestrate Databricks jobs with your Airflow DAGs.

dbt Cloud

dbt Cloud is a managed service that provides a hosted architecture to run dbt, a tool that helps you build interdependent SQL models for in-warehouse data transformation.

dbt Core

dbt Core is an open-source library for analytics engineering that helps users build interdependent SQL models for in-warehouse data transformation, using ephemeral compute of data warehouses.

DuckDB is an open-source in-process SQL OLAP database management system. It allows you to run complex queries on relational datasets using either local, file-based DuckDB instances, or the cloud service MotherDuck. The ability to create a local DuckDB instance is useful for testing complex Airflow pipelines without the need to connect to a remote database.