Start your Astro trial
Use this guide to get started with Astro, the best place to run Apache Airflow.
Start a trial
Go to Try Astro to activate your free 14-day trial. To create your Astro user account, you'll need to provide a valid email address and create a password.
Create an Organization and Workspace
After you've created your Astro user account, you'll be asked to create an Organization and your first Workspace.
An Organization is the highest management level on Astro. An Organization contains Workspaces, which are collections of Deployments, or Airflow environments, that are typically owned by a single team. You can manage user roles and permissions both at the Organization and Workspace levels.
To start your trial, Astronomer recommends using the name of your company as the name of your Organization and naming your first Workspace after your data team or initial business use case with Airflow. You can update these names in the Cloud UI after you finish activating your trial.
Create a cluster
To run Astro in your cloud, you'll need to create an Astro cluster. An Astro cluster is a set of infrastructure resources within your organization's data plane that hosts Deployments, or Airflow environments on Astro.
To create a cluster, you first need a dedicated account with your cloud provider that Astronomer can access. This account allows Astronomer to fully manage the infrastructure resources required to run Airflow at scale for your team.
After you've created your Organization and Workspace, your new Workspace homepage appears. Click Create Cluster and then complete the setup for your cloud provider.
- AWS
- GCP
- Azure
Create a dedicated AWS account for Astro. Astro uses this account to provision and manage your cluster resources. For security reasons, you cannot currently create an Astro cluster within an AWS account that has other tooling running in it.
Copy the Account ID for Step 5.
When creating your account, specify the following EC2 service quotas:
QuotaCode QuotaName Minimum Value L-1216C47A Running On-Demand Standard (A, C, D, H, I, M, R, T, Z) instances 40 L-34B43A08 All Standard (A, C, D, H, I, M, R, T, Z) Spot Instance Requests 40 These quotas ensure a smooth onboarding experience on Astro. If you need to modify or increase a specific quota, see Request a quota increasein Amazon’s documentation.
On the Astro cluster creation screen, click Launch AWS stack creation.
In AWS CloudFormation, click Create stack. A cross-account Identity and Access Management (IAM) role is created to provide Astronomer support with access to the Astro AWS account.
In the Cloud UI cluster creation screen, enter your AWS account ID in AWS Account ID.
In the Region list, select the region where your cluster will be hosted. For trials, Astronomer recommends choosing the region that's closest to you.
Optional. Click Advanced and configure a VPC subnet range for Astro to connect to your AWS account through VPC peering.
Click Create cluster.
Wait for Astronomer to finish creating the cluster. You'll receive an email notification when the process is complete.
The cluster is created with a default set of resources that are suitable for most use cases. See AWS cluster settings for a list of all default resources.
Create a dedicated Google Cloud project for Astro with billing enabled. Astro uses this account to provision and manage your cluster resources. For security reasons, the install process is not currently supported on a Google Cloud project that has other tooling running in it.
Copy the project ID for step 5.
In the Cloud UI, click Launch Google Cloud Shell on the cluster creation screen.
In your cloud shell, run
./bootstrap.sh
and follow the steps to grant Astro access to your GCP project.In the Cloud UI cluster creation screen, enter your GCP Project ID in GCP Project ID.
In the Region list, select the region where you want to host your cluster. For trials, Astronomer recommends choosing the region that's closest to you.
Optional. Click Advanced and configure VPC subnet ranges for Astro to connect to your GCP project through VPC peering.
Click Create cluster.
Wait for Astronomer to finish creating the cluster. You'll receive an email notification when the process is complete.
The cluster is created with a default set of resources that are suitable for most use cases. See GCP cluster settings for a list of all default resources.
Create a dedicated Azure subscription for Astro. Astro uses this account to provision and manage your cluster resources. The subscription must be included in an Azure management group that doesn't apply Azure policies. See What are Azure management groups.
Copy the subscription ID for step 5.
In the Azure portal for your subscription, find and copy your Azure Tenant ID for step 5.
Grant Astronomer access to your Azure subscription through either the Azure CLI or Powershell.
- Azure CLI on Bash
- PowerShell
Run the following command to log in to your Azure account:
az login
Run the following command to select your Azure subscription:
az account set -s <subscription-id>
Run the following command to add the Astronomer Service Principal to Azure AD:
az ad sp create --id a67e6057-7138-4f78-bbaf-fd9db7b8aab0
Run the following commands to get details about the Azure subscription and create a new role assignment for the Astronomer service principal:
subid=$(az account show --query id --output tsv)
az role assignment create --assignee a67e6057-7138-4f78-bbaf-fd9db7b8aab0 --role Owner --scope /subscriptions/$subidRun the following commands to register the
EncryptionAtHost
feature:az feature register --namespace "Microsoft.Compute" --name "EncryptionAtHost"
while [ $(az feature list --query "[?contains(name, 'Microsoft.Compute/EncryptionAtHost')].{State:properties.state}" -o tsv) != "Registered" ]
do
echo "Still waiting for Feature Registration (EncryptionAtHost) to complete, this can take up to 15 minutes"
sleep 60
done
echo "Registration Complete"
az provider register --namespace Microsoft.Compute
Run the following command to log in to your Azure account:
Connect-AzAccount
Run the following command to select your Azure subscription:
Set-AzContext -SubscriptionId <subscription-id>
Run the following command to create the Astronomer service principal:
$sp = New-AzADServicePrincipal -AppId a67e6057-7138-4f78-bbaf-fd9db7b8aab0
Run the following commands to get details about the Azure subscription and create a new role assignment for the Astronomer service principal:
$sp = Get-AzADServicePrincipal -ApplicationId a67e6057-7138-4f78-bbaf-fd9db7b8aab0
$subid = (Get-AzContext).Subscription.id
$ra = New-AzRoleAssignment -ObjectId $sp.id -RoleDefinitionName Owner -Scope "/subscriptions/$subid"
Run the following commands to register the
EncryptionAtHost
feature:Register-AzProviderFeature -FeatureName EncryptionAtHost -ProviderNamespace Microsoft.Compute
while ( (Get-AzProviderFeature -FeatureName EncryptionAtHost -ProviderNamespace Microsoft.Compute).RegistrationState -ne "Registered") {echo "Still waiting for Feature Registration (EncryptionAtHost) to complete, this can take up to 15 minutes"; sleep 60} echo "Registration Complete"Register-AzResourceProvider -ProviderNamespace Microsoft.compute
In the Cloud UI cluster creation screen, enter your Azure Tenant ID in the Azure Tenant ID field.
Enter your Azure Subscription ID in Azure Subscription ID field.
In the Region list, select the region where you want to host your cluster. For trials, Astronomer recommends choosing the region that's closest to you.
Optional. Click Advanced and configure a VNet subnet range for Astro to connect to your Azure subscription through VPC peering.
Click Create cluster.
Wait for Astronomer to finish creating the cluster. You'll receive an email notification when the process is complete.
The cluster is created with a default set of resources that are suitable for most use cases. See Azure cluster settings for a list of all default resources.
Next steps
After Astronomer creates your cluster, you're ready to start deploying and running DAGs on Astro. Complete the following tasks to get your first DAG up and running on Astro:
- Install the Astro CLI. The Astro CLI is an open source command line interface for developing Airflow DAGs on your local machine and deploying them to Astro
- Create an Astro project. An Astro project contains the set of files that you need to run Airflow on Astro. It includes dedicated folders for your Python packages and DAGs.
- Create a Deployment. A Deployment is an Astro Runtime environment that is powered by the core components of Apache Airflow and where you can run DAGs.
- Deploy your Astro project. Use the Astro CLI to push code to a Deployment on Astro in just a few minutes.
After your trial
After your 14-day trial ends, you can no longer access your Deployments and Workspaces from the Cloud UI. You can still access your user account page and Astronomer support forms. Any DAGs you deployed will continue to run for an additional 7-day grace period.
After the 7-day grace period, your cluster and all Deployments within it are automatically deleted. Any code that you deployed to Astro will be lost. If you need additional time to evaluate Astro, or you need to copy your configuration for future use, you can:
- Schedule a call with your point of contact from Astronomer.
- Go to the Cloud UI and schedule a 15 minute call with an Astronomer engineer. This option is available only after your 14-day trial ends.
- Contact Astronomer support.