Skip to main content

View metrics across your Organization with Astro reporting dashboards

warning

This feature is in Private Preview. Please reach out to your customer success manager to enable this feature.

Astro provides dashboards that share important metrics about your Organization's use of Astro, which you can use to manage Deployments and resources. These dashboards include:

  • Organization Explorer
  • Deployment Detail
  • DAG Run Details
  • Cost Breakdown (Hosted only)
  • Operator Use

Dashboards help you quickly identify opportunities to optimize how your team uses Airflow at different organizational levels, such as across your Organization, within Workspaces, in specific Deployments, and tasks within DAGs. For example, you can use the Deployment Detail dashboard to identify unexpected DAG behaviors, without requiring you to examine the DAGs results in the Airflow UI. Instead, you can quickly switch between DAGs in a dashboard to identify trends like unusually high compute use, and then check the Cost Breakdown dashboard to identify any associated costs incurred by that behavior.

To view Astro reporting dashboards, click your Workspace name in the upper left corner of the Cloud UI, click Organization Settings, and then click Dashboards. You can also access this page directly at https://cloud.astronomer.io/dashboards.

Use the tabs at the bottom of the Cloud UI to switch between dashboards. Each dashboard shows the last time that it was updated in the Data available through section.

info

Only users with Organization Billing Admin user permissions can access reporting dashboards.

Organization Explorer

The Organization Explorer dashboard provides at-a-glance summaries about activity across your Organization's Deployments. You can also filter to view summaries for specific Workspaces or Deployments.

This dashboard allows you to compare the activity and performances of Deployments to one another. You can identify Deployments, DAGs, or tasks that have had recent behavior changes or are performing in an unexpected way. For example, you can filter the data shown by time period, Workspace name, or Deployment name, to view data such as the number of successful or failed tasks within Workspaces or Deployments. Hovering your cursor over any of the charts brings up a detailed view of the data, indexed by date.

By examining your data at the Organization level, you can identify Deployments with large numbers of failing tasks by looking at the graphs or charts for outliers. Then, you can filter by time period to see if there have been similar events in the past and when.

The main section of the Organization Overview dashboard, showing Deployments and task counts over time as a bar chart

Deployment Detail

The Deployment Detail dashboard shows a table of all Deployments in your Organization, indexed by Workspace name. For each Deployment, the dashboard shows your Deployment configurations as well as use metrics like task run counts, DAG run counts, and operator counts.

Use this dashboard to check that your Deployment has the appropriate resources based on the number of DAGs it runs. You can also use this dashboard to check whether a Deployment's Astro Runtime version is currently supported.

View data about Deployment health and DAG success.

DAG run detail

This dashboard shows the average and median ending time of a specific DAG run, aggregated by a chosen time period, month, week or day. You can use this view to visually inspect when particular DAGs complete their first run, which allows you to see trends over time. Check this dashboard when you make changes to Deployment resources or DAG code to track their effects on performance over time.

You can also use this dashboard to simulate a service level agreement (SLA) for when a DAG should complete, and then compare how frequently your DAG runs complete within the SLA.

note

The report only includes the first successful occurrence of each DAG Run ID. Manual DAG runs and sub-daily DAGs are excluded.

Examine the time of day when your DAG runs typically complete compared to an example SLA time of 1:30AM and the duration of your DAG runs in minutes.

Create an SLA simulation

Use this view to check how frequently your Organization meets your SLA obligations, or to identify if specific SLAs are breached.

To simulate an SLA, you must first define an SLA and then apply it to specific DAGs.

  1. Select the Time Period over which you want to look at the DAG run data.
  2. Choose the DAG ID that you want to check DAG run completion times for. If you have a large number of DAGs in your Organization, you can first filter by Workspace Name and Deployment Name before choosing your DAG ID.
  3. In the Compute section, choose the method that the dashboard uses to summarize your DAG run end times. For example, if you select Median, the dashboard shows the medium DAG run end time for each time interval.
  4. In the Display by section, choose whether you want to aggregate the data by Month, Week, or Day. The default is Week.
  5. Specify the SLA Time (UTC) to compare with your DAG run end times.

The report generates two graphs. The first shows your summarized DAG Run End Times compared to the SLA time you defined. The second chart shows a summary of the same DAG runs, but charts their run time using duration instead of end time.

Cost Breakdown

This feature is available only on Astro Hosted.

In the Cost Breakdown dashboard, you can find detailed information about how much you spend on Astro over time for each of your Workspaces and Deployments. Use this data alongside your other dashboards to identify the biggest opportunities for cost reduction in your Organization.

View the cost of your different Astro resources.

Operator use

The Operator Use dashboard shows how your Deployments and Workspaces use Operators, as well as how often tasks succeed and fail when using specific operators. Use this data to identify types of operators that could be replaced with more efficient alternatives, or to find operators that fail more than expected. This dashboard provides data to answer the questions, What are the top operators used across my organization? and Which workspace is using the selected operators the most?.

Was this page helpful?

Sign up for Developer Updates

Get a summary of new Astro features once a month.

You can unsubscribe at any time.
By proceeding you agree to our Privacy Policy, our Website Terms and to receive emails from Astronomer.