All Airflow logs from your Astronomer logs will flow to Elasticsearch and can be visualized on Kibana. Like Grafana, this view is only available to system admins.
Open a browser and go to
Click Menu in the upper left, click Stack Management, and then click Index Patterns.
In the Name field enter
fluentd.*and then click Create index pattern.
Elasticsearch uses index patterns to organize how you explore data. Setting
fluentd.*as the index means that Kibana will display all logs from all deployments (Astronomer uses
fluentdto ship logs from pods to ElasticSearch).
After the index pattern is confirmed, the
Discover tab displays logs as they become available.
From this view, you can add filters to see logs as they come in from all Airflow deployments. You can also add field filters.
Custom dashboards can be created in the