All Airflow logs from your Astronomer logs will flow to Elasticsearch and can be visualized on Kibana. Like Grafana, this view is only available to system admins.
To setup logging in Kibana, navigate to
Management and create an index pattern for
Elasticsearch uses index patterns to organize how you explore data. Setting
fluentd.* as the index means that Kibana will display all logs from all deployments (Astronomer uses
fluentd to ship logs from pods to ElasticSearch).
@timestamp as the
Time Filter on the next screen.
Once the index pattern has been confirmed, the
Discover tab will show logs as they come in.
From this view, you can add filters to see logs as they come in from all Airflow deployments. You can also add fields to filter by:
Custom dashboards can be created in the