Monitoring

There are two main ways of understanding and monitoring an Imply cluster: analyzing performance telemetry with Clarity and monitoring high-level status via our APIs.

Clarity

Imply Cloud includes Clarity, a performance analysis service that gives you visibility into the performance of your cluster, and can help you pinpoint and solve performance issues. Access it by clicking the "Clarity" item in the Imply Manager.

clarity home

Once inside, you have access to the following views:

Status APIs

Druid has a number of status APIs that provide visibility into the system. The following APIs are especially useful for monitoring.

  1. Unavailable segments: On the Coordinator, check /druid/coordinator/v1/loadstatus?simple and verify each datasource registers "0". This is the number of unavailable segments. It may briefly be non-zero when new segments are added. But if this value is high for a prolonged period of time, it indicates a problem with segment availability in your cluster. In this case, check your data nodes to confirm they are healthy, have spare disk space to load data, and have access to your S3 bucket where data is stored.

  2. Data freshness: Run a "dataSourceMetadata" query to get the "maxIngestedEventTime" and verify that it's recent enough for your needs. For example, alert if it's more than a few minutes old. This is is an inexpensive Druid query, since it only hits the most recent segments and it only looks at the last row of data. In addition to verifying ingestion time, this also verifies that Druid is responsive to queries. If this value is staler than you expect, it can indicate that real-time data is not being loaded properly. In this case, use the Imply Manager to verify that your data ingestion is healthy, that there have not been any errors loading data, and that you have enough capacity to load the amount of data that you're trying to load.

Overview

Deploy

Manage Data

Query Data

Visualize

Configure

Misc