Skip to main content

Storage metrics

info

This information applies to Lumi Enterprise.

Lumi Enterprise provides storage metrics to help you optimize compute and storage resources. Use these metrics to determine how to size your tiers for optimal cost and performance.

This topic describes the available storage metrics for Lumi Enterprise. For assistance on how to adjust your Lumi Enterprise configuration in response to these metrics, contact Imply support.

View storage metrics​

To view storage metrics:

  1. Open the Lumi Management Console.
  2. Click Usage in the left sidebar.
  3. Go to the Storage tab.

Average total data​

Average amount of data stored in Lumi Enterprise over the selected time period. Use this metric to track your typical storage footprint over time.

Average hot tier utilization​

Percentage of allocated hot tier storage currently in use. This metric shows how you are using your hot tier for frequently accessed data.

  • Below 50%: Your hot tier may be underutilized. Consider increasing the hot data retention period to keep data in hot storage longer.
  • Above 80%: Your hot tier is near capacity. Consider one of the following:
    • Decrease the hot data retention period to remove data from hot storage sooner.
    • Increase your hot tier infrastructure to hold more data in hot storage.

If your hot tier utilization exceeds 100%, hot storage fills to capacity and can't accept additional data. The impact depends on whether you have a virtual tier configured:

  • Without a virtual tier, some hot data becomes unavailable for querying. Which specific data becomes unavailable is arbitrary. Lumi continues to ingest new data, but it remains unavailable until you either add more hot tier capacity or configure a virtual tier.
  • With a virtual tier, you can still query excess data through the virtual tier but with reduced performance.

Average virtual coverage​

Percentage of allocated virtual tier capacity relative to total data in your Lumi account. Use this metric to determine what percentage of your total data can fit in virtual storage at once.

  • Below 100%: Your virtual tier capacity is below your total volume of data. This is normal and expected because Lumi doesn't load your total data volume onto the virtual tier, only a per-query subset.
  • Above 100%: Your virtual tier may be oversized. Consider reducing virtual tier capacity.

Virtual tier churn ratio​

Percentage of data evicted from virtual storage relative to the data scanned by queries.

  • Below 50%: Your virtual tier is properly sized. Consider gradually reducing your virtual tier infrastructure to find the right balance between cost and performance. Note that 0% churn doesn't signify that there is an issue—it could mean that virtual storage already contains the data that satisfies the query.
  • Above 50%: Your virtual tier may be undersized. Consider increasing virtual tier infrastructure or expanding the hot data retention period.

When virtual storage reaches capacity, Lumi evicts less recently accessed data from the caching layer to make room for newly requested data. Evicted data remains in object storage but is unloaded from the cache. When you query that data again, Lumi retrieves it from object storage and reloads it into virtual storage.

Learn more​

For more information, see the following topics: