Analyze consumption

After creating partitions, use the provided license consumption tools to analyze consumption across partitions to understand what’s driving growth:

• The Consumption page.
• The Logging License Consumption dashboard.

Both tools display persisted log data consumption against license capacity. Use this information to analyze consumption across partitions to detect unwanted spikes and understand what’s driving growth.

These tools monitor log data consumption against your contract, including the consumption by volume over time and the consumption of each partition and any defined budgets.

If you have already configured budgets, use these tools to review budget thresholds, which help detect growth patterns in partitions. This information can help to manage both anomalous spikes in data and slow data growth over time.

Although the Consumption page and the Logging License Consumption dashboard present similar information, Chronosphere recommends using the Consumption page. In addition to consumption data, this page includes panels with alerting details and statuses for individual budgets, provides a consolidated view of consumption statistics, and displays a comprehensive list of child partitions and their growth trends.

Analyze with the Consumption page

If this page isn’t available in your tenant, use the Logging License Consumption dashboard.

To analyze log data consumption in the Consumption page, in the navigation menu select Control > Consumption.

In the Consumption page, use the provided panels to help analyze consumption:

• Use the Global Partition panel group to view the status of your budget, which can be Ok, Warning, or Dropping.

• Review the defined Budgets for any alerts to determine which thresholds are being exceeded.

• In the Consumption panel, use the Time window menu to review cumulative consumption trends across various time windows and partitions to understand what’s driving growth.

  If you defined thresholds, a dotted line displays on the graph to indicate the threshold value. Use this menu to view total consumption for each partition for the selected time period:

  • The Per second period helps detect data spikes in real time.
  • The Daily, Weekly, and Monthly periods help identify gradual usage growth or sustained overconsumption patterns in cumulative log volumes.
  • The Rolling periods help identify recurring anomalies in volume over rolling time windows, such as one- or three-hour periods.

• In the Consumption panel, use the Group by menu to select Consumption by partition to view total consumption for each partition for the selected time period. This view helps to understand which partitions are consuming the most of your budget

• Use the Budgets panel to review and investigate any budgets that are alerting or dropping data.

  The budget for the global partition might exceed its threshold, while budgets for all child partitions are within their defined thresholds. For the global partition budget to more accurately reflect growth trends, set thresholds on budgets for individual partitions.

• Click the links in the Child Partitions section to select individual child partitions and display their consumption information. Use this view to investigate partitions that display a warning or dropping status.

Analyze with the Logging License Dashboard

To analyze log data consumption in the Logging License Consumption dashboard:

1. In the navigation menu select Dashboards.

2. In the search bar, enter Logging License Consumption.

3. Click the name of the dashboard to open it.

4. Use the Instant Rate Threshold and Volume Threshold panel groups to review cumulative consumption trends across various time windows and partitions to understand what’s driving growth:

   • The rolling period panels help identify recurring anomalies in volume over rolling time windows, such as one- or three-hour periods.
   • The instant rate threshold panels help detect data spikes in real time.
   • The fixed period panels identify gradual usage growth or sustained overconsumption patterns in cumulative log volumes across daily, weekly, or monthly windows.

5. In the dashboard, use the Partition menu to select the partition you want to view consumption data for.

6. To investigate the source of consumption, in the Explore panel group, click the Logs Explorer link.

   Logs Explorer opens with a predefined query from the dashboard.

7. In Logs Explorer, use the provided filters to identify patterns and trends in sources of consumption.

Next steps

Based on your findings, you might want to refine your partitions with more granular dimensions, such as adding more child partitions to apply greater levels of control.

After analyzing your consumption and refining partitions, create budgets to apply optional shaping policies that you can attach to a partition to provide guardrails to avoid usage overages and overspending.