HDDS-15416. Ozone status grafana dashboard

[yandrey321]

What changes were proposed in this pull request?

HDDS-15416 Ozone status grafana dashboard

Sections:

Storage — total, used, and available capacity across DataNodes, percent used, and utilization over time.
DataNodes — registered nodes, decommissioning, and failed (dead), with trends.
Disks — volume count by healthy vs failed, with trends.
OM namespace — keys, volumes, and buckets over time.
S3 Gateway — number of gateway instances, with trend.
Containers — counts by lifecycle state (snapshot and over time).
Deletion backlog — pending physical deletes on DataNodes, OM purge queue, and containers being deleted, with trends.

What is the link to the Apache JIRA

https://issues.apache.org/jira/browse/HDDS-15416

How was this patch tested?

Imported to Grafana connected to the Ozone cluster.

[jojochuang]

We need a screenshot of the dashboard

[yandrey321]

[Copilot]

Copilot wasn't able to review any files in this pull request.

---

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

[jojochuang]

After comparing it against existing dashboards in dashboards, this new dashboard is a direct modern replacement/duplicate of:

• Ozone - Overall Metrics.json

Here is a detailed comparison of the overlaps:

1. Duplication & Improvements Over Ozone - Overall Metrics

The new Ozone - Status overview dashboard monitors the exact same categories of high-level cluster metrics as Ozone - Overall Metrics , but with
updated and more precise queries:

• Disk/Storage Capacity:
• Old: Used/Capacity via SCM scm_node_manager_disk_used / scm_node_manager_disk_capacity .
• New: Uses volume-level metrics ( volume_info_metrics_*capacity/used ) for more accuracy with a fallback to the SCM disk metrics.
• DataNode Counts:
• Old: Count of nodes in service ( in_service[[node_type]]nodes ).
• New: Plots total, decommissioning, and dead nodes.
• Ozone Manager Namespace:
• Old: Counts for directories, files, volumes, and buckets.
• New: Plots Keys (with fallback to RocksDB estimates rocksdb_om_db_keytable_estimate_num_keys to reduce query performance impact), Volumes, and
Buckets.
• Containers:
• Old: Counts via scm_container_metrics[[container_type]]_containers .
• New: Counts by detailed Replication Manager states (open, closing, quasi-closed, closed, deleting, deleted, recovering).

2. What the New Dashboard Adds

• Disk/Volume Health: Plots total, healthy, and failed disks.
• S3 Gateway Instances: Plots the number of S3 Gateway instances online.
• Deletion Backlog: Adds a section tracking space pending reclaim (blocks queued/pending on DNs, deleted keys sent for purge, DELETING containers).

3. Redundancies Offloaded

The old Ozone - Overall Metrics dashboard contained general panels for RPC, RATIS, and raw DataNode Chunk/Block counts. The new Ozone - Status
overview intentionally omits these since they are now comprehensively monitored in:

• Ozone - RPC Metrics.json
• Ozone - SCM overview.json (added in PR #10382)
• Ozone - DataNode Overview.json (added in PR #10314)

[jojochuang]

Suggest to remove Ozone - Overall Metrics.json, or replace it with this dashboard.

[github-actions]

This PR has been marked as stale due to 21 days of inactivity. Please comment or remove the stale label to keep it open. Otherwise, it will be automatically closed in 7 days.

[github-actions]

Thank you for your contribution. This PR is being closed due to inactivity. Please contact a maintainer if you would like to reopen it.