OpenSearchCon India 2025

HPCM (HPE Performance Cluster Manager) is a suite for monitoring HPC systems, consisting of rack, chassis, compute nodes(GPU, CPU), power,cooling components. OpenSearch, deployed in a distributed manner, enables efficient indexing and querying of large volumes of data. For real-time monitoring, events across the system is collected and streamed to Kafka, then persisted in OpenSearch via Logstash, allowing for efficient log management. OpenSearch Dashboards, integrated with Fluent Bit, provide real-time log observability, enabling users to visualize and analyze system logs for insightful cluster monitoring. We have developed a user-friendly wrapper around OpenSearch Alerting that uses custom YAML-based configurations to define alerting rules, categorize alerts by severity and group, and trigger notifications to endpoints like email,alertmanager. Argonne National Laboratory's Aurora, the third-fastest supercomputer in the world, uses 21,248 CPUs and 63,744 GPUs across 166 racks. HPCM, along with its 10-instance OpenSearch database deployed on 10 nodes, successfully manages and monitors events and logs, with OpenSearch Alerting effectively deployed to track critical system issues.