Operators / Monitoring

watch the signals that matter.

Monitoring should make operator action obvious before degraded infrastructure becomes a network or user-facing incident.

core signals

  • chain synchronization and block progress
  • peer count and connectivity quality
  • CPU, memory, disk usage and disk latency
  • RPC latency, error rates and saturation
  • indexer lag, failed jobs and data freshness
  • validator participation and missed duties where applicable

alert design

Alert on actionable conditions rather than raw noise. Thresholds should include duration and severity so brief fluctuations do not trigger the same response as sustained failure.

logs & retention

Centralize logs with timestamps, host identity and service version. Protect logs from accidental deletion while avoiding retention policies that exhaust production storage.

incident context

Record deploys, upgrades and configuration changes alongside telemetry so operators can correlate failures with recent changes and recover more quickly.