You are browsing a read-only backup copy of Wikitech. The primary site can be found at wikitech.wikimedia.org
Alertmanager: Difference between revisions
imported>Filippo Giunchedi (→Software stack: add prometheus-icinga-exporter) |
imported>Filippo Giunchedi (Add production deployment diagram) |
||
| Line 3: | Line 3: | ||
Alertmanager is being progressively rolled out as the central place where all alerts are sent, the implementation is done in phases according to the [[:File:Alerting Infrastructure design document & roadmap.pdf|alerting infrastructure roadmap]]. As of Jan 2021 LibreNMS has been fully migrated, with more services to come. | Alertmanager is being progressively rolled out as the central place where all alerts are sent, the implementation is done in phases according to the [[:File:Alerting Infrastructure design document & roadmap.pdf|alerting infrastructure roadmap]]. As of Jan 2021 LibreNMS has been fully migrated, with more services to come. | ||
[[File:Alertmanager deployment jan2021.png|thumb|Alertmanager production deployment in Jan 2021]] | |||
== Software stack == | == Software stack == | ||
Revision as of 15:09, 12 January 2021
What is it?
Alertmanager is the service (and software) in charge of collecting, de-duplicating and sending notifications for alerts across WMF infrastructure. It is part of the Prometheus ecosystem and therefore Prometheus itself has native support to act as Alertmanager client. The alerts dashboard, implemented by Karma, can be reached at https://alerts.wikimedia.org/. As of Jan 2021 the dashboard is available for SSO users only, however a read-only version is possible as well.
Alertmanager is being progressively rolled out as the central place where all alerts are sent, the implementation is done in phases according to the alerting infrastructure roadmap. As of Jan 2021 LibreNMS has been fully migrated, with more services to come.
Software stack
When talking about the Alertmanager stack as a whole it is useful to list its components as deployed at Wikimedia Foundation, namely the following software is:
- Alertmanager the daemon actually in charge of handling alerts and sending out notifications
- Karma the dashboard/UI for Alertmanager alerts, it powers https://alerts.wikimedia.org
- kthxbye implements the "acknowledgement" functionality for alerts
- alertmanager-irc-relay forwards alerts to IRC channels
- prometheus-icinga-exporter compatibility shim to forward active Icinga alerts to Alertmanager, also provides Prometheus-style metrics for Icinga