You are browsing a read-only backup copy of Wikitech. The primary site can be found at wikitech.wikimedia.org

Difference between revisions of "Alertmanager"

From Wikitech-static
Jump to navigation Jump to search
imported>Filippo Giunchedi
(Intro to AM)
imported>Filippo Giunchedi
(→‎Software stack: add prometheus-icinga-exporter)
Line 3: Line 3:


Alertmanager is being progressively rolled out as the central place where all alerts are sent, the implementation is done in phases according to the [[:File:Alerting Infrastructure design document & roadmap.pdf|alerting infrastructure roadmap]]. As of Jan 2021 LibreNMS has been fully migrated, with more services to come.
Alertmanager is being progressively rolled out as the central place where all alerts are sent, the implementation is done in phases according to the [[:File:Alerting Infrastructure design document & roadmap.pdf|alerting infrastructure roadmap]]. As of Jan 2021 LibreNMS has been fully migrated, with more services to come.
== Software stack ==
When talking about the Alertmanager stack as a whole it is useful to list its components as deployed at Wikimedia Foundation, namely the following software is:
* [https://prometheus.io/docs/alerting/latest/alertmanager/ Alertmanager] the daemon actually in charge of handling alerts and sending out notifications
* [https://github.com/prymitive/karma Karma] the dashboard/UI for Alertmanager alerts, it powers https://alerts.wikimedia.org
* [https://github.com/prymitive/kthxbye kthxbye] implements the "acknowledgement" functionality for alerts
* [https://github.com/google/alertmanager-irc-relay alertmanager-irc-relay] forwards alerts to IRC channels
*[[git:operations/debs/prometheus-icinga-exporter|prometheus-icinga-exporter]] compatibility shim to forward active Icinga alerts to Alertmanager, also provides Prometheus-style metrics for Icinga

Revision as of 14:43, 11 January 2021

What is it?

Alertmanager is the service (and software) in charge of collecting, de-duplicating and sending notifications for alerts across WMF infrastructure. It is part of the Prometheus ecosystem and therefore Prometheus itself has native support to act as Alertmanager client. The alerts dashboard, implemented by Karma, can be reached at https://alerts.wikimedia.org/. As of Jan 2021 the dashboard is available for SSO users only, however a read-only version is possible as well.

Alertmanager is being progressively rolled out as the central place where all alerts are sent, the implementation is done in phases according to the alerting infrastructure roadmap. As of Jan 2021 LibreNMS has been fully migrated, with more services to come.

Software stack

When talking about the Alertmanager stack as a whole it is useful to list its components as deployed at Wikimedia Foundation, namely the following software is: