You are browsing a read-only backup copy of Wikitech. The live site can be found at wikitech.wikimedia.org
WMDE/Wikidata/Alerts: Difference between revisions
imported>Addshore No edit summary |
imported>Addshore (→Edits: Wikidata edit rate: mention maxlag) |
||
| Line 20: | Line 20: | ||
You can view the edits dashboard at https://grafana.wikimedia.org/d/000000170/wikidata-edits | You can view the edits dashboard at https://grafana.wikimedia.org/d/000000170/wikidata-edits | ||
If MAXLAG is high, that might be a reason for low edit rate. | |||
You may want to investigate what is going on with the API (as all edits go via the API) https://grafana.wikimedia.org/d/000000559/api-requests-breakdown?refresh=5m&orgId=1&var-metric=p50&var-module=wb* | You may want to investigate what is going on with the API (as all edits go via the API) https://grafana.wikimedia.org/d/000000559/api-requests-breakdown?refresh=5m&orgId=1&var-metric=p50&var-module=wb* | ||
Revision as of 16:05, 20 November 2019
Icinga
Wikidata related Icinga alerts are defined in puppet https://gerrit.wikimedia.org/r/plugins/gitiles/operations/puppet/+/production/modules/icinga/manifests/monitor/wikidata.pp
The status of alerts can be seen at https://icinga.wikimedia.org/cgi-bin/icinga/status.cgi?search_string=wikidata
All alerts report to the "wikidata" contact group, which can be seen at https://gerrit.wikimedia.org/r/plugins/gitiles/operations/puppet/+/production/modules/nagios_common/files/contactgroups.cfg#52
Internally in WMDE there is a wikidata-monitoring mailing list you can subscribe to, also notifications will land in the wikidata IRC channel.
Grafana
One of the Icinga checks monitors the alert status of the wikidata alerts dashboard on Grafana.
The dashboard can be found here: https://grafana.wikimedia.org/d/TUJ0V-0Zk/wikidata-alerts
Edits: Wikidata edit rate
The edit rate on Wikidata can be a good indicator that something somewhere is wrong, although it will not always indicate exactly what that is.
You can view the edits dashboard at https://grafana.wikimedia.org/d/000000170/wikidata-edits
If MAXLAG is high, that might be a reason for low edit rate.
You may want to investigate what is going on with the API (as all edits go via the API) https://grafana.wikimedia.org/d/000000559/api-requests-breakdown?refresh=5m&orgId=1&var-metric=p50&var-module=wb*
API: Max p95 execute time for write modules
Investigate the wb api @ https://grafana.wikimedia.org/d/000000559/api-requests-breakdown?refresh=5m&orgId=1&var-metric=p50&var-module=wb*
SQL: Rows read, above 10 million, for 2 minutes
This is likely too much reading.
Oozie Job
Contact WMF analytics to investigate