ORES/Metrics

Metrics are captured via a statsd endpoint. They can be found under ores at https://graphite.wikimedia.org. Graphs are curated at https://grafana.wikimedia.org/dashboard/db/ores

Labs statsd

• labmon1001.eqiad.wmnet configured in https://github.com/wiki-ai/ores-wmflabs-deploy/blob/master/config/00-main.yaml

Production statsd

• graphite-in.eqiad.wmnet configured in https://github.com/wikimedia/operations-puppet/blob/production/modules/ores/manifests/web.pp

grafana-dashboard json backup

• Update grafana repo
• Grafana.wikimedia.org/ores.json (obsolete: See the github repo)

Views

The view data if they are behind varnish (meaning internal requests like change propagation or mediawiki request are not logged) can be found in Webrequest database in hadoop.

For example this groups IPs and order them by hit count for September 4th, 2018:

SELECT ip, count(*) as hitcount
FROM wmf.webrequest
WHERE
uri_host = 'ores.wikimedia.org' AND
year = 2018 AND
month = '09' AND
day = '04'
GROUP BY ip
ORDER BY hitcount DESC
LIMIT 500;