You are browsing a read-only backup copy of Wikitech. The primary site can be found at wikitech.wikimedia.org

ORES/Metrics: Difference between revisions

From Wikitech-static
Jump to navigation Jump to search
imported>Amir Sarabadani (WMDE)
No edit summary
imported>Dzahn
(One intermediate revision by one other user not shown)
Line 11: Line 11:
*[[Grafana.wikimedia.org/ores.json]] (obsolete: [https://github.com/wiki-ai/grafana-dashboards See the github repo])
*[[Grafana.wikimedia.org/ores.json]] (obsolete: [https://github.com/wiki-ai/grafana-dashboards See the github repo])


== Views ==
The view data if they are behind varnish (meaning internal requests like change propagation or mediawiki request are not logged) can be found in [[Analytics/Data Lake/Traffic/Webrequest|Webrequest database]] in hadoop.
For example this groups IPs and order them by hit count for September 4th, 2018:
<pre>
SELECT ip, count(*) as hitcount
FROM wmf.webrequest
WHERE
uri_host = 'ores.wikimedia.org' AND
year = 2018 AND
month = '09' AND
day = '04'
GROUP BY ip
ORDER BY hitcount DESC
LIMIT 500;
</pre>
[[Category:ORES]]
[[Category:ORES]]
[[Category:Metrics]]

Revision as of 20:09, 17 July 2019

Metrics are captured via a statsd endpoint. They can be found under ores at https://graphite.wikimedia.org. Graphs are curated at https://grafana.wikimedia.org/dashboard/db/ores

Labs statsd
Production statsd
grafana-dashboard json backup

Views

The view data if they are behind varnish (meaning internal requests like change propagation or mediawiki request are not logged) can be found in Webrequest database in hadoop.

For example this groups IPs and order them by hit count for September 4th, 2018:

SELECT ip, count(*) as hitcount
FROM wmf.webrequest
WHERE
uri_host = 'ores.wikimedia.org' AND
year = 2018 AND
month = '09' AND
day = '04'
GROUP BY ip
ORDER BY hitcount DESC
LIMIT 500;