You are browsing a read-only backup copy of Wikitech. The primary site can be found at wikitech.wikimedia.org
Analytics/Systems/Wikistats: Difference between revisions
Jump to navigation
Jump to search
imported>Milimetric m (Milimetric moved page Analytics/Wikistats to Analytics/Systems/Wikistats) |
imported>Nuria (→Data) |
||
Line 1: | Line 1: | ||
== New Version, Wikistats 2.0 == | |||
== Monthly Pageview Reports == | The Wikistats interface, available at [https://stats.wikimedia.org/ stats.wikimedia.org] is being re-worked to be a little more browse-able and friendly. You can see the prototype here: [https://analytics-prototype.wmflabs.org analytics-prototype.wmflabs.org]. The code for this work is in [https://phabricator.wikimedia.org/source/wikistats/ this repository] and we're aiming to deploy a very minimal version by the end of July, 2017. We will iterate on that adding more metrics and functionality. | ||
== Data == | |||
The data behind Wikistats is [[Analytics/Data_Lake/Edits]]. It is processed in two steps: | |||
# Extracted as raw data from labs replicas on a monthly basis, by a cron. | |||
# Processed by a oozie job running scala and labeled with the month's snapshot (eg. 2017-06). | |||
More details: [[Analytics/Data_Lake/Edits]] | |||
== Old Version (to archive soon) Monthly Pageview Reports == | |||
These are now feed with hive data | These are now feed with hive data |
Revision as of 04:33, 3 August 2017
New Version, Wikistats 2.0
The Wikistats interface, available at stats.wikimedia.org is being re-worked to be a little more browse-able and friendly. You can see the prototype here: analytics-prototype.wmflabs.org. The code for this work is in this repository and we're aiming to deploy a very minimal version by the end of July, 2017. We will iterate on that adding more metrics and functionality.
Data
The data behind Wikistats is Analytics/Data_Lake/Edits. It is processed in two steps:
- Extracted as raw data from labs replicas on a monthly basis, by a cron.
- Processed by a oozie job running scala and labeled with the month's snapshot (eg. 2017-06).
More details: Analytics/Data_Lake/Edits
Old Version (to archive soon) Monthly Pageview Reports
These are now feed with hive data