You are browsing a read-only backup copy of Wikitech. The primary site can be found at


From Wikitech-static
< Dumps
Revision as of 15:27, 4 March 2019 by imported>ArielGlenn
(diff) ← Older revision | Latest revision (diff) | Newer revision → (diff)
Jump to navigation Jump to search

This page is about the Wikidata entity dumps. For information about the xml/sql dumps, please see Dumps/XML-SQL Dumps.

These dumps currently run once a week via cron.

The dump scripts attempt to retry failures up to a maximum number of retries. After that maximum, failures are reported by email to

Issues with wikidata entity dumps should be filed under the Dumps-generation project in Phabricator, as well as Wikidata.

Because wikidata grows so quickly, over a period of a few months these dumps can get slow to finish. It's a bad idea to have one week's jobs still going when the next week's starts. Several jobs are run in parallel; this number could theoretically be increased, but the dbas should approve first, since this means more concurrent requests to the database.

These dumps run on database servers designated 'vslow, dumps', on a snapshot host dedicated to 'misc' dump generation (everything other than the xml/sql dumps).

The dump scripts are in our git puppet repo.