Deployments

Notes:

• Ask for a little more time than what you think you'll need for deployment and testing; you never know what issues may come up and slow you down.
  • Generally, we have found one hour to be a good size for most things.
• Deployment windows are 'pinned' to the time in San Francisco and thus the UTC time will change due to the United States observance of Daylight Savings Time as appropriate.
• SWAT deploys are for pushing out simple and low-risk changes (as assessed by you, SWAT team, and the Release Engineering Team). They happen on Mondays to Thursdays at:
  • "European Mid-day SWAT", 04:00 Pacific
  • "Morning SWAT", 11:00 Pacific (except Tuesdays)
  • "Evening SWAT", 16:00 Pacific

For detailed instructions on how to actually deploy code to the Wikimedia servers, see How to deploy code.

Deployments
Jump to current event Deployment calendar Long-term calendar 1.40 Roadmap Train overview Archive Blocking tasks (Current task) Holding the train 🚨 Emergencies How to deploy code Heterogeneous deployment Train deploys Backport windows How to deploy backports Backport vs Train vs Special Window Train vs Backport Special Windows Backport windows

This page tracks upcoming deployments of software to the Wikimedia Foundation servers that host Wikimedia project sites (Wikipedia, Wiktionary, Wikiversity, Wikimedia Commons, etc.).

Cadence

For the core software ("MediaWiki"): The Wikimedia Foundation currently follows a one-week deploy cadence. This means that there is one week between updates to any one Wikimedia project site wiki (excluding urgent fixes, of course).

For other non-core software: Each team is responsible for their own schedule.

Scheduling

To schedule a deploy window, or if you see a potential conflict with your upcoming deployment, please contact the Release Engineering Team on IRC at #wikimedia-releng ^connect; pinging Greg (greg-g) or Tyler (thcipriani) directly helps.

Inclusion criteria

See the list at Inclusion criteria for the kinds of changes that require scheduling here.

Long running tasks/scripts

While not strictly a deployment, performing long running (>1 hour) tasks (eg: migration scripts) can encounter issues when code is updated while a script is being run. For this reason it is required to add an entry in the calendar for the task with a window that accounts for the anticipated start time and estimated length for the task.

Communicating

• Every major or new feature deployment should be announced on the Wikimedia blog and/or Tech News (use the "user-notice" tag on Phabricator) and/or global on-wiki delivery. For routine and maintenance deployments, listing your change here is enough.
• Changes that are liable to affect site performance or infrastructure should be announced on the ops mailing list. This includes anything that alters caching behavior, introduces cookies, substantially increases the static asset payload, or adds new and complicated query patterns.

Something went wrong‽ (see also Incident response)

• Is there a user-impacting or other severe issue?
  • Communicate this in the #wikimedia-operations ^connect IRC channel.
  • Add the #wikimedia-incident project to any relevant Phabricator task; if appropriate set to UBN! priority.
• What happens next?
  • In case of halting or reverting the weekly train

Near-term

NOTE: You can also subscribe to the "WMF Deployments" google calendar by adding <wikimedia.org_rudis09ii2mm5fk4hgdjeh1u64@group.calendar.google.com>. This does not always get one-off windows that are noted below. This wiki page is the canonical deployment schedule and any differences with the google calendar are to be interpreted as the google calendar being incorrect.

Week of June 01

Time	Component	Deployer	Changes
Sunday, May 31
07:00–07:00 UTC # 00:00–00:00 PDT	No deploys all day! See Deployments/Emergencies if things are broken.		No Deploys
Monday, June 01
10:30–11:00 UTC # 03:30–04:00 PDT	Wikimedia Portals Update	Jan Drewniak (jan_drewniak)	Weekly window for the portals page: https://www.wikipedia.org/
11:00–12:00 UTC # 04:00–05:00 PDT	European Mid-day SWAT (Max 6 patches)	Amir (Amir1), Lucas (Lucas_WMDE), Adam (awight), Martin (Urbanecm)	Requesting Developer (irc-nickname) Gerrit link to backport or config change
17:00–17:30 UTC # 10:00–10:30 PDT	Wikidata Query Service weekly deploy	Guillaume (gehel), Mathew (onimisionipe)	...
18:00–19:00 UTC # 11:00–12:00 PDT	Morning SWAT (Max 6 patches)	Roan (RoanKattouw), Niharika (Niharika), Martin (Urbanecm)	Bill Pirkle (bpirkle), Petr Pchelko (Pchelolo) 570395 (deploy commands) [Config] Enable kask-transition session store for all groups
20:00–21:00 UTC # 13:00–14:00 PDT	Services – Graphoid / Citoid / ORES	Aaron (halfak)), Andy (accraze)	See Graphoid
21:00–23:00 UTC # 14:00–16:00 PDT	Weekly Security deployment window	Sam (Reedy), Scott (sbassett)	Held deployment window for Security-team related deploys.
23:00–00:00 UTC # 16:00–17:00 PDT	Evening SWAT (Max 6 patches)	Roan (RoanKattouw), Niharika (Niharika), Martin (Urbanecm)	Aaron Schulz (AaronSchulz) [config] 598852 (deploy commands) Enable "coalesceKeys"="non-global" for WANCache on wikidatawiki Requesting Developer (irc-nickname) Gerrit link to backport or config change
Tuesday, June 02
11:00–12:00 UTC # 04:00–05:00 PDT	European Mid-day SWAT (Max 6 patches)	Amir (Amir1), Lucas (Lucas_WMDE), Adam (awight), Martin (Urbanecm)	Kartik Mistry (kart_) [config] 601174 (deploy commands) Create URL campaign for African languages for COVID-19 translation project Requesting Developer (irc-nickname) Gerrit link to backport or config change
13:00–14:00 UTC # 06:00–07:00 PDT	database load testing	cdanis, marostegui
16:00–17:00 UTC # 09:00–10:00 PDT	Puppet SWAT (Max 6 patches)	Filippo (godog), Giuseppe (_joe_)	Requesting Developer (irc-nickname) Gerrit link to Puppet change
17:00–18:00 UTC # 10:00–11:00 PDT	Services – Graphoid / Citoid / ORES	Aaron (halfak)), Andy (accraze)	See Graphoid
18:00–19:00 UTC # 11:00–12:00 PDT	Pre MediaWiki train sanity break		No Deploys
19:00–21:00 UTC # 12:00–14:00 PDT	Mediawiki train - American Version	James (James_F), Jeena (longma)	1.35 schedule group0 1.35.0-wmf.34->1.35.0-wmf.35 group1 1.35.0-wmf.34 group2 1.35.0-wmf.34 group0 to 1.35.0-wmf.35 Blockers: task T253023
23:00–00:00 UTC # 16:00–17:00 PDT	Evening SWAT (Max 6 patches)	Roan (RoanKattouw), Niharika (Niharika), Martin (Urbanecm)	Requesting Developer (irc-nickname) Gerrit link to backport or config change
Wednesday, June 03
11:00–12:00 UTC # 04:00–05:00 PDT	European Mid-day SWAT (Max 6 patches)	Amir (Amir1), Lucas (Lucas_WMDE), Adam (awight), Martin (Urbanecm)	DannyS712 (DannyS712) 602022 (deploy commands) [config] Remove obsolete schema migration settings MarcoAurelio (hauskatze) 600979 (deploy commands) [config][eswiki] Normalize talk namespaces for Anexo, Portal and Wikiproyecto (T254252) Requesting Developer (irc-nickname) Gerrit link to backport or config change
18:00–19:00 UTC # 11:00–12:00 PDT	Train log triage with CPT	James (James_F), Jeena (longma) + CPT	See Heterogeneous_deployment/Train_deploys#Breakage
18:00–19:00 UTC # 11:00–12:00 PDT	Morning SWAT (Max 6 patches)	Roan (RoanKattouw), Niharika (Niharika), Martin (Urbanecm)	Bill Pirkle (bpirkle), Petr Pchelko (Pchelolo) Done [config] 570396 (deploy commands) Enable kask-session session store for all groups Petr Pchelko (Pchelolo) Done [config] 599150 (deploy commands) Enable Kafka purges for group0 Jdlrobson Done [config] Use AddFooterLink hook for code of conduct and contact links 596277 (deploy commands) Done [config] Disable growth survey 601842 (deploy commands) Done [config] Enable talk pages on Swedish Minerva 601843 (deploy commands) Done [config] Stop special casing the main page on several projects 601847 (deploy commands)
19:00–21:00 UTC # 12:00–14:00 PDT	Mediawiki train - American Version	James (James_F), Jeena (longma)	1.35 schedule group0 1.35.0-wmf.35 group1 1.35.0-wmf.34->1.35.0-wmf.35 group2 1.35.0-wmf.34 group1 to 1.35.0-wmf.35 Blockers: task T253023
20:00–21:00 UTC # 13:00–14:00 PDT	Services – Graphoid / Citoid / ORES	Aaron (halfak)), Andy (accraze)	See Graphoid
23:00–00:00 UTC # 16:00–17:00 PDT	Evening SWAT (Max 6 patches)	Roan (RoanKattouw), Niharika (Niharika), Martin (Urbanecm)	Requesting Developer (irc-nickname) Gerrit link to backport or config change
Thursday, June 04
00:00–01:00 UTC # (Wed) 17:00–18:00 PDT	Phabricator update	Mukunda (twentyafterfour)	HOLD: Window to update phabricator.wikimedia.org
11:00–12:00 UTC # 04:00–05:00 PDT	European Mid-day SWAT (Max 6 patches)	Amir (Amir1), Lucas (Lucas_WMDE), Adam (awight), Martin (Urbanecm)	Requesting Developer (irc-nickname) Gerrit link to backport or config change
16:00–17:00 UTC # 09:00–10:00 PDT	Puppet SWAT (Max 6 patches)	Filippo (godog), Giuseppe (_joe_)	Brennen Bearnes (brennen) 593936 (deploy commands): logspam-watch: add time and sortable columns, improve formatting
17:00–18:00 UTC # 10:00–11:00 PDT	Services – Graphoid / Citoid / ORES	Aaron (halfak)), Andy (accraze)	See Graphoid
18:00–19:00 UTC # 11:00–12:00 PDT	Morning SWAT (Max 6 patches)	Roan (RoanKattouw), Niharika (Niharika), Martin (Urbanecm)	Requesting Developer (irc-nickname) Gerrit link to backport or config change
19:00–21:00 UTC # 12:00–14:00 PDT	Mediawiki train - American Version	James (James_F), Jeena (longma)	1.35 schedule group0 1.35.0-wmf.35 group1 1.35.0-wmf.35 group2 1.35.0-wmf.34->1.35.0-wmf.35 group2 to 1.35.0-wmf.35 Blockers: task T253023
23:00–00:00 UTC # 16:00–17:00 PDT	Evening SWAT (Max 6 patches)	Roan (RoanKattouw), Niharika (Niharika), Martin (Urbanecm)	RoanKattouw [config] 601409 (deploy commands) Enable GrowthExperiments guidance behind a hidden preference Requesting Developer (irc-nickname) Gerrit link to backport or config change
Friday, June 05
07:00–07:00 UTC # 00:00–00:00 PDT	No deploys all day! See Deployments/Emergencies if things are broken.		No Deploys
Saturday, June 06
07:00–07:00 UTC # 00:00–00:00 PDT	No deploys all day! See Deployments/Emergencies if things are broken.		No Deploys

Week of June 08

Time	Component	Deployer	Changes
Sunday, June 07
07:00–07:00 UTC # 00:00–00:00 PDT	No deploys all day! See Deployments/Emergencies if things are broken.		No Deploys
Monday, June 08
10:30–11:00 UTC # 03:30–04:00 PDT	Wikimedia Portals Update	Jan Drewniak (jan_drewniak)	Weekly window for the portals page: https://www.wikipedia.org/
11:00–12:00 UTC # 04:00–05:00 PDT	European Mid-day SWAT (Max 6 patches)	Amir (Amir1), Lucas (Lucas_WMDE), Adam (awight), Martin (Urbanecm)	Requesting Developer (irc-nickname) Gerrit link to backport or config change
17:00–17:30 UTC # 10:00–10:30 PDT	Wikidata Query Service weekly deploy	Guillaume (gehel), Mathew (onimisionipe)	...
18:00–19:00 UTC # 11:00–12:00 PDT	Morning SWAT (Max 6 patches)	Roan (RoanKattouw), Niharika (Niharika), Martin (Urbanecm)	Requesting Developer (irc-nickname) Gerrit link to backport or config change
20:00–21:00 UTC # 13:00–14:00 PDT	Services – Graphoid / Citoid / ORES	Aaron (halfak)), Andy (accraze)	See Graphoid
21:00–23:00 UTC # 14:00–16:00 PDT	Weekly Security deployment window	Sam (Reedy), Scott (sbassett)	Held deployment window for Security-team related deploys.
23:00–00:00 UTC # 16:00–17:00 PDT	Evening SWAT (Max 6 patches)	Roan (RoanKattouw), Niharika (Niharika), Martin (Urbanecm)	Requesting Developer (irc-nickname) Gerrit link to backport or config change
Tuesday, June 09
11:00–12:00 UTC # 04:00–05:00 PDT	European Mid-day SWAT (Max 6 patches)	Amir (Amir1), Lucas (Lucas_WMDE), Adam (awight), Martin (Urbanecm)	Requesting Developer (irc-nickname) Gerrit link to backport or config change
16:00–17:00 UTC # 09:00–10:00 PDT	Puppet SWAT (Max 6 patches)	Filippo (godog), Giuseppe (_joe_)	Requesting Developer (irc-nickname) Gerrit link to Puppet change
17:00–18:00 UTC # 10:00–11:00 PDT	Services – Graphoid / Citoid / ORES	Aaron (halfak)), Andy (accraze)	See Graphoid
18:00–19:00 UTC # 11:00–12:00 PDT	Pre MediaWiki train sanity break		No Deploys
19:00–21:00 UTC # 12:00–14:00 PDT	Mediawiki train - American+European Version	Jeena (longma), Lars (liw)	1.35 schedule group0 1.35.0-wmf.35->1.35.0-wmf.36 group1 1.35.0-wmf.35 group2 1.35.0-wmf.35 group0 to 1.35.0-wmf.36 Blockers: task T254173
23:00–00:00 UTC # 16:00–17:00 PDT	Evening SWAT (Max 6 patches)	Roan (RoanKattouw), Niharika (Niharika), Martin (Urbanecm)	Requesting Developer (irc-nickname) Gerrit link to backport or config change
Wednesday, June 10
11:00–12:00 UTC # 04:00–05:00 PDT	European Mid-day SWAT (Max 6 patches)	Amir (Amir1), Lucas (Lucas_WMDE), Adam (awight), Martin (Urbanecm)	Requesting Developer (irc-nickname) Gerrit link to backport or config change
13:00–15:00 UTC # 06:00–08:00 PDT	Mediawiki train - American+European Version (secondary timeslot)	Jeena (longma), Lars (liw)	1.35 schedule group0 1.35.0-wmf.36 group1 1.35.0-wmf.35->1.35.0-wmf.36 group2 1.35.0-wmf.35 group1 to 1.35.0-wmf.36 Blockers: task T254173
18:00–19:00 UTC # 11:00–12:00 PDT	Train log triage with CPT	Jeena (longma), Lars (liw) + CPT	See Heterogeneous_deployment/Train_deploys#Breakage
18:00–19:00 UTC # 11:00–12:00 PDT	Morning SWAT (Max 6 patches)	Roan (RoanKattouw), Niharika (Niharika), Martin (Urbanecm)	Requesting Developer (irc-nickname) Gerrit link to backport or config change
19:00–21:00 UTC # 12:00–14:00 PDT	Mediawiki train - American+European Version	Jeena (longma), Lars (liw)	1.35 schedule group0 1.35.0-wmf.36 group1 1.35.0-wmf.35->1.35.0-wmf.36 group2 1.35.0-wmf.35 group1 to 1.35.0-wmf.36 Blockers: task T254173
20:00–21:00 UTC # 13:00–14:00 PDT	Services – Graphoid / Citoid / ORES	Aaron (halfak)), Andy (accraze)	See Graphoid
23:00–00:00 UTC # 16:00–17:00 PDT	Evening SWAT (Max 6 patches)	Roan (RoanKattouw), Niharika (Niharika), Martin (Urbanecm)	Requesting Developer (irc-nickname) Gerrit link to backport or config change
Thursday, June 11
00:00–01:00 UTC # (Wed) 17:00–18:00 PDT	Phabricator update	Mukunda (twentyafterfour)	HOLD: Window to update phabricator.wikimedia.org
11:00–12:00 UTC # 04:00–05:00 PDT	European Mid-day SWAT (Max 6 patches)	Amir (Amir1), Lucas (Lucas_WMDE), Adam (awight), Martin (Urbanecm)	Requesting Developer (irc-nickname) Gerrit link to backport or config change
13:00–15:00 UTC # 06:00–08:00 PDT	Mediawiki train - American+European Version (secondary timeslot)	Jeena (longma), Lars (liw)	1.35 schedule group0 1.35.0-wmf.36 group1 1.35.0-wmf.36 group2 1.35.0-wmf.35->1.35.0-wmf.36 group2 to 1.35.0-wmf.36 Blockers: task T254173
16:00–17:00 UTC # 09:00–10:00 PDT	Puppet SWAT (Max 6 patches)	Filippo (godog), Giuseppe (_joe_)	Requesting Developer (irc-nickname) Gerrit link to Puppet change
17:00–18:00 UTC # 10:00–11:00 PDT	Services – Graphoid / Citoid / ORES	Aaron (halfak)), Andy (accraze)	See Graphoid
18:00–19:00 UTC # 11:00–12:00 PDT	Morning SWAT (Max 6 patches)	Roan (RoanKattouw), Niharika (Niharika), Martin (Urbanecm)	Requesting Developer (irc-nickname) Gerrit link to backport or config change
19:00–21:00 UTC # 12:00–14:00 PDT	Mediawiki train - American+European Version	Jeena (longma), Lars (liw)	1.35 schedule group0 1.35.0-wmf.36 group1 1.35.0-wmf.36 group2 1.35.0-wmf.35->1.35.0-wmf.36 group2 to 1.35.0-wmf.36 Blockers: task T254173
23:00–00:00 UTC # 16:00–17:00 PDT	Evening SWAT (Max 6 patches)	Roan (RoanKattouw), Niharika (Niharika), Martin (Urbanecm)	Requesting Developer (irc-nickname) Gerrit link to backport or config change
Friday, June 12
07:00–07:00 UTC # 00:00–00:00 PDT	No deploys all day! See Deployments/Emergencies if things are broken.		No Deploys
Saturday, June 13
07:00–07:00 UTC # 00:00–00:00 PDT	No deploys all day! See Deployments/Emergencies if things are broken.		No Deploys

Past deployments

• /Archive

See also

• SWAT deploys