You are browsing a read-only backup copy of Wikitech. The live site can be found at wikitech.wikimedia.org

Heterogeneous deployment/Train deploys: Revision history

View logs for this page

Jump to navigation Jump to search

Diff selection: Mark the radio buttons of the revisions to compare and hit enter or the button at the bottom.
Legend: (cur) = difference with latest revision, (prev) = difference with preceding revision, m = minor edit.

curprev 18:5818:58, 8 May 2023‎ imported>Brennen Bearnes‎ 15,585 bytes +349‎ →‎Places we monitor: link new errors dashboard, a bit more context on logs, remove channels we don't do much with.

curprev 15:4415:44, 19 April 2023‎ imported>Thcipriani‎ 15,236 bytes +514‎ No edit summary

curprev 16:1016:10, 17 April 2023‎ imported>Ahmon Dancy‎ 14,722 bytes −471‎ →‎Before the deploy window: Removed row about latest branch mismatch. This is unlikely to happen.

curprev 07:5207:52, 14 April 2023‎ imported>Tacsipacsi‎ m 15,193 bytes −1‎ →‎Tuesday: New branch creation and deploy: typo fix

curprev 21:2821:28, 13 April 2023‎ imported>Ahmon Dancy‎ 15,194 bytes +2,041‎ →‎Before the deploy window: Updated the error message that will be seen if the branch cut CI job fails

curprev 18:2718:27, 11 April 2023‎ imported>Chad‎ m 13,153 bytes −18,322‎ Remove empty collapsed section

curprev 22:3822:38, 16 February 2023‎ imported>Dduvall‎ m 31,475 bytes 0‎ →‎Update roadmap

curprev 15:2615:26, 20 January 2023‎ imported>Jforrester‎ m 31,475 bytes −8‎ Trim double-spaces.

curprev 22:1822:18, 19 January 2023‎ imported>Ahmon Dancy‎ 31,483 bytes −223‎ Remove instructions to clone the release repo. That is not a requirement for train operations.

curprev 19:0719:07, 3 January 2023‎ imported>Dduvall‎ 31,706 bytes 0‎ Update roadmap links to 1.40

curprev 13:3413:34, 26 September 2022‎ imported>Lucas Werkmeister (WMDE)‎ m 31,706 bytes +27‎ add alt to banner image (short and sweet, don’t think it needs to be more detailed in this context)

curprev 13:1313:13, 10 June 2022‎ imported>Krinkle‎ 31,679 bytes −309‎ No edit summary

curprev 16:4516:45, 9 June 2022‎ imported>Krinkle‎ 31,988 bytes +11‎ No edit summary

curprev 12:1412:14, 3 May 2022‎ imported>Jaime Nuche‎ 31,977 bytes −27‎ Update stage-train instructions to use the new version integrated into scap

curprev 08:3108:31, 19 April 2022‎ imported>Jaime Nuche‎ 32,004 bytes −67‎ No edit summary

curprev 07:5707:57, 6 April 2022‎ imported>Jaime Nuche‎ 32,071 bytes 0‎ Update roadmap page links to 1.39

curprev 07:4107:41, 5 April 2022‎ imported>Jaime Nuche‎ 32,071 bytes 0‎ Update roadmap page link to 1.39

curprev 19:1719:17, 2 March 2022‎ imported>Dduvall‎ 32,071 bytes 0‎ →‎Places to Watch for Breakage: Fix varnish dashboard link

curprev 09:3909:39, 16 February 2022‎ imported>Hashar‎ m 32,071 bytes 0‎ →‎Update roadmap: 1.35 > 1.38

curprev 21:2221:22, 1 February 2022‎ imported>Ahmon Dancy‎ 32,071 bytes 0‎ Update link to Roadmap

curprev 20:3220:32, 11 January 2022‎ imported>Dduvall‎ 32,071 bytes −1‎ →‎Places to Watch for Breakage: Fixed mediawiki-errors logstash link

curprev 01:0601:06, 5 January 2022‎ imported>Reedy‎ 32,072 bytes −68‎ →‎Apply security patches: checks and applies

curprev 20:1520:15, 14 December 2021‎ imported>Hashar‎ m 32,140 bytes 0‎ Reverted edits by Hashar (talk) to last revision by Thcipriani

curprev 18:2918:29, 15 November 2021‎ imported>Thcipriani‎ 32,140 bytes −2,283‎ →‎Before the deploy window

curprev 23:2323:23, 5 November 2021‎ imported>Dduvall‎ m 34,423 bytes 0‎ →‎Update roadmap

curprev 14:4914:49, 12 October 2021‎ imported>Ahmon Dancy‎ m 34,423 bytes −45‎ Removed an obsolete note

curprev 20:5420:54, 5 October 2021‎ imported>Brennen Bearnes‎ 34,468 bytes +48‎ →‎Rollback: Formatting tweak for commit amending section

curprev 22:4522:45, 23 September 2021‎ imported>Dduvall‎ 34,420 bytes 0‎ →‎Thursday: group{0,1} to all deploy: Updated roadmap link to 1.38

curprev 20:3120:31, 24 August 2021‎ imported>Ahmon Dancy‎ m 34,420 bytes 0‎ point to 1.37 roadmap

curprev 00:1300:13, 18 August 2021‎ imported>Thcipriani‎ m 34,420 bytes −76‎ No edit summary

curprev 07:5207:52, 21 July 2021‎ imported>Hashar‎ m 34,496 bytes +66‎ Use refs/for/%topic=

curprev 15:4615:46, 13 July 2021‎ imported>Ahmon Dancy‎ 34,430 bytes −528‎ Remove obsolete steps from "Before the deploy window" section.

curprev 19:1019:10, 24 June 2021‎ imported>Dduvall‎ 34,958 bytes +11‎ Suggest passing explicit group1 argument to deploy-promote

curprev 14:4014:40, 27 April 2021‎ imported>Lars Wirzenius‎ 34,947 bytes +56‎ →‎Before the deploy window

curprev 08:2208:22, 31 March 2021‎ imported>Hashar‎ m 34,891 bytes +101‎ →‎If the train is blocked: + Slack channel

curprev 19:4019:40, 16 March 2021‎ imported>Ahmon Dancy‎ 34,790 bytes −53‎ Update time estimate for deploy-promote testwikis step

curprev 19:5719:57, 3 March 2021‎ imported>Thcipriani‎ 34,843 bytes +149‎ →‎Places to Watch for Breakage

curprev 17:1817:18, 2 March 2021‎ imported>Ahmon Dancy‎ 34,694 bytes +105‎ Added link to Currently Deployed Security Patches phab ticket

curprev 08:2808:28, 17 February 2021‎ imported>Amire80‎ 34,589 bytes +141‎ →‎See also: rm nowiki

curprev 23:4223:42, 3 February 2021‎ imported>Brennen Bearnes‎ 34,448 bytes +208‎ →‎Places to Watch for Breakage: Mention client error dashboard.

curprev 19:4919:49, 17 November 2020‎ imported>Ahmon Dancy‎ 34,240 bytes −1,549‎ Move old code pruning steps below the deploy-promote step.

curprev 22:1622:16, 20 September 2020‎ imported>Tacsipacsi‎ 35,789 bytes −1‎ move categories to the absolute bottom

curprev 21:2421:24, 19 September 2020‎ imported>Ahmon Dancy‎ 35,790 bytes +15‎ Separate Incident documentation from the automatically generated footnotes section.

curprev 18:1118:11, 14 September 2020‎ imported>Ahmon Dancy‎ m 35,775 bytes +21‎ Stay in /srv/mediawiki-staging to run deploy-promote. Updated path to deploy-promote

curprev 17:3517:35, 13 August 2020‎ imported>Ahmon Dancy‎ 35,754 bytes +23‎ →‎Initial setup

curprev 15:4115:41, 11 August 2020‎ imported>Thcipriani‎ 35,731 bytes +6‎ →‎Before the deploy window: README -> README.md (T260145)

curprev 19:2619:26, 10 August 2020‎ imported>BryanDavis‎ 35,725 bytes +16‎ →‎Before the deploy window: use interwiki link to phab

curprev 21:2221:22, 5 August 2020‎ imported>Ahmon Dancy‎ 35,709 bytes −381‎ Added initial setup instructions

curprev 16:1416:14, 4 August 2020‎ imported>Tacsipacsi‎ 36,090 bytes −3‎ →‎Weekly steps: 1.36 is being deployed now

curprev 15:4515:45, 29 July 2020‎ imported>Thcipriani‎ 36,093 bytes +12‎ →‎Rollback: Topic sytnax has changed

curprev 11:2911:29, 7 July 2020‎ imported>Majavah‎ 36,081 bytes +59‎ toolforge.org, advertise my tool

curprev 18:5718:57, 23 June 2020‎ imported>Brennen Bearnes‎ 36,022 bytes −21‎ →‎Before the deploy window: Correct deploy-promote prompt to indicate user's $HOME.

curprev 13:3813:38, 17 June 2020‎ imported>Lars Wirzenius‎ 36,043 bytes +6‎ →‎During the deploy window: fix link to mw.org to be to mw.org

curprev 15:2415:24, 15 June 2020‎ imported>Thcipriani‎ 36,037 bytes +114‎ →‎Before the deploy window: Auto branch cut.

curprev 17:4517:45, 3 June 2020‎ imported>Jforrester‎ 35,923 bytes −718‎ →‎Before the deploy window: Add time warning to scap clean; time for scap sync can be epic. :-(

curprev 21:1121:11, 2 June 2020‎ imported>Thcipriani‎ 36,641 bytes 0‎ Undo revision 1868114 by 20after4 (talk) -- This is for next week :)

curprev 17:0717:07, 28 May 2020‎ imported>20after4‎ 36,641 bytes +154‎ Application Servers RED Dashboard

curprev 17:2317:23, 26 May 2020‎ imported>Jforrester‎ 36,487 bytes 0‎ →‎Before the deploy window: Use an example TrainBranchBot commit instead of an old manual one.

curprev 17:2017:20, 13 May 2020‎ imported>Brennen Bearnes‎ 36,487 bytes +110‎ →‎Wednesday: group0 to group1 deploy: Stub in mention of Train Log Triage meeting for Wednesday.

curprev 14:1014:10, 12 May 2020‎ imported>Lars Wirzenius‎ 36,377 bytes +297‎ →‎Before the deploy window: note that branch cutting is slow now

curprev 16:4116:41, 1 May 2020‎ imported>20after4‎ 36,080 bytes −1,162‎ Document the new branch cut jenkins job

curprev 18:0418:04, 30 April 2020‎ imported>Jforrester‎ m 37,242 bytes +174‎ Other deploy-promote fixes.

curprev 20:5120:51, 29 April 2020‎ imported>Jforrester‎ 37,068 bytes +10‎ →‎During the deploy window: You need to specify the version for the group0 deploy-promote.

curprev 23:0623:06, 28 April 2020‎ imported>Brennen Bearnes‎ 37,058 bytes +180‎ →‎Places to Watch for Breakage: Slightly reorganize list, mention production error workboard.

curprev 19:4019:40, 16 April 2020‎ imported>Jforrester‎ 36,878 bytes +12,783‎ Add in short-form instructions.

curprev 21:3821:38, 8 April 2020‎ imported>Brennen Bearnes‎ 24,095 bytes +180‎ →‎Sync to cluster and verify on testwiki: Mention T223287 re: scap-cdb-rebuild hanging.

curprev 19:4519:45, 25 March 2020‎ imported>Thcipriani‎ 23,915 bytes +257‎ →‎Update deploy notes

curprev 16:2916:29, 20 March 2020‎ imported>Krinkle‎ 23,658 bytes −94‎ merged dash

curprev 19:1819:18, 10 March 2020‎ imported>Brennen Bearnes‎ 23,752 bytes +17‎ →‎Sync to cluster and verify on testwiki: udpate timings for initial scap sync

curprev 12:4612:46, 4 March 2020‎ imported>Lars Wirzenius‎ 23,735 bytes +453‎ →‎Update roadmap: add note to kill ssh-agent at the end of the day

curprev 15:3515:35, 16 January 2020‎ imported>Lars Wirzenius‎ 23,282 bytes +423‎ →‎tmux or screen: add ssh-agent instructions

curprev 15:0815:08, 14 January 2020‎ imported>Jforrester‎ 22,859 bytes +199‎ →‎Before the deploy window: + merge your patch

curprev 17:3017:30, 10 January 2020‎ imported>Thcipriani‎ 22,660 bytes −2,311‎ Rearrange some things to favor cutting the branch locally.

curprev 19:3319:33, 7 January 2020‎ imported>Jforrester‎ 24,971 bytes −560‎ →‎Create the new branch in Gerrit: Per Tyler, this shouldn't be an issue now.

curprev 11:3011:30, 17 December 2019‎ imported>Jforrester‎ m 25,531 bytes +6‎ →‎Create the new branch in Gerrit: Fix directory path

curprev 19:0019:00, 10 December 2019‎ imported>Jforrester‎ m 25,525 bytes +703‎ →‎Create the new branch in Gerrit: Make the example use 1.34.0-wmf.0 for consistency

curprev 20:0820:08, 26 November 2019‎ imported>Brennen Bearnes‎ 24,822 bytes +163‎ →‎Places to Watch for Breakage: add mwlog1001 / logspam-watch

curprev 16:3216:32, 31 October 2019‎ imported>Brennen Bearnes‎ 24,659 bytes +1,572‎ Add basic pairing documentation.

curprev 19:0919:09, 8 October 2019‎ imported>Dduvall‎ 23,087 bytes 0‎ →‎Wednesday: group0 to group1 deploy: 1.35

curprev 20:2520:25, 1 October 2019‎ imported>Jforrester‎ m 23,087 bytes −417‎ →‎Before the deploy window: Fix wording.

curprev 14:0214:02, 27 August 2019‎ imported>Zfilipin‎ 23,504 bytes +229‎ →‎Sync to cluster and verify on testwiki: git diff

curprev 16:5716:57, 26 August 2019‎ imported>Zfilipin‎ 23,275 bytes −111‎ →‎If the train is blocked: -wikitech-ambassadors (decided during #releng team meeting)

curprev 13:5313:53, 20 August 2019‎ imported>Zfilipin‎ 23,386 bytes +503‎ →‎Apply security patches: for extension

curprev 19:4619:46, 30 July 2019‎ imported>Thcipriani‎ 22,883 bytes −53‎ →‎If the train is blocked: no such list!

curprev 13:0713:07, 24 July 2019‎ imported>Lars Wirzenius‎ 22,936 bytes +85‎ →‎Wednesday: group0 to group1 deploy: add time estimate

curprev 13:1513:15, 23 July 2019‎ imported>Lars Wirzenius‎ 22,851 bytes +415‎ →‎Switch group0 wikis to [VERSION]: Clarify what needs to be done

curprev 12:4212:42, 16 July 2019‎ imported>Hashar‎ 22,436 bytes +86‎ →‎Clean up old stuff

curprev 21:2021:20, 9 July 2019‎ imported>Thcipriani‎ m 22,350 bytes +74‎ →‎Rollback: Add magic CR+2 to rollback

curprev 16:4916:49, 17 June 2019‎ imported>Pmiazga‎ 22,276 bytes +179‎ Added link to MinervaClientError Grafana link. This can be used to verify that JS error rate is within the trend.

curprev 10:3610:36, 28 May 2019‎ imported>Zfilipin‎ 22,097 bytes +2,302‎ →‎Clean up old stuff: 1.33 > 1.34

curprev 20:3820:38, 9 January 2019‎ imported>Dduvall‎ 19,795 bytes +154‎ →‎Places to Watch for Breakage: Added link to Frontend Responses NGINX vs Varnish dashboard

curprev 15:3315:33, 12 December 2018‎ imported>Zfilipin‎ 19,641 bytes −38‎ →‎Incident documentation: Use Create report form to create a new page

curprev 15:5715:57, 11 December 2018‎ imported>Zfilipin‎ 19,679 bytes −62‎ 1.32 > 1.33

curprev 17:2417:24, 30 October 2018‎ imported>Thcipriani‎ m 19,741 bytes +18‎ →‎Clone new branch: you don't need to create a directory, scap prep creates it

curprev 16:2516:25, 25 September 2018‎ imported>Zfilipin‎ 19,723 bytes +210‎ →‎Clean up old stuff: simple and fancy way of finding old branches

curprev 17:0317:03, 28 August 2018‎ imported>Dduvall‎ 19,513 bytes +8,437‎ →‎Clean up old stuff: Tweaked php- directory listing command

curprev 20:5220:52, 6 March 2018‎ imported>Thcipriani‎ 11,076 bytes −1‎ →‎Update roadmap: we're on 1.31 now

curprev 16:4916:49, 12 December 2017‎ imported>Chad‎ 11,077 bytes −219‎ →‎Apply security patches: This should automatically happen as part of scap prep

curprev 16:4116:41, 19 September 2017‎ imported>Chad‎ 11,296 bytes −67‎ →‎Create patches to update wikiversions.json: php- prefixes are le dumb

curprev 05:4505:45, 29 August 2017‎ imported>Chad‎ 11,363 bytes 0‎ →‎Clean up old stuff: 5 weeks is 35 days, we can prune 5 days before that

curprev 18:5218:52, 15 August 2017‎ imported>Chad‎ 11,363 bytes +36‎ →‎Thursday: group{0,1} to all deploy: Collapse giant wall of text

curprev 13:3913:39, 26 May 2017‎ imported>Thcipriani‎ 11,327 bytes +530‎ Add rollback policy

curprev 19:0719:07, 23 May 2017‎ imported>Thcipriani‎ 10,797 bytes −1‎ →‎Sync to cluster and verify on testwiki: seerver -> server

curprev 16:5916:59, 27 April 2017‎ imported>Chad‎ 10,798 bytes −5‎ →‎Clean up old stuff: Swapped logic --keep-static for --delete

curprev 21:2521:25, 4 April 2017‎ imported>Chad‎ 10,803 bytes −84‎ →‎Clean up old stuff: Really, you should clean stuff up. It shaves off 5+ minutes from the sync in the next step

curprev 04:4104:41, 22 March 2017‎ imported>Chad‎ m 10,887 bytes −1‎ →‎Wait for deploy window: It shouldn't take over an hour and a half, typically

curprev 23:4723:47, 9 February 2017‎ imported>Chad‎ 10,888 bytes +228‎ →‎Clean up old stuff: Clarify what to do

curprev 18:4418:44, 3 January 2017‎ imported>Thcipriani‎ 10,660 bytes −88‎ →‎Clone new branch: Use scap plugins to checkout new branch

curprev 08:0408:04, 22 December 2016‎ imported>Mainframe98‎ m 10,748 bytes −1‎ →‎Update deploy notes: typofix

curprev 19:4519:45, 5 December 2016‎ imported>Chad‎ 10,749 bytes −1,273‎ →‎Clean up old stuff: Nice and easy

curprev 18:2218:22, 29 November 2016‎ imported>Chad‎ 12,022 bytes −14‎ →‎Update deploy notes: lol ports

curprev 20:3620:36, 23 November 2016‎ imported>Chad‎ 12,036 bytes −3‎ →‎Remove clones of expired branches: weeks, not branch #s. It's about time.

curprev 20:0020:00, 1 November 2016‎ imported>Thcipriani‎ 12,039 bytes 0‎ →‎Update roadmap

curprev 17:5217:52, 25 October 2016‎ imported>Chad‎ 12,039 bytes −48‎ More sillies

curprev 19:1819:18, 1 September 2016‎ imported>Hashar‎ 12,087 bytes −78‎ →‎Thursday: group{0,1} to all deploy

curprev 19:4419:44, 31 August 2016‎ imported>Hashar‎ m 12,165 bytes −80‎ →‎Wednesday: group0 to group1 deploy: update deploy-promote doc. It now CR+2

curprev 19:0219:02, 25 August 2016‎ imported>Hashar‎ m 12,245 bytes +24‎ →‎Thursday: group{0,1} to all deploy: refresh deploy-promote all output

curprev 16:5016:50, 24 August 2016‎ imported>Chad‎ 12,221 bytes +132‎ Group the cleanup stages

curprev 00:2200:22, 10 August 2016‎ imported>20after4‎ 12,089 bytes +223‎ mention delete-stale-branch script

curprev 19:5019:50, 28 July 2016‎ imported>Thcipriani‎ 11,866 bytes +2,001‎ →‎Thursday: group{0,1} to all deploy

curprev 19:4419:44, 26 July 2016‎ imported>Thcipriani‎ 9,865 bytes −1‎ →‎Purge localization cache for now unused versions: use scap subcommands

curprev 19:1219:12, 19 July 2016‎ imported>Chad‎ 9,866 bytes −366‎ →‎Tuesday: New branch creation and deploy: Use HTTPS not SSH

curprev 16:5216:52, 13 July 2016‎ imported>Chad‎ 10,232 bytes 0‎ →‎Tuesday: New branch creation and deploy: Move update deploy notes to prior to the window. There's no need to wait and no point in sending people to a broken wikipage if you're running late.

curprev 21:5521:55, 11 July 2016‎ imported>Chad‎ 10,232 bytes −16‎ Undo - far too optimistic of a train ride :p

curprev 13:3713:37, 14 June 2016‎ imported>Hashar‎ m 10,248 bytes +16‎ switch to a nicer train instead of the infamous train wreckage

curprev 19:5519:55, 7 June 2016‎ imported>Thcipriani‎ 10,232 bytes +10‎ →‎Switch group0 wikis to VERSION: use scap subcommands for sync-wikiversions

curprev 22:2722:27, 31 May 2016‎ imported>Thcipriani‎ 10,222 bytes −512‎ →‎Update roadmap: 1.28 roadmap

curprev 16:5316:53, 12 April 2016‎ imported>Chad‎ 10,734 bytes −107‎ →‎Remove symlinks to expired branches: static isn't tracked there anymore and doesn't need manual rm.

curprev 17:5417:54, 6 April 2016‎ imported>Dduvall‎ 10,841 bytes +232‎ →‎Apply security patches: Cleared up some documentation around applying security patches

curprev 20:3920:39, 8 March 2016‎ imported>20after4‎ 10,609 bytes −426‎ note about pushInsteadOf (use ssh instead of https for pushes)

curprev 20:0920:09, 2 March 2016‎ imported>Legoktm‎ 11,035 bytes +68‎ add a picture of a train, per _joe_

curprev 15:4315:43, 16 February 2016‎ imported>Hashar‎ m 10,967 bytes +989‎ →‎Create the new branch in gerrit: no more need root

curprev 18:3918:39, 9 February 2016‎ imported>Chad‎ 9,978 bytes −368‎ →‎Create symlink patch for common/docroot: rm obsolete section

curprev 07:4007:40, 4 February 2016‎ imported>Florianschmidtwelzow‎ m 10,346 bytes +134‎ →‎Update roadmap: {{done}} doesn't work anymore :)

curprev 15:3515:35, 2 February 2016‎ imported>Hashar‎ m 10,212 bytes +37‎ →‎Create symlink patch for common/docroot: no more needed

curprev 21:1521:15, 1 February 2016‎ imported>Hashar‎ 10,175 bytes +196‎ mention integration-make-wmf-branch

curprev 17:5417:54, 26 January 2016‎ imported>Dduvall‎ 9,979 bytes 0‎ →‎Update roadmap: Point to the latest minor version roadmap

curprev 00:1800:18, 20 January 2016‎ imported>Dduvall‎ 9,979 bytes +419‎ →‎Update deploy notes: Deploy note generation won't work without the previous branched checked out as well

curprev 16:4616:46, 13 January 2016‎ imported>Thcipriani‎ 9,560 bytes −869‎ Update to include the use of deploy-promote, add day-by-day breakdown

curprev 17:2517:25, 15 December 2015‎ imported>Thcipriani‎ 10,429 bytes +467‎ Security patch instructions, Change in group promotion.

curprev 22:5722:57, 14 November 2015‎ imported>Reedy‎ 9,962 bytes +57‎ →‎Remove left over files from expired branches: code

curprev 03:2503:25, 23 October 2015‎ imported>BryanDavis‎ 9,905 bytes +17‎ →‎Create the new branch in gerrit: Keep MW from autolinking the ssh:// URI for git-clone

curprev 07:0607:06, 19 August 2015‎ imported>Greg Grossmeier‎ 9,888 bytes −90‎ Add warning about make-wmf-branch and remove references to days of the week

curprev 18:1218:12, 19 May 2015‎ imported>20after4‎ 9,978 bytes +9,978‎ now we do have a group1 dblist, so the process is simplified

Retrieved from "https://wikitech-static.wikimedia.org/wiki/Heterogeneous_deployment/Train_deploys"