You are browsing a read-only backup copy of Wikitech. The live site can be found at wikitech.wikimedia.org

Release Engineering/SAL: Difference between revisions

From Wikitech-static
Jump to navigation Jump to search
imported>Stashbot
(taavi: restart trafficserver-tls on deployment-cache-text06)
imported>Stashbot
(hashar: Reloaded Zuul for https://gerrit.wikimedia.org/r/c/integration/config/+/923647)
 
(304 intermediate revisions by 2 users not shown)
Line 1: Line 1:
== 2022-02-19 ==
== 2023-05-26 ==
* 12:19 taavi: restart trafficserver-tls on deployment-cache-text06
* 15:12 hashar: Reloaded Zuul for https://gerrit.wikimedia.org/r/c/integration/config/+/923647
* 02:15 James_F: Zuul: [design/codex] Publish the Netlify preview on every patch for [[phab:T293705|T293705]]
* 00:35 James_F: Manually re-triggered a build of the docs of Codex (via `zuul-test-repo design/codex postmerge`) now that we actually set the environment vars for [[phab:T293705|T293705]]


== 2022-02-18 ==
== 2023-05-25 ==
* 22:54 James_F: Zuul: [branchdeploy-codex-node14-npm-docker] Create as experimental for [[phab:T293705|T293705]]
* 17:30 hashar: gerrit2002 replication eventually has completed at some point: `Replication completed with some errors!` # [[phab:T334521|T334521]]
* 22:14 James_F: Jenkins: Defined BRANCHDEPLOY_AUTH_TOKEN_codex and BRANCHDEPLOY_SITE_ID_codex secrets for [[phab:T293705|T293705]]
* 16:44 hashar: gerrit2002: creating lucene indices: `java -jar /var/lib/gerrit2/review_site/bin/gerrit.war reindex --index groups` #  [[phab:T334521|T334521]]
* 13:44 hashar: Reloading Zuul for https://gerrit.wikimedia.org/r/c/integration/config/+/763724 [[phab:T301453|T301453]]
* 16:37 hashar: ssh -p 29418 gerrit.wikimedia.org replication start --url gerrit2002 --all --wait  # [[phab:T334521|T334521]]
* 09:21 hashar: Reloading Zuul for {{Gerrit|I1494abb5e9e28da951ffb72154a074a16a0f8381}}
* 16:27 brennen: phab1004: sudo systemctl restart php7.3-fpm.service && sudo systemctl restart phd


== 2022-02-17 ==
== 2023-05-24 ==
* 21:48 brennen: added Dzahn (mutante) to acl*repository-admins on phabricator
* 10:09 eoghan: Switching doc.wikimedia.org from doc1002 -> doc1003, [[phab:T319477|T319477]]
* 15:58 zabe: root@deployment-cache-upload06:~# touch /srv/trafficserver/tls/etc/ssl_multicert.config && systemctl reload trafficserver-tls.service # [[phab:T301995|T301995]]
* 09:24 Daimona: Creating new DB table on beta wikishared for the CampaignEvents extension # [[phab:T336362|T336362]]
* 13:35 hashar: Reloading Zuul for https://gerrit.wikimedia.org/r/c/integration/config/+/763207
* 13:20 Reedy: Reloading Zuul to deploy https://gerrit.wikimedia.org/r/763458
* 11:12 hashar: Bringing deployment-deploy03 back
* 11:07 hashar: Disabled deployment-deploy03 Jenkins agent in order to revert some mediawiki/core patch and test the outcome


== 2022-02-16 ==
== 2023-05-23 ==
* 18:20 hashar: Tag Quibble 1.4.1 @ {{Gerrit|d4bd2801de}} # [[phab:T300301|T300301]]
* 21:48 brennen: https://phab.wmflabs.org/ now running phorge 2023.17
* 16:42 dancy: Updating to scap 4.3.1-1+0~20220216163646.173~1.gbp823710?in beta
* 13:54 TheresNoTime: (deployment-prep) `samtar@deployment-mwmaint02:~$ mwscript resetUserEmail.php --wiki=metawiki Diskdance [snip]` [[phab:T337172|T337172]]
* 12:55 jelto: apply gitlab-settings to gitlab-prod-1001.devtools.eqiad1.wikimedia.cloud
* 10:09 hashar: Reloading Zuul for {{Gerrit|I997fee0f160ca3049b8085879831bfe175096ced}}
* 09:59 hashar: Reloading Zuul for {{Gerrit|I2ffa016563ad37f1e7c13dcce81deb8ab411c9e2}}


== 2022-02-15 ==
== 2023-05-21 ==
* 21:12 dancy: rebooting deployment-mediawiki12.deployment-prep.eqiad1.wikimedia.cloud to try to revive beta wikis
* 10:54 Lucas_WMDE: aborted stuck job https://integration.wikimedia.org/ci/job/wmf-quibble-selenium-php74-docker/37265/console which was blocking gate-and-submit
* 20:59 dancy: Killed runaway puppet agent on deployment-mediawiki11.deployment-prep.eqiad1.wikimedia.cloud
* 16:24 hashar: Restarting CI Jenkins for plugins updates
* 16:21 hashar: Upgrading Jenkins plugins on releases Jenkins
* 16:06 hashar: Rollback fresh-test Jenkins job to the version intended to run on integration-agent-qemu-1001
* 15:26 hashar: Reloading Zuul for {{Gerrit|If80b4b4cfa5c1a869ceb220f5b11c272b384a721}}


== 2022-02-14 ==
== 2023-05-17 ==
* 16:28 dancy: Updating scap in beta cluster to 4.3.1-1+0~20220211225318.167~1.gbp315b2c
* 09:53 hashar: integration-agent-docker-1029: erased a few files under `/srv`. I suspect the 36GBytes partition is not large enough nowadays for multiple concurrent builds of MediaWiki # [[phab:T336840|T336840]]
* 16:16 Amir1: Reloading Zuul to deploy  https://gerrit.wikimedia.org/r/c/integration/config/+/762471
* 03:12 brennen: gitlab-webhooks restart after failed webhook requests (presumably earlier outage)
* 15:41 hashar: Messing up with fresh-test Jenkns job to polish up Qemu / qcow2 integration
* 14:26 jnuche: Jenkins upgrade complete [[phab:T301361|T301361]]
* 13:54 jnuche: Jenkins contint instances are going to be restarted soon


== 2022-02-12 ==
== 2023-05-16 ==
* 18:22 urbanecm: deployment-prep: reboot deployment-eventgate-3 ([[phab:T289029|T289029]])
* 15:11 hashar: Killing stall https://integration.wikimedia.org/ci/job/castor-save-workspace-cache/ job
* 15:04 hashar: CI Jenkins: updating IRC plugin from 2.42 to 3.829.v12d4b_d1f7650  and instant-messaging plugin from 1.48 to 2.666.va_6c1e97cc252  # [[phab:T283009|T283009]]
* 11:30 hashar: Reloaded Zuul for https://gerrit.wikimedia.org/r/c/integration/config/+/919873 {{!}} [[phab:T336218|T336218]]
* 10:55 taavi: update operations-puppet-tests-buster-docker jjb job for https://gerrit.wikimedia.org/r/c/integration/config/+/914785


== 2022-02-10 ==
== 2023-05-12 ==
* 17:29 jeena: reloading Zuul to deploy https://gerrit.wikimedia.org/r/c/integration/config/+/761602
* 15:52 hashar: Reloaded Zuul for https://gerrit.wikimedia.org/r/c/integration/config/+/919347/ {{!}} [[phab:T333861|T333861]]


== 2022-02-09 ==
== 2023-05-11 ==
* 15:22 taavi: deleted shutoff deployment-mx02
* 21:20 RhinosF1: beta scap is paused while MatmaRex tests some changes
* 20:41 thcipriani: pausing beta-code-update-eqiad/beta-mediawiki-config-update-eqiad/beta-scap-sync-world for debugging train
* 16:25 hashar: Reloading Zuul
* 07:19 hashar: Reloaded Zuul for https://gerrit.wikimedia.org/r/c/integration/config/+/918970 {{!}} [[phab:T333125|T333125]]
* 07:17 hashar: Reloaded Zuul for https://gerrit.wikimedia.org/r/c/integration/config/+/918474 {{!}} [[phab:T333125|T333125]]


== 2022-02-08 ==
== 2023-05-10 ==
* 17:34 taavi: remove scap from deployment-kafka-main/jumbo
* 23:19 brennen: reconfigured and restarted gitlab-webhooks to use CodeReviewBot for messages instead of gerritbot ([[phab:T327424|T327424]])
* 16:23 taavi: hard reboot misbehaving deployment-echostore01
* 13:39 taavi: delete /srv/mediawiki-staging.save on deployment-deploy03


== 2022-02-07 ==
== 2023-05-09 ==
* 20:55 taavi: added Zabe as member of the deployment-prep project [[phab:T301179|T301179]]
* 16:36 hashar: zuul enqueue --trigger gerrit --pipeline postmerge --project analytics/datahub --change 916483,4
* 18:19 Reedy: Reloading Zuul to deploy https://gerrit.wikimedia.org/r/760550
* 13:56 hashar: Reloaded Zuul for https://gerrit.wikimedia.org/r/c/integration/config/+/917868 {{!}} [[phab:T329514|T329514]]
* 09:06 hashar: Reloaded Zuul for https://gerrit.wikimedia.org/r/c/integration/config/+/916513/ and https://gerrit.wikimedia.org/r/c/integration/config/+/916793/
* 08:04 hashar: Reloading Zuul to enable Sonar Codehhealth on TitleBlacklist, TextExtracts, TemplateData and SyntaxHighlight_GeSHI Mediawiki extensions # [[phab:T321837|T321837]]


== 2022-02-04 ==
== 2023-05-05 ==
* 00:21 Krinkle: Updating docker-pkg files on contint primary for https://gerrit.wikimedia.org/r/759622
* 23:39 Krinkle: Reloading Zuul to deploy  https://gerrit.wikimedia.org/r/916634
* 17:45 Krinkle: Reloading Zuul to deploy https://gerrit.wikimedia.org/r/916527


== 2022-02-03 ==
== 2023-05-04 ==
* 18:41 taavi: deployment-prep: route /w/api.php to deployment-mediawiki11, trying to reduce load on a single server
* 13:51 _joe_: Updating docker-pkg files on contint primary for  https://gerrit.wikimedia.org/r/915652
* 14:53 hashar: Building Docker images for Quibble 1.4.0 (prepared by kostajh)
* 12:00 _joe_: Updating docker-pkg files on contint primary for  https://gerrit.wikimedia.org/r/914782
* 13:51 kostajh: Tag Quibble 1.4.0 @ {{Gerrit|4231bc2832395d94e29a332fe8d863301a0cd441}} # [[phab:T300340|T300340]] [[phab:T291549|T291549]] [[phab:T225730|T225730]]


== 2022-02-02 ==
== 2023-05-03 ==
* 16:50 dancy: Upgrading scap to 4.2.2-1+0~20220202164708.157~1.gbp376a16 in beta.
* 09:25 hashar: Reloaded Zuul for https://gerrit.wikimedia.org/r/914715
* 16:12 dancy: Upgrading scap to 4.2.2-1+0~20220201161808.156~1.gbp1c1c64 in beta


== 2022-02-01 ==
== 2023-05-02 ==
* 17:27 addshore: Reloading Zuul to deploy https://gerrit.wikimedia.org/r/c/integration/config/+/734654
* 16:55 dancy: scap version "4.52.0" installed on 15 hosts
* 00:34 tgr: deployment-pre un-cherry-picked gerrit 758584 from beta puppetmaster, patch is now merged [[phab:T300591|T300591]]
* 08:15 hashar: Reloaded Zuul to enable Sonar Codehealth on CategoryTree https://gerrit.wikimedia.org/r/909331 and PageImages https://gerrit.wikimedia.org/r/909330 # [[phab:T321837|T321837]]
* 00:12 tgr: deployment-prep cherry-picked gerrit 758584 to beta puppetmaster [[phab:T300591|T300591]]
* 08:14 hashar: Reloaded Zuul for https://gerrit.wikimedia.org/r/913541 https://gerrit.wikimedia.org/r/913925 https://gerrit.wikimedia.org/r/913191


== 2022-01-31 ==
== 2023-05-01 ==
* 19:01 James_F: Re-configured Jenkins job mediawiki-i18n-check-docker to {{Gerrit|9e3ea96c548d7a84be763d38c2d118bc861cf189}} for [[phab:T222216|T222216]]
* 17:20 brennen: experimenting with ldap user sync on gitlab.devtools
* 10:49 hashar: Added integration-agent-qemu-1003 with label `Qemu` # [[phab:T284774|T284774]]


== 2022-01-28 ==
== 2023-04-28 ==
* 21:45 taavi: running recountCategories.php on all beta wikis per [[phab:T299823|T299823]]#7652496
* 19:56 dancy: Ran `git submodule sync` as jenkins-deploy in deployment-deploy03:/srv/mediawiki-staging/php-master/extensions for  [[phab:T335602|T335602]]
* 14:27 hashar: taking heapdump  of CI Jenkins `sudo -u jenkins /usr/lib/jvm/java-11-openjdk-amd64/bin/jmap -dump:live,format=b,file=/var/lib/jenkins/202201281527.hprof xxxx`


== 2022-01-27 ==
== 2023-04-27 ==
* 20:26 hashar: Successfully published image docker-registry.discovery.wmnet/releng/logstash-filter-verifier:0.0.2  # [[phab:T299431|T299431]]
* 17:10 James_F: Zuul: [wvui] Mark repo as archived for [[phab:T310244|T310244]]
* 19:34 Amir1: Reloading Zuul to deploy 757464
* 16:00 hashar: Pooling back agents 1035 1036 1037 1038 , they could not connect due to ssh host mismatch since yesterday they all got attached to instance 1033 and accepted that host key # [[phab:T300214|T300214]]
* 09:16 hashar: integration: cumin --force 'name:docker' 'apt install rsync'  # [[phab:T300236|T300236]]
* 09:05 hashar: integration: cumin --force 'name:docker' 'apt install rsync'  # [[phab:T300214|T300214]]
* 00:24 thcipriani: restarting jenkins


== 2022-01-26 ==
== 2023-04-26 ==
* 20:29 hashar: Completed migration of integration-agent-docker-XXXX instances from Stretch to Bullseye - [[phab:T252071|T252071]]
* 16:51 James_F: Zuul: Add Kevin Wilke to CI allow list
* 19:55 hashar: deleting integration-agent-docker-1014 which only has the `codehealth` label. A short live experiment no more used since October 2nd 2019 - https://gerrit.wikimedia.org/r/c/integration/config/+/540362 - [[phab:T234259|T234259]]
* 18:56 hashar: integration: pooled in Jenkins a few more Bullseye docker agents for [[phab:T252071|T252071]]
* 18:17 hashar: integration: pooled in Jenkins a few Bullseye docker agent for [[phab:T252071|T252071]]
* 16:45 hashar: integration: creating  integration-agent-docker-1023  based on buster with new flavor `g3.cores8.ram24.disk20.ephemeral60.4xiops` # [[phab:T290783|T290783]]


== 2022-01-25 ==
== 2023-04-25 ==
* 20:17 James_F: Zuul: [mediawiki/extensions/CentralAuth] Drop UserMerge dependency
* 21:23 mutante: gerrit1003 - sudo -u gerrit2 /usr/bin/scap deploy-local --repo gerrit/gerrit -D log_json:False  (manually it works, but that's the same command that puppet is supposed to run !?) - [[phab:T257317|T257317]] [[phab:T326368|T326368]]
* 16:39 James_F: Zuul: Mark Math extension as now tarballed in parameter_functions for [[phab:T232948|T232948]]
* 15:57 James_F: Zuul: [mediawiki/extensions/Math] Add Math to the main gate for [[phab:T232948|T232948]]
* 13:44 hashar: Jenkins CI: added Logger https://integration.wikimedia.org/ci/log/ProcessTree%20-%20T299995/ to watch `hudson.util.ProcessTree` for [[phab:T299995|T299995]]
* 10:02 hashar: integration: removing usage of `role::ci::slave::labs::docker::docker_lvm_volume` in Horizon following https://gerrit.wikimedia.org/r/c/operations/puppet/+/755948  . Docker role instances now always have a 24G partition for Docker
* 09:59 hashar: integration-agent-qemu-1001: resized /srv to 100% disk free: `lvextend -r -l +100%FREE /dev/mapper/vd-second--local--disk` # [[phab:T299996|T299996]]
* 09:59 hashar: integration-agent-qemu-1001: resizing /dev/mapper/vd-second--local--disk (/srv) to 20G : `resize2fs -p /dev/mapper/vd-second--local--disk 20G` # [[phab:T299996|T299996]]
* 09:51 hashar: integration-agent-qemu-1001: resizing /dev/mapper/vd-second--local--disk (/srv) to 20G : `resize2fs -p /dev/mapper/vd-second--local--disk 20G`
* 09:51 hashar: integration-agent-qemu-1003: nuked /dev/vd/second-local-disk and /srv to make room for a docker logical volume. That has fixed puppet  [[phab:T299996|T299996]]
* 09:22 Reedy: unblocked beta again
* 07:32 Krinkle: integration-castor03:/srv/jenkins-workspace/caches$ sudo rm -rf castor-mw-ext-and-skins/


== 2022-01-24 ==
== 2023-04-24 ==
* 21:44 Reedy: unstick beta ci jobs
* 21:37 TheresNoTime: (deployment-prep) Add volume to `deployment-mwmaint02` (`mwmaint`) and moved `/srv` - [[phab:T327853|T327853]]
* 21:19 jeena: reloading Zuul to deploy https://gerrit.wikimedia.org/r/c/integration/config/+/756523
* 20:36 Krinkle: Reloading Zuul to deploy https://gerrit.wikimedia.org/r/c/integration/config/+/756139
* 17:28 hashar: Nuke castor caches on integration-castor03 : sudo rm -fR /srv/jenkins-workspace/caches/castor-mw-ext-and-skins/master/<nowiki>{</nowiki>quibble-vendor-mysql-php72-selenium-docker,wmf-quibble-selenium-php72-docker<nowiki>}</nowiki>  # [[phab:T299933|T299933]]
* 17:28 hashar: Nuke castor caches on integration-castor03 : sudo rm -fR /srv/jenkins-workspace/caches/castor-mw-ext-and-skins/master/<nowiki>{</nowiki>quibble-vendor-mysql-php72-selenium-docker,wmf-quibble-selenium-php72-docker<nowiki>}</nowiki>


== 2022-01-22 ==
== 2023-04-23 ==
* 13:40 taavi: apply [[phab:T299827|T299827]] on deployment-prep centralauth database
* 16:55 Krinkle: Fix profile::tlsproxy::envoy::global_cert_name in Horizon for webperf host to use '%<nowiki>{</nowiki>facts.fqdn<nowiki>}</nowiki>' instead of performance.discovery.wmnet as the latter doesn't resolve  / would be an invalid cert for https://deployment-webperf21, ref [[phab:T291015|T291015]]
* 11:44 taavi: restart varnish-frontend.service on deployment-cache-upload06 to clear puppet agent failure alerts


== 2022-01-21 ==
== 2023-04-22 ==
* 18:12 taavi: resolved merge conflicts on deployment-puppetmaster04
* 21:50 hashar: Reloaded Zuul for https://gerrit.wikimedia.org/r/c/integration/config/+/908941
* 15:50 hashar: integration-puppetmaster-02: deleted 2021 snapshot tags in puppet repo and ran `git gc --prune=now`
* 21:47 hashar: Reloaded Zuul for https://gerrit.wikimedia.org/r/c/integration/config/+/909624
* 19:35 Krinkle: Create excimer_ui_server db user in Beta Cluster on deployment-db13 based on prod grants. Password stored in deployment-puppetmaster04:/var/lib/git/labs/private/ (passwords::excimer_ui_server::$excimer_db_pass). Picked db13 because recommendationapi is here (also prod m2), and because mdb (created for this purpose originally) appears broken since several OS iterations (likely forgotten due to unusual name) [[phab:T301637|T301637]], [[phab:T331956|T331956]]
* 18:05 Krinkle: Fix database hostname dns error at https://performance.wikimedia.beta.wmflabs.org/xhgui/, switch from mdb01 to mdb02, ref [[phab:T301637|T301637]]
* 18:00 Krinkle: Move deployment-xhgui03 config from to deployment-xhgui prefix, https://gerrit.wikimedia.org/g/cloud/instance-puppet/+/1d03d4cf84a148bff7e055d9939c44f30c618d85/deployment-prep/deployment-xhgui03.deployment-prep.eqiad1.wikimedia.cloud.yaml https://gerrit.wikimedia.org/r/plugins/gitiles/cloud/instance-puppet/+/ab1c9d2968ba3c292b81ba76f8c0775151630f94%5E%21/, ref [[phab:T301637|T301637]]


== 2022-01-20 ==
== 2023-04-21 ==
* 20:24 James_F: Zuul: [Kartographer] Add parsoid as dependency for CI jobs
* 10:04 Lucas_WMDE: `sudo systemctl reload nginx` on deployment-elastic09, deployment-elastic10, deployment-elastic11 # [[phab:T335181|T335181]]
* 20:22 James_F: Zuul: [DiscussionTools] Add Gadgets as dependency for Phan jobs
* 20:04 dancy: Jenkins beta jobs are back online, using scap prep auto now.
* 19:19 dancy: Pausing beta Jenkins jobs to make a copy of /srv/mediawiki-staging in preparation for testing
* 19:10 dancy: Unpacking scap (4.1.1-1+0~20220120175448.144~1.gbp517f9d) over (4.1.1-1+0~20220113154148.133~1.gbp6e3a17) on deploy03
* 18:07 hashar: Updating Quibble jobs to have MediaWiki files written on the hosts /srv partition (38G) instead of inside the container which ends in /var/lib/docker (24G) https://gerrit.wikimedia.org/r/755743  # [[phab:T292729|T292729]]
* 16:31 hashar: Rebalancing /var/lib/docker and /srv partitions on CI agents {{!}} https://gerrit.wikimedia.org/r/755713
* 12:12 hashar: contint2001 deleting all the Docker images (they will be pulled as needed)
* 12:10 hashar: contint2001 : docker container prune && docker image prune
* 12:07 hashar: contint1001 deleting all the Docker images (they will be pulled as needed)
* 12:04 hashar: contint1001 `docker image prune`
* 11:51 hashar: Cleaning very old Docker images on contint1001.wikimedia.Org


== 2022-01-19 ==
== 2023-04-20 ==
* 18:20 hashar: Adding  https://integration.wikimedia.org/ci/computer/contint1001/ back to the pool again
* 09:59 taavi: update helm-lint jjb job for https://gerrit.wikimedia.org/r/c/integration/config/+/910433/
* 17:31 hashar: Adding  https://integration.wikimedia.org/ci/computer/contint1001/ back to the pool after the machine got powercycled # [[phab:T299542|T299542]]
* 09:13 joe: Updating docker-pkg files on contint primary for https://gerrit.wikimedia.org/r/909996
* 10:38 Reedy: kill some stuck jobs [[phab:T299485|T299485]]


== 2022-01-18 ==
== 2023-04-19 ==
* 19:56 hashar: building Docker images for https://gerrit.wikimedia.org/r/754951
* 13:59 James_F: Beta: Setting `namespace: repos/abstract-wiki/wikifunctions image_name: function-orchestrator` on deployment-docker-wikifunctions01 for [[phab:T334998|T334998]]
* 18:01 taavi: added ryankemper as a member of the deployment-prep project
* 10:56 joe: Updating docker-pkg files on contint primary for helm-linter
* 15:00 hashar: Updating Jenkins jobs for Quibble 1.3.0  with proper PHP version in the images # [[phab:T299389|T299389]]
* 11:39 hashar: Rolling back Quibble 1.3.0 jobs due to php configuration files with at least releng/quibble-buster73:1.3.0  # [[phab:T299389|T299389]]
* 08:07 hashar: Updating Jenkins jobs for Quibble to pass `--parallel-npm-install` https://gerrit.wikimedia.org/r/c/integration/config/+/754569
* 08:02 hashar: Updating Jenkins jobs for Quibble 1.3.0


== 2022-01-17 ==
== 2023-04-18 ==
* 16:28 hashar: Building Quibble 1.3.0 Docker images
* 17:35 mutante: doc2001 - systemctl reset-failed - cleared monitoring for systemd state - remnants from PHP7.3 after upgrade to 7.4
* 16:16 hashar: Tagged Quibble 1.3.0 @ {{Gerrit|2b2c7f9a45}} # [[phab:T297480|T297480]] [[phab:T226869|T226869]] [[phab:T294931|T294931]]
* 17:08 James_F: Zuul, jjb: [mediawiki/services/function-orchestrator] Archive, moved to GitLab for [[phab:T334397|T334397]]
* 08:32 hashar: Refreshing all Jenkins jobs with jjb to take in account recent changes related to the Jinja2 docker macro


== 2022-01-14 ==
== 2023-04-17 ==
* 15:56 dancy: Reloading Zuul to deploy https://gerrit.wikimedia.org/r/c/integration/config/+/753981
* 13:37 James_F: Zuul: [mediawiki/services/function-schemata] Mark as archived for [[phab:T281500|T281500]]
* 14:59 hashar: Starting VM integration-agent-docker-1022 which was in shutdown state since December and is Bullseye based # [[phab:T290783|T290783]]
* 13:49 hashar: Restarting all CI Docker agents via Horizon to apply new flavor settings [[phab:T265615|T265615]] [[phab:T299211|T299211]]
* 01:47 dancy: revert to scap 4.1.1-1+0~20220113154148.133~1.gbp6e3a17 in beta


== 2022-01-13 ==
== 2023-04-12 ==
* 18:02 dancy: Updating scap to 4.1.1-1+0~20220113154506.135~1.gbp523480 on all beta hosts
* 15:39 jnuche: Updating docker-pkg files on contint primary for https://gerrit.wikimedia.org/r/908248
* 17:54 dancy: Reloading Zuul to deploy https://gerrit.wikimedia.org/r/753792
* 09:58 hashar: Reloaded Zuul for https://gerrit.wikimedia.org/r/c/integration/config/+/899523
* 16:27 dancy: testing scap prep auto on deployment-deploy03
* 15:52 dancy: Update scap to 4.1.1-1+0~20220113154506.135~1.gbp523480 on deployment-deploy03
* 11:27 hashar: Updating Jenkins job to normalize usage of `docker run --workdir` https://gerrit.wikimedia.org/r/c/integration/config/+/753457
* 10:52 hashar: Restarting Jenkins CI for plugins update
* 10:42 hashar: Applied Jenkins built-in node migration to CI Jenkins (`master` > `built-in` renaming) # [[phab:T298691|T298691]]
* 10:14 taavi: cancelled stuck deployment-prep jobs on jenkins


== 2022-01-12 ==
== 2023-04-10 ==
* 18:58 hashar: Applied plugins update to https://releases-jenkins.wikimedia.org/
* 20:00 thcipriani: restarting zuul due to due to stuck gerrit ssh-connections
* 18:44 thcipriani: restart zuul-merger


== 2022-01-11 ==
== 2023-04-09 ==
* 09:18 hashar: Updating all Jenkins jobs following recent "noop" refactorings
* 13:22 lucaswerkmeister: lucaswerkmeister@deployment-mwmaint02:~$ mwscript createAndPromote metawiki --custom-groups=oauthadmin --force 'Lucas Werkmeister' # made myself OAuth admin so I can manage the clients used to test m3api-oauth2


== 2022-01-10 ==
== 2023-04-06 ==
* 17:13 dancy: Update beta scap to 4.1.0-1+0~20220107203309.130~1.gbpcd0ace
* 19:49 James_F: Zuul: Add all @wikia/fandom domains to the CI allow list
* 14:01 James_F: Zuul: Add gate-and-submit-l10n to Isa for [[phab:T222291|T222291]]


== 2022-01-05 ==
== 2023-04-05 ==
* 19:15 taavi: run `sudo chown -R jenkins-deploy:wikidev public/dists/bullseye-deployment-prep/` on deployment-deploy03
* 18:05 James_F: Zuul: [mediawiki/extensions/EntitySchema] Add Wikibase dep, for [[phab:T333661|T333661]]
* 17:31 hashar: Deploying Zuul change https://gerrit.wikimedia.org/r/c/integration/config/+/751697  to get rid of the wmf-quibble-apache jobs # [[phab:T285649|T285649]]
* 18:05 James_F: Zuul: [mediawiki/extensions/SimilarEditors] Demote from WMF production, for [[phab:T331718|T331718]]
* 10:48 hashar: CI: switching MediaWiki selenium from php built-in server to Apache # https://gerrit.wikimedia.org/r/751697
* 09:44 hashar: Reloaded Zuul for https://gerrit.wikimedia.org/r/c/integration/config/+/905664
* 09:24 hashar: Updating Quibble jobs to use latest image (provides `quibble-with-apache` entrypoint) https://gerrit.wikimedia.org/r/c/integration/config/+/751685/


== 2022-01-04 ==
== 2023-04-04 ==
* 12:49 hashar: Reloading Zuul for "api-testing: rename jobs to shorter forms"  https://gerrit.wikimedia.org/r/751422
* 05:04 hashar: Reloaded Zuul for https://gerrit.wikimedia.org/r/c/integration/config/+/905262
* 09:48 hashar: Builder Quibble Docker images with Apache included https://gerrit.wikimedia.org/r/c/integration/config/+/748104
* 09:47 hashar: Reloading Zuul for "Add CentralAuth to phan dependency list for GrowthExperiments" https://gerrit.wikimedia.org/r/751383


== 2022-01-03 ==
== 2023-04-03 ==
* 14:37 hashar: Upgraded Java 11 on contint2001 && contint1001.  Restarted CI Jenkins.
* 14:14 James_F: Zuul: [mediawiki/extensions/ContentStabilization] Add BlueSpiceBookshelf dep
* 14:35 hashar: Upgraded Java 11 on releases1002 && releases2002
* 11:10 hashar: Switching Jenkins jobs to Quibble 1.5.4 {{!}} https://gerrit.wikimedia.org/r/905190
* 10:25 hashar: Building Docker images for Quibble 1.5.4 https://gerrit.wikimedia.org/r/905167
* 10:20 hashar: Tag Quibble 1.5.4 @ {{Gerrit|0a37ce9367672e973b49b8293f57ebffe40abdf6}} # [[phab:T332930|T332930]] [[phab:T331280|T331280]] [[phab:T333412|T333412]]
* 08:11 hashar: gtlab: runner-1030: running `docker volume prune`  to discard all volumes metadata after they have been manually deleted from `/var/lib/docker`  ( Reclaimed 13.92GB) {{!}} [[phab:T333586|T333586]]
* 08:11 hashar: gtlab: runner-1030: running `docker volume prune`  to discard all volumes metadata after they have been manually deleted from `/var/lib/docker`  ( Reclaimed 13.92GB) {{!}} [[phab:T33586|T33586]]
 
== 2023-03-31 ==
* 16:24 hashar: Reloaded Zuul for https://gerrit.wikimedia.org/r/c/integration/config/+/904818
* 16:20 hashar: Reloaded Zuul for https://gerrit.wikimedia.org/r/c/integration/config/+/904810
* 16:18 hashar: Reloaded Zuul for https://gerrit.wikimedia.org/r/c/integration/config/+/904805/
* 14:34 dwalden: (deployment-prep) `dwalden@deployment-mwmaint02:~$ mwscript maintenance/refreshLinks.php --wiki en_rtlwiki --category='Pages that use Phonos'` for [[phab:T327708|T327708]]
* 14:26 dwalden: (deployment-prep) `dwalden@deployment-mwmaint02:~$ mwscript maintenance/refreshLinks.php --wiki enwiki --category='Pages that use Phonos'` for [[phab:T327708|T327708]]
 
== 2023-03-29 ==
* 06:09 hashar: Reloaded Zuul for https://gerrit.wikimedia.org/r/903839
* 00:50 Krinkle: Reloading Zuul to deploy https://gerrit.wikimedia.org/r/903539
 
== 2023-03-23 ==
* 13:22 James_F: Gerrit: Deleting mediawiki/extensions/PageProperties duplicate 'main' branch, development work is in 'master'.
 
== 2023-03-22 ==
* 21:14 taavi: taavi@deployment-mwmaint02:~$ mwscript extensions/OATHAuth/maintenance/UpdateForMultipleDevicesSupport.php metawiki --force # [[phab:T242031|T242031]]
* 20:34 taavi: cat /srv/mediawiki/php-master/extensions/OATHAuth/sql/mysql/tables-generated.sql {{!}} sql centralauth --write # [[phab:T242031|T242031]]
 
== 2023-03-20 ==
* 21:43 brennen: phabricator: setting sbassett to administrator per [[phab:T331928|T331928]]
 
== 2023-03-19 ==
* 22:34 TheresNoTime: (beta) `samtar@deployment-kafka-logging01:~$ sudo systemctl restart kafka.service`, noticed beta-logs wasn't showing logs from ~14:00UTC in [[phab:T332507|T332507]]
* 22:10 TheresNoTime: (beta) `GRANT SELECT, INSERT, UPDATE, DELETE, CREATE, REFERENCES, INDEX, ALTER, CREATE TEMPORARY TABLES, LOCK TABLES, EXECUTE, CREATE VIEW, SHOW VIEW, CREATE ROUTINE, ALTER ROUTINE, EVENT, TRIGGER ON mainstash.* TO 'wikiadmin'@'172.16.%';` [[phab:T322469|T322469]]
* 14:43 hashar: deployment-prep: databases update hourly job times out, filed [[phab:T332507|T332507]]
 
== 2023-03-17 ==
* 23:00 urbanecm: deployment-prep: Reboot deployment-elastic10, deployment-elastic11 ([[phab:T332455|T332455]])
* 22:58 urbanecm: deployment-prep: Reboot deployment-elastic09 ([[phab:T332455|T332455]])
* 10:36 mutante: disabled phab user 'Cloudduck1233'
 
== 2023-03-16 ==
* 10:48 hashar: Updating all jobs to switch Castor from Stretch to Bullseye based image {{!}} https://gerrit.wikimedia.org/r/c/integration/config/+/899508/ {{!}} [[phab:T278203|T278203]]
* 10:41 hashar: Switching https://integration.wikimedia.org/ci/job/castor-save-workspace-cache/ to a Bullseye based image (was Stretch based) [[phab:T278203|T278203]]
* 10:41 hashar: Switching https://integration.wikimedia.org/ci/job/castor-save-workspace-cache/ to a Bullseye based image (was Stretch based)
* 08:20 hashar: github: created https://github.com/wikimedia/mediawiki-services-machinetranslation for replication from Gerrit # [[phab:T331256|T331256]]
 
== 2023-03-15 ==
* 09:01 dwalden: (deployment-prep) `dwalden@deployment-mwmaint02:~$ mwscript maintenance/refreshLinks.php --wiki enwiki --category='Pages that use Phonos'` for [[phab:T327708|T327708]]
* 08:09 hashar: Refreshing all Jenkins jobs to catch up with various changes made in the last few days
* 08:01 hashar: Switching Jenkins jobs to Quibble 1.5.3 {{!}} https://gerrit.wikimedia.org/r/c/integration/config/+/898807 {{!}} [[phab:T331061|T331061]], [[phab:T331621|T331621]]
* 07:50 hashar: Cleared Jenkins workspaces on integration-agent-docker-1034
 
== 2023-03-14 ==
* 16:54 hashar: Building Docker images for Quibble 1.5.3
* 16:41 hashar: Tag Quibble 1.5.3 @ {{Gerrit|df49e8a04f5}} # [[phab:T331621|T331621]]  [[phab:T331061|T331061]]
* 16:00 hashar: updating Docker images for https://gerrit.wikimedia.org/r/c/integration/config/+/898787
* 07:25 dwalden: `dwalden@deployment-mwmaint02:~$ mwscript maintenance/refreshLinks.php --wiki en_rtlwiki --category='Pages that use Phonos'` for [[phab:T326163|T326163]]
* 07:24 dwalden: `dwalden@deployment-mwmaint02:~$ mwscript maintenance/refreshLinks.php --wiki enwiktionary --category='Pages that use Phonos'` for [[phab:T326163|T326163]]
* 07:17 dwalden: `dwalden@deployment-mwmaint02:~$ mwscript maintenance/refreshLinks.php --wiki enwiki --category='Pages that use Phonos'` for [[phab:T326163|T326163]]
* 02:44 James_F: MediaWiki being branched to REL1_40 from {{Gerrit|fd3ce7633984d0120288d4a6fe48343cf9ba86a2}} for [[phab:T329079|T329079]]
 
== 2023-03-13 ==
* 17:57 James_F: Moved deployment-docker-cpjobqueue01 from v0.9.5 to v0.10.5 of change-prop whilst debugging [[phab:T326192|T326192]]
* 17:44 James_F: Manually changed cloudmetrics1002 to cloudmetrics1003 on deployment-docker-cpjobqueue01 whilst debugging [[phab:T326192|T326192]]
* 17:41 brennen: gitlab: removing dzahn (mutante) as member of /repos to test notification behavior
 
== 2023-03-12 ==
* 23:01 James_F: Zuul: [mediawiki/extensions/Tabber] Fix archived extension
* 23:01 James_F: Zuul: Add CI for EImage, SearchParserFunction, and StandardWikitext extensions
* 22:57 James_F: Zuul: Add Want to the CI whitelist
* 10:23 taavi: reload zuul for https://gerrit.wikimedia.org/r/897068 [[phab:T328240|T328240]]
 
== 2023-03-11 ==
* 01:22 TheresNoTime: `[samtar@deployment-deploy03 ~]$ scap lock --all --verbose Debugging issue with extension maintenance script, [[phab:T324233|T324233]]`
 
== 2023-03-10 ==
* 21:08 Krinkle: Reloading Zuul to deploy https://gerrit.wikimedia.org/r/896431
* 16:37 TheresNoTime: `[samtar@deployment-deploy03 ~]$ scap lock --all --verbose Debugging issue with extension maintenance script, [[phab:T324233|T324233]]`
* 15:07 TheresNoTime: (deployment-prep) `[samtar@deployment-deploy03 ~]$ scap lock --all --verbose Debugging issue with extension maintenance script, [[phab:T324233|T324233]]
* 14:37 TheresNoTime: (deployment-prep) clear lock
* 14:28 TheresNoTime: (deployment-prep) `[samtar@deployment-deploy03 ~]$ scap lock --all --verbose Debugging issue with extension maintenance script, [[phab:T324233|T324233]]`
 
== 2023-03-09 ==
* 20:53 brennen: scheduled tentative phabricator update window for tuesday 2023-03-14 @ 21:00 UTC
* 11:37 hashar: Rolling back selenium-daily Jenkins jobs back to NodeJS 14 {{!}} https://gerrit.wikimedia.org/r/c/integration/config/+/896026/ {{!}} [[phab:T330426|T330426]]
* 10:23 hashar: Reloaded Zuul for https://gerrit.wikimedia.org/r/c/integration/config/+/895839
 
== 2023-03-08 ==
* 20:12 brennen: Updating docker-pkg files on contint primary for https://gerrit.wikimedia.org/r/893074
* 10:36 hashar: Reloaded Zuul for https://gerrit.wikimedia.org/r/c/integration/config/+/895698 {{!}} [[phab:T331505|T331505]]
* 06:26 hashar: Reloaded Zuul for https://gerrit.wikimedia.org/r/c/integration/config/+/895142
* 06:23 hashar: Reloaded Zuul for https://gerrit.wikimedia.org/r/c/integration/config/+/895329 and https://gerrit.wikimedia.org/r/c/integration/config/+/895333 {{!}} [[phab:T321837|T321837]]
 
== 2023-03-07 ==
* 17:52 TheresNoTime: (deployment-prep) Ctrl+C'd `mwscript maintenance/refreshLinks.php --wiki enwiki --category='Pages that use Phonos'`, taking "a long time", saw `GlobalVarConfig::get: undefined option: 'PhonosStoreFilesAsMp3'`, [[phab:T326163|T326163]]
* 17:48 TheresNoTime: (deployment-prep) `samtar@deployment-mwmaint02:~$ mwscript maintenance/refreshLinks.php --wiki enwiki --category='Pages that use Phonos'` for [[phab:T326163|T326163]]
* 08:17 hashar: Updating Jenkins jobs for JJB updgrade from 4.1.0 to 4.2.0 {{!}} https://gerrit.wikimedia.org/r/c/integration/config/+/893765
 
== 2023-03-06 ==
* 13:48 hashar: Freed 3G of disk on deployment-mwmaint02 by deleting `/srv/mediawiki/php-master/cache/l10n/upstream/.~tmp~`  [[phab:T327853|T327853]]
* 13:44 hashar: Beta cluster no more updates due to deployment-mwmaint02 having a disk too small {{!}} [[phab:T327853|T327853]]
* 12:42 hashar: Updating Jenkins jobs to Quibble 1.5.2
* 12:24 hashar: Building Docker images for Quibble 1.5.2 {{!}} https://gerrit.wikimedia.org/r/894617
* 12:15 hashar: Tag Quibble 1.5.2 @ {{Gerrit|932b48cab06c}} # [[phab:T331236|T331236]] [[phab:T331061|T331061]] [[phab:T323750|T323750]]
 
== 2023-03-05 ==
* 14:09 lucaswerkmeister: manually deleted mediainfo slots of two pages on beta commons ([[phab:T331214|T331214]]#8666432)
 
== 2023-03-03 ==
* 19:52 zabe: deployment-db13: start replication from deployment-db11 # [[phab:T331019|T331019]]
* 19:52 zabe: deployment-db13: import dump into mariadb # [[phab:T331019|T331019]]
* 08:56 hashar: Updating Jenkins jobs with JJB 4.0.0 {{!}} https://gerrit.wikimedia.org/r/c/integration/config/+/893667/
* 00:37 zabe: take deployment-prep out of read-only # [[phab:T331019|T331019]]
 
== 2023-03-02 ==
* 22:01 zabe: enable read-only mode and create dump of all databases # [[phab:T331019|T331019]]
* 21:54 zabe: install mariadb 10.6 via role::mariadb::beta on deployment-db12 # [[phab:T331019|T331019]]
* 16:35 zabe: create volume db13 and attach to deployment-db13 # [[phab:T331019|T331019]]
* 16:29 zabe: create deployment-db13 as g3.cores8.ram16.disk20 # [[phab:T331019|T331019]]
* 16:24 zabe: shutoff deployment-db09 # [[phab:T331019|T331019]]
* 16:13 zabe: failover deployment-prep master from deployment-db09 to deployment-db11 # [[phab:T331019|T331019]]
* 14:00 hashar: gerrit: removed old replication tasks from /var/lib/gerrit2/review_site/data/replication/ref-updates/waiting (most from August 5th 2022)
* 12:41 Lucas_WMDE: wikidata/query-builder/deploy.git: deleted master branch (was {{Gerrit|ed287d58a1e9a2ea39f2eb5bbba31d8fc54269c2}} ) # [[phab:T330752|T330752]]
* 12:39 Luca: wikidata/query-builder/deploy.git: changed HEAD from master to production # [[phab:T330752|T330752]]
* 12:13 zabe: delete deploymentwiki # [[phab:T198673|T198673]]
 
== 2023-03-01 ==
* 19:30 hashar: Building Docker images for Quibble 1.5.1 ( https://gerrit.wikimedia.org/r/c/integration/config/+/893528/ )
* 19:17 hashar: Tagged Quibble 1.5.1 @ {{Gerrit|9a163094a855}} # [[phab:T330750|T330750]]
* 18:30 brennen: gitlab: enable custom issue-tracker instance-wide
* 17:37 hashar: Deploying `device-analytics-*` jobs for for https://gerrit.wikimedia.org/r/c/integration/config/+/893416 {{!}} [[phab:T320967|T320967]]
* 16:32 taavi: deployment-prep: block automatic/update.php execution of UpdateForMultipleDevicesSupport maintenance script in OATHAuth by pre-inserting rows in updatelog tables, will be run manually instead. [[phab:T242031|T242031]]
* 15:55 hashar: Reloaded Zuul for https://gerrit.wikimedia.org/r/c/integration/config/+/893416 {{!}} [[phab:T320967|T320967]]
* 14:07 hashar: integration: removed krenair from Puppet config `passwords::root::extra_keys`
 
== 2023-02-28 ==
* 15:49 hashar: Reloaded Zuul for https://gerrit.wikimedia.org/r/c/integration/config/+/892548/
* 14:43 hashar: Reloaded Zuul for https://gerrit.wikimedia.org/r/c/integration/config/+/892993 {{!}} [[phab:T271418|T271418]]
* 14:08 hashar: Updating Quibble jobs for https://gerrit.wikimedia.org/r/c/integration/config/+/891742 (node 14 shipped from the node14 images instead of being manually installed at build time)
* 13:56 hashar: Reloaded Zuul for https://gerrit.wikimedia.org/r/c/integration/config/+/892546 {{!}} [[phab:T311462|T311462]]
* 13:06 hashar: Reloaded Zuul for https://gerrit.wikimedia.org/r/c/integration/config/+/892952 {{!}} [[phab:T296348|T296348]]
* 12:11 hashar: Reloaded Zuul for https://gerrit.wikimedia.org/r/c/integration/config/+/892919 {{!}} [[phab:T299263|T299263]]
* 10:19 hashar: Reloaded Zuul for https://gerrit.wikimedia.org/r/c/integration/config/+/892910/ {{!}} [[phab:T299262|T299262]]
* 09:16 hashar: Reloaded Zuul for https://gerrit.wikimedia.org/r/c/integration/config/+/892530 {{!}} [[phab:T299158|T299158]] {{!}} [[phab:T299161|T299161]]
 
== 2023-02-27 ==
* 15:08 hashar: Reloaded Zuul for https://gerrit.wikimedia.org/r/c/integration/config/+/892458 {{!}} [[phab:T299283|T299283]]
* 13:02 hashar: Reloaded Zuul for https://gerrit.wikimedia.org/r/c/integration/config/+/892435 {{!}} [[phab:T327583|T327583]]
* 12:50 hashar: Reloaded Zuul for https://gerrit.wikimedia.org/r/c/integration/config/+/891968
 
== 2023-02-25 ==
* 22:57 James_F: Zuul: [mediawiki/tools/minus-x] Use lib template (add doxygen and coverage)
* 22:56 James_F: Zuul: [mediawiki/tools/phpunit-patch-coverage] Use lib template (add doxygen)
 
== 2023-02-24 ==
* 15:26 andrewbogott: deleting long-shutoff stretch instance deployment-imagescaler03.deployment-prep.eqiad1.wikimedia.cloud -- [[phab:T289883|T289883]]
* 01:49 James_F: Zuul: [mediawiki/tools/codesniffer] Use lib template (add doxygen)
 
== 2023-02-23 ==
* 22:15 James_F: Docker: [quibble-buster] Re-use node from the node image rather than our own
* 21:13 James_F: Docker: [node16] Upgrade node from 16.16.0 to 16.19.1
* 14:11 hashar: Update Jenkins jobs to use Quibble 1.5.0 and have some to use the new reporting-url parameter
* 14:00 taavi: update quibble* jenkins jobs for 891303
* 07:49 hashar: Reloaded Zuul for https://gerrit.wikimedia.org/r/c/integration/config/+/891317 Make tox-docker a voting job for operations/mediawiki-config
 
== 2023-02-22 ==
* 14:48 Reedy: Reloading Zuul to deploy https://gerrit.wikimedia.org/r/891281 [[phab:T328240|T328240]]
* 14:19 hashar: Updating all jobs to add `QUIBBLE_API_KEY` to the Quibble jobs {{!}} https://gerrit.wikimedia.org/r/c/integration/config/+/891278/ {{!}} [[phab:T323750|T323750]]
* 02:48 James_F: Zuul: Migrate further MediaWiki-adjunct node code testing from 14 to 16 for [[phab:T314470|T314470]]
* 02:45 James_F: Zuul: Migrate all MediaWiki-land node jobs to node16 for [[phab:T314470|T314470]]
* 02:43 James_F: Zuul: Migrate all non-MediaWiki-land node jobs to node16 for [[phab:T314470|T314470]]
 
== 2023-02-21 ==
* 18:55 James_F: Zuul: [mediawiki/extensions/Flow] Also run with BetaFeatures
* 16:04 James_F: Zuul: [mediawiki/extensions/GrowthExperiments] Add JS doc build/publish jobs [[phab:T329034|T329034]]
* 15:07 James_F: Zuul: [mediawiki/services/jobrunner] Use lib template (add doxygen and coverage)
* 13:50 hashar: Updating docker-pkg files for https://gerrit.wikimedia.org/r/890817
* 11:30 hashar: Reloaded Zuul to enable Sonar Codehealth Checks on CheckUser, DiscussionTools and ContentTranslation {{!}} [[phab:T321837|T321837]]
 
== 2023-02-20 ==
* 00:21 Krinkle: Reloading Zuul to deploy https://gerrit.wikimedia.org/r/890197
 
== 2023-02-16 ==
* 10:31 jnuche: restarted Zuul to clear stale events
 
== 2023-02-15 ==
* 20:07 taavi: unbroke puppet on deployment-ms-*
* 18:12 dancy: Reloading Zuul to deploy https://gerrit.wikimedia.org/r/c/integration/config/+/889499
* 16:03 thcipriani: restart ci jenkins for updates
* 16:02 thcipriani: restart releases jenkins for updates
 
== 2023-02-14 ==
* 16:23 taavi: make Dreamy Jazz a mediawiki/* +2'er [[phab:T329000|T329000]]
* 15:02 zabe: deployment-db12: start replicating from deployment-db09 # [[phab:T329577|T329577]]
* 14:04 zabe: delete deployment-db10 and volume db10 # [[phab:T329577|T329577]]
* 11:38 zabe: deployment-db11: start replicating from deployment-db09 # [[phab:T329577|T329577]]
* 02:19 zabe: deployment-db12: import dump into mariadb # [[phab:T329577|T329577]]
* 02:16 zabe: rsync dump from deployment-db09 to deployment-db12 # [[phab:T329577|T329577]]
* 02:09 zabe: install mariadb 10.6 via role::mariadb::beta on deployment-db12 # [[phab:T329577|T329577]]
* 01:50 zabe: create volume db12 and attach to deployment-db12 # [[phab:T329577|T329577]]
* 01:38 zabe: create deployment-db12 as g3.cores8.ram16.disk20 # [[phab:T329577|T329577]]
* 01:14 zabe: deployment-db11: import dump into mariadb # [[phab:T329577|T329577]]
* 01:06 zabe: rsync dump from deployment-db09 to deployment-db11 # [[phab:T329577|T329577]]
* 00:22 zabe: install mariadb 10.6 via role::mariadb::beta on deployment-db11 # [[phab:T329577|T329577]]
 
== 2023-02-13 ==
* 23:48 zabe: create volume db11 and attach to deployment-db11 # [[phab:T329577|T329577]]
* 23:44 zabe: shutoff deployment-db10 # [[phab:T329577|T329577]]
* 23:35 zabe: create deployment-db11 as g3.cores8.ram16.disk20 # [[phab:T329577|T329577]]
* 23:20 zabe: created backup of all databases on deployment-db09 # [[phab:T329577|T329577]]
* 22:29 dancy: Disabled beta-scap-sync-world and beta-update-databases-eqiad Jenkins jobs
* 19:57 zabe: zabe@deployment-deploy03:~$ sudo keyholder arm
 
== 2023-02-10 ==
* 21:52 James_F: Zuul: [operations/software/homer/deploy] Add CI for [[phab:T277440|T277440]]
* 03:21 James_F: Zuul: [wikimedia/fundraising/crm/civicrm] Mark as archived for [[phab:T324732|T324732]]
 
== 2023-02-08 ==
* 23:17 James_F: Zuul: Add Nik.xyz.in e-mail to CI allow list
* 21:32 hashar: Reloaded Zuul for https://gerrit.wikimedia.org/r/c/integration/config/+/887829 # [[phab:T329231|T329231]]
* 18:11 Krinkle: Disable spam account https://phabricator.wikimedia.org/people/manage/35991/
* 12:37 James_F: Zuul: [mediawiki/extensions/Wikibase] Drop composer api-testing job
* 09:16 hashar: deployment-prep:  deployment-deploy03 `systemctl stop ferm`  to allow jenkins to connect to the instance # [[phab:T329056|T329056]]
 
== 2023-02-07 ==
* 19:13 James_F: Zuul: Configure support for forthcoming REL1_40 branches for [[phab:T329077|T329077]]
 
== 2023-02-06 ==
* 09:30 hashar: Built tox Docker images to include `bats` {{!}} https://gerrit.wikimedia.org/r/c/integration/config/+/871178/
 
== 2023-02-03 ==
* 03:35 Krinkle: Delete empty GitHub repositories that were created as mirror of a Gerrit repo but are empty and more than 5 years old
 
== 2023-02-02 ==
* 15:53 James_F: Zuul: [operations/debs/gdnsd] Add debian-glue CI for [[phab:T321309|T321309]]
* 12:19 hashar: gerrit: deleted erroneous project which had a leading space ' research/navigation-vectors'. Done over ssh with: `ssh -p 29418 gerrit.wikimedia.org delete-project delete --yes-really-delete  "' research/navigation-vectors'"`
 
== 2023-01-31 ==
* 20:30 brennen: deploy1002:/srv/deployment/phabricator/deployment: updating previous phabricator remotes to gitlab
* 18:21 James_F: Zuul: [wikimedia/fundraising/crm] Make composer php74 voting via teamplate
* 18:11 James_F: Zuul: [wikimedia/fundraising/crm] Switch to generic composer job
* 18:06 James_F: Zuul: Switch FR things on mwgate-composer-php73-docker to php74 for [[phab:T326372|T326372]]
 
== 2023-01-30 ==
* 23:23 James_F: Zuul: [mediawiki/services/kartotherian] Rename jobs to 'publish' for [[phab:T327332|T327332]]
* 18:35 James_F: Zuul: [mediawiki/extensions/PushAll] Add basic tests
* 14:39 hashar: Building Docker image for https://gerrit.wikimedia.org/r/884904
* 10:59 hashar: Building docker images for https://gerrit.wikimedia.org/r/c/integration/config/+/884835/
 
== 2023-01-27 ==
* 20:42 thcipriani: Updating docker-pkg files on contint primary for https://gerrit.wikimedia.org/r/884372
* 19:35 brennen: Updating docker-pkg files on contint primary for https://gerrit.wikimedia.org/r/c/integration/config/+/884365/
* 14:23 hashar: Reloaded Zuul for https://gerrit.wikimedia.org/r/c/integration/config/+/884143 {{!}} [[phab:T315621|T315621]]
* 14:13 hashar: Reloaded Zuul for https://gerrit.wikimedia.org/r/884309
* 14:13 hashar: Reloaded Zuul for https://gerrit.wikimedia.org/r/884283
* 08:39 hashar: devtools: fix git security warning on deployment server by cherry-picking https://gerrit.wikimedia.org/r/c/operations/puppet/+/868002 on the puppet master {{!}} [[phab:T325128|T325128]]
 
== 2023-01-25 ==
* 21:35 dancy: runner-1030.gitlab-runners.eqiad1.wikimedia.cloud has been re-registered as an instance-wide runner[[phab:T327949|T327949]]
* 19:37 dancy: Taking runner-1030.gitlab-runners.eqiad1.wikimedia.cloud offline for [[phab:T327949|T327949]]
 
== 2023-01-24 ==
* 22:08 James_F: Zuul: Drop fundraising/REL1_35 jobs, everything has moved to REL1_39 now [[phab:T326372|T326372]]
* 22:04 James_F: Zuul: Make fundraising/REL1_39 jobs voting for [[phab:T326372|T326372]]
* 17:19 thcipriani: restarting ci jenkins for updates
* 17:15 thcipriani: restarted releases-jenkins for plugin updates
 
== 2023-01-23 ==
* 20:04 hashar: gerrit: changed mediawiki/tools/code-utils merge strategy from `fast-forward` only to `Rebase if necessary` *
* 15:29 James_F: Docker: Building new version of helm-linter image with sextant installed for [[phab:T292818|T292818]]
 
== 2023-01-20 ==
* 06:19 hashar: Reloaded Zuul for https://gerrit.wikimedia.org/r/c/integration/config/+/881665 {{!}} [[phab:T327301|T327301]]
 
== 2023-01-19 ==
* 20:01 James_F: Zuul: Add Izno to the CI allowlist
* 19:10 zabe: zabe@deployment-mwmaint02:~$ foreachwiki migrateRevisionCommentTemp.php # [[phab:T299954|T299954]]
* 19:10 zabe: zabe@deployment-mwmaint02:~$ foreachwiki migrateRevisionCommentTemp.php
* 19:10 taavi: deployment-prep: pruned bunch of stale puppet certificates and puppetdb entries
* 19:02 andrewbogott: deleting long-shutdown stretch instances: deployment-echostore01, deployment-ms-fe03, deployment-prometheus02
* 17:42 jeena: restarting zuul to deploy https://gerrit.wikimedia.org/r/c/integration/config/+/879907
 
== 2023-01-18 ==
* 21:33 dancy: Rebooting deployment-jobrunner04 for [[phab:T327329|T327329]]
* 17:55 hashar: Reloaded Zuul for https://gerrit.wikimedia.org/r/c/integration/config/+/881457 {{!}} [[phab:T327301|T327301]]
* 15:42 thcipriani: deployment-jobrunner04: sudo rm -rf /srv/mediawiki/php-master/cache/l10n/upstream/.~tmp~
* 15:31 andrewbogott: shutting down deployment-imagescaler03 as it is long-overdue for replacement.  See [[phab:T294148|T294148]] for details.
* 10:10 arturo: bump trove quotas ([[phab:T326674|T326674]])
 
== 2023-01-17 ==
* 12:58 hashar: Reloaded Zuul for https://gerrit.wikimedia.org/r/c/integration/config/+/880951/
* 10:05 hashar: Updating sonar-scanner jobs https://gerrit.wikimedia.org/r/c/integration/config/+/880893/
* 09:52 hashar: Built image docker-registry.discovery.wmnet/releng/sonar-scanner:4.6.0.2311-4
* 08:32 hashar: Reloading Zuul for https://gerrit.wikimedia.org/r/c/integration/config/+/880503 {{!}} [[phab:T321837|T321837]]
* 00:21 James_F: Zuul: [operations/debs/cadvisor] Add debian-glue-unstable CI for [[phab:T325557|T325557]]
* 00:21 James_F: Zuul: [mediawiki/extensions/WikimediaMaintenance] +AbuseFilter phan dep
 
== 2023-01-16 ==
* 22:29 Krinkle: Updating docker-pkg files on contint primary for https://gerrit.wikimedia.org/r/880541
* 00:19 Krinkle: Reloading Zuul
 
== 2023-01-13 ==
* 10:41 hashar: Reloading Zuul for https://gerrit.wikimedia.org/r/c/integration/config/+/879754
* 01:35 Krinkle: Reloading Zuul to deploy https://gerrit.wikimedia.org/r/879687
 
== 2023-01-12 ==
* 21:49 Reedy: Reloading Zuul to deploy https://gerrit.wikimedia.org/r/879649
* 10:42 hashar: Deployed docroot change https://gerrit.wikimedia.org/r/878860 "zuul: Link to report_url if available"
 
== 2023-01-10 ==
* 21:14 brennen: Updating development images on contint primary for https://gitlab.wikimedia.org/repos/releng/dev-images/-/merge_requests/27
* 16:50 James_F: Zuul: Fix extension-quibble to run vendor not composer quibble on wmf for [[phab:T326653|T326653]]
* 15:28 James_F: Zuul: Add experimental jobs for fundraising/REL1_39 for [[phab:T326372|T326372]]
 
== 2023-01-09 ==
* 19:56 James_F: Zuul: Fix extension-quibble-only-standalone to not run vendor jobs on branches
* 16:30 wm-bot2: Increased quotas by 6 cores ([[phab:T326568|T326568]]) - cookbook ran by arturo@nostromo
* 10:34 hashar: Restarted zuul-merger on contint1002 it was listening but not processing any requests
 
== 2023-01-08 ==
* 19:10 Reedy: Reloading Zuul to deploy https://gerrit.wikimedia.org/r/876355
* 00:21 Krinkle: Mark various Gerrit repos under mediawiki/tools/ as read-only "ARCHIVED" that are 6y+ inactive, in prep for enabling Codesearch for this prefix
 
== 2023-01-07 ==
* 22:53 Krinkle: Reloading Zuul to deploy https://gerrit.wikimedia.org/r/876327
 
== 2023-01-06 ==
* 16:59 James_F: Docker: Publishing new CI images with composer 2.5.1 for [[phab:T319257|T319257]]
* 11:43 hashar: Refreshing Jenkins jobs to update Quibble jobs with php-excimer {{!}} https://gerrit.wikimedia.org/r/c/integration/config/+/876190
 
== 2023-01-05 ==
* 09:18 hashar: Reloaded Zuul for https://gerrit.wikimedia.org/r/c/integration/config/+/868193 {{!}} Make CentralAuth a clone dependency for MassMessage {{!}} [[phab:T145430|T145430]]
 
== 2023-01-04 ==
* 19:42 MatmaRex: Ran maintenansce script refreshGlobalimagelinks.php for [[phab:T322588|T322588]]
* 02:47 TimStarling: Reloading Zuul to deploy https://gerrit.wikimedia.org/r/c/integration/config/+/874959
 
== 2023-01-03 ==
* 19:14 dduvall: restarting zuul
* 19:12 Krinkle: Disable publishing of rPMSM, ref [[phab:T143162|T143162]], [[phab:T326112|T326112]]
* 17:38 hashar: gerrit: reactivated account for `jmando` using `gerrit set-account 9431 --active` {{!}} [[phab:T326159|T326159]]
* 14:20 hashar: integration: restarting all instances for Linux kernel upgrade
* 07:52 hashar: Reloaded Zuul for https://gerrit.wikimedia.org/r/c/integration/config/+/874439/ Make Phonos depend on TimedMediaHandler # [[phab:T322368|T322368]]





Latest revision as of 15:12, 26 May 2023

2023-05-26

2023-05-25

  • 17:30 hashar: gerrit2002 replication eventually has completed at some point: `Replication completed with some errors!` # T334521
  • 16:44 hashar: gerrit2002: creating lucene indices: `java -jar /var/lib/gerrit2/review_site/bin/gerrit.war reindex --index groups` # T334521
  • 16:37 hashar: ssh -p 29418 gerrit.wikimedia.org replication start --url gerrit2002 --all --wait # T334521
  • 16:27 brennen: phab1004: sudo systemctl restart php7.3-fpm.service && sudo systemctl restart phd

2023-05-24

  • 10:09 eoghan: Switching doc.wikimedia.org from doc1002 -> doc1003, T319477
  • 09:24 Daimona: Creating new DB table on beta wikishared for the CampaignEvents extension # T336362

2023-05-23

  • 21:48 brennen: https://phab.wmflabs.org/ now running phorge 2023.17
  • 13:54 TheresNoTime: (deployment-prep) `samtar@deployment-mwmaint02:~$ mwscript resetUserEmail.php --wiki=metawiki Diskdance [snip]` T337172

2023-05-21

2023-05-17

  • 09:53 hashar: integration-agent-docker-1029: erased a few files under `/srv`. I suspect the 36GBytes partition is not large enough nowadays for multiple concurrent builds of MediaWiki # T336840
  • 03:12 brennen: gitlab-webhooks restart after failed webhook requests (presumably earlier outage)

2023-05-16

2023-05-12

2023-05-11

2023-05-10

  • 23:19 brennen: reconfigured and restarted gitlab-webhooks to use CodeReviewBot for messages instead of gerritbot (T327424)

2023-05-09

2023-05-05

2023-05-04

2023-05-03

2023-05-02

2023-05-01

  • 17:20 brennen: experimenting with ldap user sync on gitlab.devtools

2023-04-28

  • 19:56 dancy: Ran `git submodule sync` as jenkins-deploy in deployment-deploy03:/srv/mediawiki-staging/php-master/extensions for T335602

2023-04-27

  • 17:10 James_F: Zuul: [wvui] Mark repo as archived for T310244

2023-04-26

  • 16:51 James_F: Zuul: Add Kevin Wilke to CI allow list

2023-04-25

  • 21:23 mutante: gerrit1003 - sudo -u gerrit2 /usr/bin/scap deploy-local --repo gerrit/gerrit -D log_json:False (manually it works, but that's the same command that puppet is supposed to run !?) - T257317 T326368

2023-04-24

  • 21:37 TheresNoTime: (deployment-prep) Add volume to `deployment-mwmaint02` (`mwmaint`) and moved `/srv` - T327853

2023-04-23

  • 16:55 Krinkle: Fix profile::tlsproxy::envoy::global_cert_name in Horizon for webperf host to use '%{facts.fqdn}' instead of performance.discovery.wmnet as the latter doesn't resolve / would be an invalid cert for https://deployment-webperf21, ref T291015

2023-04-22

2023-04-21

  • 10:04 Lucas_WMDE: `sudo systemctl reload nginx` on deployment-elastic09, deployment-elastic10, deployment-elastic11 # T335181

2023-04-20

2023-04-19

  • 13:59 James_F: Beta: Setting `namespace: repos/abstract-wiki/wikifunctions image_name: function-orchestrator` on deployment-docker-wikifunctions01 for T334998
  • 10:56 joe: Updating docker-pkg files on contint primary for helm-linter

2023-04-18

  • 17:35 mutante: doc2001 - systemctl reset-failed - cleared monitoring for systemd state - remnants from PHP7.3 after upgrade to 7.4
  • 17:08 James_F: Zuul, jjb: [mediawiki/services/function-orchestrator] Archive, moved to GitLab for T334397

2023-04-17

  • 13:37 James_F: Zuul: [mediawiki/services/function-schemata] Mark as archived for T281500

2023-04-12

2023-04-10

  • 20:00 thcipriani: restarting zuul due to due to stuck gerrit ssh-connections
  • 18:44 thcipriani: restart zuul-merger

2023-04-09

  • 13:22 lucaswerkmeister: lucaswerkmeister@deployment-mwmaint02:~$ mwscript createAndPromote metawiki --custom-groups=oauthadmin --force 'Lucas Werkmeister' # made myself OAuth admin so I can manage the clients used to test m3api-oauth2

2023-04-06

  • 19:49 James_F: Zuul: Add all @wikia/fandom domains to the CI allow list

2023-04-05

2023-04-04

2023-04-03

  • 14:14 James_F: Zuul: [mediawiki/extensions/ContentStabilization] Add BlueSpiceBookshelf dep
  • 11:10 hashar: Switching Jenkins jobs to Quibble 1.5.4 | https://gerrit.wikimedia.org/r/905190
  • 10:25 hashar: Building Docker images for Quibble 1.5.4 https://gerrit.wikimedia.org/r/905167
  • 10:20 hashar: Tag Quibble 1.5.4 @ 0a37ce9 # T332930 T331280 T333412
  • 08:11 hashar: gtlab: runner-1030: running `docker volume prune` to discard all volumes metadata after they have been manually deleted from `/var/lib/docker` ( Reclaimed 13.92GB) | T333586
  • 08:11 hashar: gtlab: runner-1030: running `docker volume prune` to discard all volumes metadata after they have been manually deleted from `/var/lib/docker` ( Reclaimed 13.92GB) | T33586

2023-03-31

2023-03-29

2023-03-23

  • 13:22 James_F: Gerrit: Deleting mediawiki/extensions/PageProperties duplicate 'main' branch, development work is in 'master'.

2023-03-22

  • 21:14 taavi: taavi@deployment-mwmaint02:~$ mwscript extensions/OATHAuth/maintenance/UpdateForMultipleDevicesSupport.php metawiki --force # T242031
  • 20:34 taavi: cat /srv/mediawiki/php-master/extensions/OATHAuth/sql/mysql/tables-generated.sql | sql centralauth --write # T242031

2023-03-20

  • 21:43 brennen: phabricator: setting sbassett to administrator per T331928

2023-03-19

  • 22:34 TheresNoTime: (beta) `samtar@deployment-kafka-logging01:~$ sudo systemctl restart kafka.service`, noticed beta-logs wasn't showing logs from ~14:00UTC in T332507
  • 22:10 TheresNoTime: (beta) `GRANT SELECT, INSERT, UPDATE, DELETE, CREATE, REFERENCES, INDEX, ALTER, CREATE TEMPORARY TABLES, LOCK TABLES, EXECUTE, CREATE VIEW, SHOW VIEW, CREATE ROUTINE, ALTER ROUTINE, EVENT, TRIGGER ON mainstash.* TO 'wikiadmin'@'172.16.%';` T322469
  • 14:43 hashar: deployment-prep: databases update hourly job times out, filed T332507

2023-03-17

  • 23:00 urbanecm: deployment-prep: Reboot deployment-elastic10, deployment-elastic11 (T332455)
  • 22:58 urbanecm: deployment-prep: Reboot deployment-elastic09 (T332455)
  • 10:36 mutante: disabled phab user 'Cloudduck1233'

2023-03-16

2023-03-15

  • 09:01 dwalden: (deployment-prep) `dwalden@deployment-mwmaint02:~$ mwscript maintenance/refreshLinks.php --wiki enwiki --category='Pages that use Phonos'` for T327708
  • 08:09 hashar: Refreshing all Jenkins jobs to catch up with various changes made in the last few days
  • 08:01 hashar: Switching Jenkins jobs to Quibble 1.5.3 | https://gerrit.wikimedia.org/r/c/integration/config/+/898807 | T331061, T331621
  • 07:50 hashar: Cleared Jenkins workspaces on integration-agent-docker-1034

2023-03-14

  • 16:54 hashar: Building Docker images for Quibble 1.5.3
  • 16:41 hashar: Tag Quibble 1.5.3 @ df49e8a04f5 # T331621 T331061
  • 16:00 hashar: updating Docker images for https://gerrit.wikimedia.org/r/c/integration/config/+/898787
  • 07:25 dwalden: `dwalden@deployment-mwmaint02:~$ mwscript maintenance/refreshLinks.php --wiki en_rtlwiki --category='Pages that use Phonos'` for T326163
  • 07:24 dwalden: `dwalden@deployment-mwmaint02:~$ mwscript maintenance/refreshLinks.php --wiki enwiktionary --category='Pages that use Phonos'` for T326163
  • 07:17 dwalden: `dwalden@deployment-mwmaint02:~$ mwscript maintenance/refreshLinks.php --wiki enwiki --category='Pages that use Phonos'` for T326163
  • 02:44 James_F: MediaWiki being branched to REL1_40 from fd3ce76 for T329079

2023-03-13

  • 17:57 James_F: Moved deployment-docker-cpjobqueue01 from v0.9.5 to v0.10.5 of change-prop whilst debugging T326192
  • 17:44 James_F: Manually changed cloudmetrics1002 to cloudmetrics1003 on deployment-docker-cpjobqueue01 whilst debugging T326192
  • 17:41 brennen: gitlab: removing dzahn (mutante) as member of /repos to test notification behavior

2023-03-12

  • 23:01 James_F: Zuul: [mediawiki/extensions/Tabber] Fix archived extension
  • 23:01 James_F: Zuul: Add CI for EImage, SearchParserFunction, and StandardWikitext extensions
  • 22:57 James_F: Zuul: Add Want to the CI whitelist
  • 10:23 taavi: reload zuul for https://gerrit.wikimedia.org/r/897068 T328240

2023-03-11

  • 01:22 TheresNoTime: `[samtar@deployment-deploy03 ~]$ scap lock --all --verbose Debugging issue with extension maintenance script, T324233`

2023-03-10

  • 21:08 Krinkle: Reloading Zuul to deploy https://gerrit.wikimedia.org/r/896431
  • 16:37 TheresNoTime: `[samtar@deployment-deploy03 ~]$ scap lock --all --verbose Debugging issue with extension maintenance script, T324233`
  • 15:07 TheresNoTime: (deployment-prep) `[samtar@deployment-deploy03 ~]$ scap lock --all --verbose Debugging issue with extension maintenance script, T324233
  • 14:37 TheresNoTime: (deployment-prep) clear lock
  • 14:28 TheresNoTime: (deployment-prep) `[samtar@deployment-deploy03 ~]$ scap lock --all --verbose Debugging issue with extension maintenance script, T324233`

2023-03-09

2023-03-08

2023-03-07

  • 17:52 TheresNoTime: (deployment-prep) Ctrl+C'd `mwscript maintenance/refreshLinks.php --wiki enwiki --category='Pages that use Phonos'`, taking "a long time", saw `GlobalVarConfig::get: undefined option: 'PhonosStoreFilesAsMp3'`, T326163
  • 17:48 TheresNoTime: (deployment-prep) `samtar@deployment-mwmaint02:~$ mwscript maintenance/refreshLinks.php --wiki enwiki --category='Pages that use Phonos'` for T326163
  • 08:17 hashar: Updating Jenkins jobs for JJB updgrade from 4.1.0 to 4.2.0 | https://gerrit.wikimedia.org/r/c/integration/config/+/893765

2023-03-06

  • 13:48 hashar: Freed 3G of disk on deployment-mwmaint02 by deleting `/srv/mediawiki/php-master/cache/l10n/upstream/.~tmp~` T327853
  • 13:44 hashar: Beta cluster no more updates due to deployment-mwmaint02 having a disk too small | T327853
  • 12:42 hashar: Updating Jenkins jobs to Quibble 1.5.2
  • 12:24 hashar: Building Docker images for Quibble 1.5.2 | https://gerrit.wikimedia.org/r/894617
  • 12:15 hashar: Tag Quibble 1.5.2 @ 932b48cab06c # T331236 T331061 T323750

2023-03-05

  • 14:09 lucaswerkmeister: manually deleted mediainfo slots of two pages on beta commons (T331214#8666432)

2023-03-03

2023-03-02

  • 22:01 zabe: enable read-only mode and create dump of all databases # T331019
  • 21:54 zabe: install mariadb 10.6 via role::mariadb::beta on deployment-db12 # T331019
  • 16:35 zabe: create volume db13 and attach to deployment-db13 # T331019
  • 16:29 zabe: create deployment-db13 as g3.cores8.ram16.disk20 # T331019
  • 16:24 zabe: shutoff deployment-db09 # T331019
  • 16:13 zabe: failover deployment-prep master from deployment-db09 to deployment-db11 # T331019
  • 14:00 hashar: gerrit: removed old replication tasks from /var/lib/gerrit2/review_site/data/replication/ref-updates/waiting (most from August 5th 2022)
  • 12:41 Lucas_WMDE: wikidata/query-builder/deploy.git: deleted master branch (was ed287d5 ) # T330752
  • 12:39 Luca: wikidata/query-builder/deploy.git: changed HEAD from master to production # T330752
  • 12:13 zabe: delete deploymentwiki # T198673

2023-03-01

2023-02-28

2023-02-27

2023-02-25

  • 22:57 James_F: Zuul: [mediawiki/tools/minus-x] Use lib template (add doxygen and coverage)
  • 22:56 James_F: Zuul: [mediawiki/tools/phpunit-patch-coverage] Use lib template (add doxygen)

2023-02-24

  • 15:26 andrewbogott: deleting long-shutoff stretch instance deployment-imagescaler03.deployment-prep.eqiad1.wikimedia.cloud -- T289883
  • 01:49 James_F: Zuul: [mediawiki/tools/codesniffer] Use lib template (add doxygen)

2023-02-23

  • 22:15 James_F: Docker: [quibble-buster] Re-use node from the node image rather than our own
  • 21:13 James_F: Docker: [node16] Upgrade node from 16.16.0 to 16.19.1
  • 14:11 hashar: Update Jenkins jobs to use Quibble 1.5.0 and have some to use the new reporting-url parameter
  • 14:00 taavi: update quibble* jenkins jobs for 891303
  • 07:49 hashar: Reloaded Zuul for https://gerrit.wikimedia.org/r/c/integration/config/+/891317 Make tox-docker a voting job for operations/mediawiki-config

2023-02-22

2023-02-21

  • 18:55 James_F: Zuul: [mediawiki/extensions/Flow] Also run with BetaFeatures
  • 16:04 James_F: Zuul: [mediawiki/extensions/GrowthExperiments] Add JS doc build/publish jobs T329034
  • 15:07 James_F: Zuul: [mediawiki/services/jobrunner] Use lib template (add doxygen and coverage)
  • 13:50 hashar: Updating docker-pkg files for https://gerrit.wikimedia.org/r/890817
  • 11:30 hashar: Reloaded Zuul to enable Sonar Codehealth Checks on CheckUser, DiscussionTools and ContentTranslation | T321837

2023-02-20

2023-02-16

  • 10:31 jnuche: restarted Zuul to clear stale events

2023-02-15

2023-02-14

  • 16:23 taavi: make Dreamy Jazz a mediawiki/* +2'er T329000
  • 15:02 zabe: deployment-db12: start replicating from deployment-db09 # T329577
  • 14:04 zabe: delete deployment-db10 and volume db10 # T329577
  • 11:38 zabe: deployment-db11: start replicating from deployment-db09 # T329577
  • 02:19 zabe: deployment-db12: import dump into mariadb # T329577
  • 02:16 zabe: rsync dump from deployment-db09 to deployment-db12 # T329577
  • 02:09 zabe: install mariadb 10.6 via role::mariadb::beta on deployment-db12 # T329577
  • 01:50 zabe: create volume db12 and attach to deployment-db12 # T329577
  • 01:38 zabe: create deployment-db12 as g3.cores8.ram16.disk20 # T329577
  • 01:14 zabe: deployment-db11: import dump into mariadb # T329577
  • 01:06 zabe: rsync dump from deployment-db09 to deployment-db11 # T329577
  • 00:22 zabe: install mariadb 10.6 via role::mariadb::beta on deployment-db11 # T329577

2023-02-13

  • 23:48 zabe: create volume db11 and attach to deployment-db11 # T329577
  • 23:44 zabe: shutoff deployment-db10 # T329577
  • 23:35 zabe: create deployment-db11 as g3.cores8.ram16.disk20 # T329577
  • 23:20 zabe: created backup of all databases on deployment-db09 # T329577
  • 22:29 dancy: Disabled beta-scap-sync-world and beta-update-databases-eqiad Jenkins jobs
  • 19:57 zabe: zabe@deployment-deploy03:~$ sudo keyholder arm

2023-02-10

  • 21:52 James_F: Zuul: [operations/software/homer/deploy] Add CI for T277440
  • 03:21 James_F: Zuul: [wikimedia/fundraising/crm/civicrm] Mark as archived for T324732

2023-02-08

2023-02-07

  • 19:13 James_F: Zuul: Configure support for forthcoming REL1_40 branches for T329077

2023-02-06

2023-02-03

  • 03:35 Krinkle: Delete empty GitHub repositories that were created as mirror of a Gerrit repo but are empty and more than 5 years old

2023-02-02

  • 15:53 James_F: Zuul: [operations/debs/gdnsd] Add debian-glue CI for T321309
  • 12:19 hashar: gerrit: deleted erroneous project which had a leading space ' research/navigation-vectors'. Done over ssh with: `ssh -p 29418 gerrit.wikimedia.org delete-project delete --yes-really-delete "' research/navigation-vectors'"`

2023-01-31

  • 20:30 brennen: deploy1002:/srv/deployment/phabricator/deployment: updating previous phabricator remotes to gitlab
  • 18:21 James_F: Zuul: [wikimedia/fundraising/crm] Make composer php74 voting via teamplate
  • 18:11 James_F: Zuul: [wikimedia/fundraising/crm] Switch to generic composer job
  • 18:06 James_F: Zuul: Switch FR things on mwgate-composer-php73-docker to php74 for T326372

2023-01-30

2023-01-27

2023-01-25

  • 21:35 dancy: runner-1030.gitlab-runners.eqiad1.wikimedia.cloud has been re-registered as an instance-wide runner. T327949
  • 19:37 dancy: Taking runner-1030.gitlab-runners.eqiad1.wikimedia.cloud offline for T327949

2023-01-24

  • 22:08 James_F: Zuul: Drop fundraising/REL1_35 jobs, everything has moved to REL1_39 now T326372
  • 22:04 James_F: Zuul: Make fundraising/REL1_39 jobs voting for T326372
  • 17:19 thcipriani: restarting ci jenkins for updates
  • 17:15 thcipriani: restarted releases-jenkins for plugin updates

2023-01-23

  • 20:04 hashar: gerrit: changed mediawiki/tools/code-utils merge strategy from `fast-forward` only to `Rebase if necessary` *
  • 15:29 James_F: Docker: Building new version of helm-linter image with sextant installed for T292818

2023-01-20

2023-01-19

  • 20:01 James_F: Zuul: Add Izno to the CI allowlist
  • 19:10 zabe: zabe@deployment-mwmaint02:~$ foreachwiki migrateRevisionCommentTemp.php # T299954
  • 19:10 zabe: zabe@deployment-mwmaint02:~$ foreachwiki migrateRevisionCommentTemp.php
  • 19:10 taavi: deployment-prep: pruned bunch of stale puppet certificates and puppetdb entries
  • 19:02 andrewbogott: deleting long-shutdown stretch instances: deployment-echostore01, deployment-ms-fe03, deployment-prometheus02
  • 17:42 jeena: restarting zuul to deploy https://gerrit.wikimedia.org/r/c/integration/config/+/879907

2023-01-18

2023-01-17

2023-01-16

2023-01-13

2023-01-12

2023-01-10

2023-01-09

  • 19:56 James_F: Zuul: Fix extension-quibble-only-standalone to not run vendor jobs on branches
  • 16:30 wm-bot2: Increased quotas by 6 cores (T326568) - cookbook ran by arturo@nostromo
  • 10:34 hashar: Restarted zuul-merger on contint1002 it was listening but not processing any requests

2023-01-08

  • 19:10 Reedy: Reloading Zuul to deploy https://gerrit.wikimedia.org/r/876355
  • 00:21 Krinkle: Mark various Gerrit repos under mediawiki/tools/ as read-only "ARCHIVED" that are 6y+ inactive, in prep for enabling Codesearch for this prefix

2023-01-07

2023-01-06

2023-01-05

2023-01-04

2023-01-03


Archives