You are browsing a read-only backup copy of Wikitech. The live site can be found at wikitech.wikimedia.org

Server Admin Log: Revision history

Jump to navigation Jump to search

Diff selection: Mark the radio buttons of the revisions to compare and hit enter or the button at the bottom.
Legend: (cur) = difference with latest revision, (prev) = difference with preceding revision, m = minor edit.

(newest | oldest) View (newer 50 | ) (20 | 50 | 100 | 250 | 500)

16 August 2022

  • curprev 00:1800:18, 16 August 2022imported>Stashbot 336,736 bytes +19,280 tstarling@deploy1002: Synchronized wmf-config/InitialiseSettings.php: replaceableSettings g 820247 (duration: 03m 18s)

14 August 2022

  • curprev 08:5408:54, 14 August 2022imported>Stashbot 317,456 bytes +542 ladsgroup@cumin1001: dbctl commit (dc=all): 'Depooling db1141 (T312863)', diff saved to https://phabricator.wikimedia.org/P32380 and previous config saved to /var/cache/conftool/dbconfig/20220814-085443-ladsgroup.json

13 August 2022

  • curprev 13:3713:37, 13 August 2022imported>Stashbot 316,914 bytes +1,309 ladsgroup@cumin1001: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db1145.eqiad.wmnet with reason: Maintenance

12 August 2022

  • curprev 23:4123:41, 12 August 2022imported>Stashbot 315,605 bytes +10,763 mutante: wikistats-bullseye:~$ /usr/lib/wikistats/update.php wp prefix blk ; /usr/lib/wikistats/update.php wp prefix kcg T315121
  • curprev 01:0301:03, 12 August 2022imported>Stashbot 304,842 bytes +25,321 ladsgroup@cumin1001: dbctl commit (dc=all): 'Depooling db1121 (T312863)', diff saved to https://phabricator.wikimedia.org/P32369 and previous config saved to /var/cache/conftool/dbconfig/20220812-010312-ladsgroup.json

11 August 2022

  • curprev 00:5800:58, 11 August 2022imported>Stashbot 279,521 bytes +35,722 sukhe@puppetmaster1001: conftool action : set/pooled=no; selector: name=cp2042.codfw.wmnet,service=varnish-fe

9 August 2022

  • curprev 23:1723:17, 9 August 2022imported>Stashbot 243,799 bytes +16,655 bking@cumin1001: conftool action : set/weight=10:pooled=yes; selector: name=wdqs1011.eqiad.wmnet

8 August 2022

  • curprev 23:5223:52, 8 August 2022imported>Stashbot 227,144 bytes +14,190 tstarling@deploy1002: Synchronized wmf-config/InitialiseSettings.php: clean up testwiki experiments T314750 (duration: 03m 19s)

7 August 2022

  • curprev 19:5819:58, 7 August 2022imported>Stashbot 212,954 bytes +3,230 taavi: taavi@mwmaint1002 ~ $ echo "https://upload.wikimedia.org/wikipedia/commons/1/15/Keep_tidy_ask.svg" | mwscript purgeList.php --wiki enwiki # T314712

6 August 2022

  • curprev 17:5917:59, 6 August 2022imported>Stashbot 209,724 bytes +2,395 ladsgroup@cumin1001: dbctl commit (dc=all): 'Depooling db1149 (T312863)', diff saved to https://phabricator.wikimedia.org/P32295 and previous config saved to /var/cache/conftool/dbconfig/20220806-175916-ladsgroup.json

5 August 2022

  • curprev 22:2022:20, 5 August 2022imported>Stashbot 207,329 bytes +9,421 dcausse@deploy1002: Finished deploy [wikimedia/discovery/analytics@71fe016]: Fix schedule_interval for image_recommendation_weekly (duration: 02m 01s)
  • curprev 00:5300:53, 5 August 2022imported>Stashbot 197,908 bytes +49,951 dzahn@cumin1001: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 8 days, 0:00:00 on gerrit2001.wikimedia.org with reason: decom, replaced by gerrit2002

4 August 2022

  • curprev 01:2301:23, 4 August 2022imported>Stashbot 147,957 bytes +66,383 marostegui@cumin1001: dbctl commit (dc=all): 'Repooling after maintenance db1146:3312 (T312972)', diff saved to https://phabricator.wikimedia.org/P32278 and previous config saved to /var/cache/conftool/dbconfig/20220804-012341-marostegui.json

2 August 2022

  • curprev 22:3922:39, 2 August 2022imported>Stashbot 81,574 bytes +58,081 mwdebug-deploy@deploy1002: helmfile [codfw] DONE helmfile.d/services/mwdebug: apply
  • curprev 00:4100:41, 2 August 2022imported>Stashbot 23,493 bytes −741,414 mwdebug-deploy@deploy1002: helmfile [codfw] DONE helmfile.d/services/mwdebug: apply

1 August 2022

  • curprev 01:0001:00, 1 August 2022imported>Stashbot 764,907 bytes +3,017 krinkle@deploy1002: Synchronized multiversion/: Ic0dbcba9f60f20a (duration: 03m 31s)

30 July 2022

  • curprev 01:4401:44, 30 July 2022imported>Stashbot 761,890 bytes +392 bking@cumin1001: END (FAIL) - Cookbook sre.elasticsearch.rolling-operation (exit_code=99) Operation.REIMAGE (1 nodes at a time) for ElasticSearch cluster search_codfw: codfw cluster reimage (bullseye upgrade) - bking@cumin1001 - T289135
  • curprev 00:5500:55, 30 July 2022imported>Stashbot 761,498 bytes +10,804 bking@cumin1001: START - Cookbook sre.hosts.reimage for host elastic2028.codfw.wmnet with OS bullseye

29 July 2022

  • curprev 00:4800:48, 29 July 2022imported>Stashbot 750,694 bytes +35,853 TimStarling: slowly restarting (with batch 1 sleep 5) trafficserver on text caches to fully deploy g 817086 T313578

28 July 2022

  • curprev 01:2601:26, 28 July 2022imported>Stashbot 714,841 bytes +36,833 mwdebug-deploy@deploy1002: helmfile [codfw] START helmfile.d/services/mwdebug: apply

26 July 2022

  • curprev 23:5923:59, 26 July 2022imported>Stashbot 678,008 bytes +28,393 tzatziki: removing one file for legal compliance
  • curprev 00:1100:11, 26 July 2022imported>Stashbot 649,615 bytes +31,213 TimStarling: restarted php7.2-fpm on the 9 canary hosts in eqiad T313770

24 July 2022

  • curprev 20:5420:54, 24 July 2022imported>Stashbot 618,402 bytes +4,271 btullis@cumin1001: END (PASS) - Cookbook sre.ganeti.reboot-vm (exit_code=0) for VM archiva1002.wikimedia.org
  • curprev 00:3700:37, 24 July 2022imported>Stashbot 614,131 bytes +18,168 ladsgroup@cumin1001: dbctl commit (dc=all): 'Depooling db1158 (T312863)', diff saved to https://phabricator.wikimedia.org/P31802 and previous config saved to /var/cache/conftool/dbconfig/20220724-003718-ladsgroup.json

23 July 2022

  • curprev 01:3701:37, 23 July 2022imported>Stashbot 595,963 bytes +27,357 ladsgroup@cumin1001: dbctl commit (dc=all): 'Repooling after maintenance db1170:3317', diff saved to https://phabricator.wikimedia.org/P31750 and previous config saved to /var/cache/conftool/dbconfig/20220723-013755-ladsgroup.json

22 July 2022

  • curprev 00:4400:44, 22 July 2022imported>Stashbot 568,606 bytes +68,956 mwdebug-deploy@deploy1002: helmfile [codfw] DONE helmfile.d/services/mwdebug: apply

21 July 2022

  • curprev 00:4400:44, 21 July 2022imported>Stashbot 499,650 bytes +51,704 bking@cumin1001: END (ERROR) - Cookbook sre.elasticsearch.rolling-operation (exit_code=97) Operation.REIMAGE (1 nodes at a time) for ElasticSearch cluster search_codfw: codfw cluster reimage (bullseye upgrade) - bking@cumin1001 - T289135

20 July 2022

  • curprev 01:2701:27, 20 July 2022imported>Stashbot 447,946 bytes +56,169 bking@cumin1001: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on elastic2052.codfw.wmnet with reason: host reimage

18 July 2022

  • curprev 23:5823:58, 18 July 2022imported>Stashbot 391,777 bytes +61,137 andrew@cumin1001: END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host cloudvirt1050.eqiad.wmnet

17 July 2022

  • curprev 18:0518:05, 17 July 2022imported>Stashbot 330,640 bytes +10,758 ladsgroup@cumin1001: dbctl commit (dc=all): 'Repooling after maintenance db1161 (T312984)', diff saved to https://phabricator.wikimedia.org/P31256 and previous config saved to /var/cache/conftool/dbconfig/20220717-180539-ladsgroup.json
  • curprev 00:4800:48, 17 July 2022imported>Stashbot 319,882 bytes +13,275 ladsgroup@cumin1001: dbctl commit (dc=all): 'Repooling after maintenance db1101:3317', diff saved to https://phabricator.wikimedia.org/P31225 and previous config saved to /var/cache/conftool/dbconfig/20220717-004804-ladsgroup.json

16 July 2022

  • curprev 00:4700:47, 16 July 2022imported>Stashbot 306,607 bytes +27,543 ryankemper@cumin1001: END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host elastic2064.codfw.wmnet with OS bullseye

15 July 2022

  • curprev 00:3000:30, 15 July 2022imported>Stashbot 279,064 bytes +31,156 TimStarling: on ms-fe1010 restarting swift-proxy

14 July 2022

  • curprev 00:4400:44, 14 July 2022imported>Stashbot 247,908 bytes +16,545 krinkle@deploy1002: Synchronized php-1.39.0-wmf.19/includes/ResourceLoader/: Ie11bdfdcf5e6724 (duration: 02m 55s)

12 July 2022

  • curprev 22:3222:32, 12 July 2022imported>Stashbot 231,363 bytes +15,830 bking@cumin1001: END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host elastic2039.codfw.wmnet with OS bullseye
  • curprev 00:1000:10, 12 July 2022imported>Stashbot 215,533 bytes +11,642 ejegg: updated payments-wiki from 53a7b7bd to 2f95d8b4

11 July 2022

  • curprev 00:2300:23, 11 July 2022imported>Stashbot 203,891 bytes +379 mwdebug-deploy@deploy1002: helmfile [codfw] DONE helmfile.d/services/mwdebug: apply

9 July 2022

  • curprev 13:3413:34, 9 July 2022imported>Stashbot 203,512 bytes +504 mwdebug-deploy@deploy1002: helmfile [codfw] DONE helmfile.d/services/mwdebug: apply
  • curprev 01:4401:44, 9 July 2022imported>Stashbot 203,008 bytes +12,736 mwdebug-deploy@deploy1002: helmfile [codfw] DONE helmfile.d/services/mwdebug: apply

8 July 2022

  • curprev 00:0200:02, 8 July 2022imported>Stashbot 190,272 bytes +47,463 pt1979@cumin2002: END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host db2181.codfw.wmnet with OS bullseye

7 July 2022

  • curprev 00:5800:58, 7 July 2022imported>Stashbot 142,809 bytes +50,193 mwdebug-deploy@deploy1002: helmfile [codfw] DONE helmfile.d/services/mwdebug: apply

5 July 2022

  • curprev 23:3023:30, 5 July 2022imported>Stashbot 92,616 bytes +32,932 ebernhardson: start restore of commonswiki_file from thanos-swift to cloudelastic

4 July 2022

  • curprev 20:0920:09, 4 July 2022imported>Stashbot 59,684 bytes +22,620 andrew@cumin1001: END (FAIL) - Cookbook sre.hosts.reboot-single (exit_code=1) for host cloudcontrol1004.wikimedia.org

3 July 2022

  • curprev 11:3611:36, 3 July 2022imported>Stashbot 37,064 bytes +255 _joe_: temporarily raised replicas for shellbox to 24

2 July 2022

  • curprev 05:3605:36, 2 July 2022imported>Stashbot 36,809 bytes +2,607 bmansurov@deploy1002: Finished deploy [airflow-dags/research@b3fe77c]: (no justification provided) (duration: 00m 09s)
  • curprev 00:4500:45, 2 July 2022imported>Stashbot 34,202 bytes +30,284 ladsgroup@cumin1001: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on db1140.eqiad.wmnet with reason: Maintenance

1 July 2022

  • curprev 01:3901:39, 1 July 2022imported>Stashbot 3,918 bytes −776,405 krinkle@deploy1002: Synchronized tests/: I60edfb0f60 (1/3) (duration: 03m 32s)

30 June 2022

  • curprev 01:3601:36, 30 June 2022imported>Stashbot 780,323 bytes +52,007 pt1979@cumin2002: END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host db2158.codfw.wmnet with OS bullseye

29 June 2022

  • curprev 00:1800:18, 29 June 2022imported>Stashbot 728,316 bytes +67,167 pt1979@cumin2002: END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host cloudgw2003-dev.codfw.wmnet with OS bullseye

27 June 2022

  • curprev 23:5123:51, 27 June 2022imported>Stashbot 661,149 bytes +85,388 cmjohnson@cumin1001: START - Cookbook sre.hosts.provision for host mw1474.mgmt.eqiad.wmnet with reboot policy FORCED
(newest | oldest) View (newer 50 | ) (20 | 50 | 100 | 250 | 500)