You are browsing a read-only backup copy of Wikitech. The primary site can be found at wikitech.wikimedia.org

Server Admin Log: Revision history

Jump to navigation Jump to search

Diff selection: Mark the radio buttons of the revisions to compare and hit enter or the button at the bottom.
Legend: (cur) = difference with latest revision, (prev) = difference with preceding revision, m = minor edit.

(newest | oldest) View (newer 50 | ) (20 | 50 | 100 | 250 | 500)

27 January 2023

  • curprev 01:1601:16, 27 January 2023imported>Stashbot 559,678 bytes +62,951 eevans@cumin1001: END (PASS) - Cookbook sre.cassandra.roll-restart (exit_code=0) for nodes matching cassandra-dev2*: Applying configuration change to cassandra-dev cluster - eevans@cumin1001

26 January 2023

  • curprev 01:2401:24, 26 January 2023imported>Stashbot 496,727 bytes +35,241 ejegg: payments-wiki upgraded from 15395d05 to 08b8c3bc (upgraded from MW 1.35 to MW 1.39)

25 January 2023

  • curprev 01:1701:17, 25 January 2023imported>Stashbot 461,486 bytes +48,935 legoktm: adjusting Gerrit group "Campaigns Team" so it is not recursively a member of itself

24 January 2023

  • curprev 01:1601:16, 24 January 2023imported>Stashbot 412,551 bytes +38,290 eevans@cumin1001: END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host restbase1031.eqiad.wmnet

20 January 2023

18 January 2023

  • curprev 23:4723:47, 18 January 2023imported>Stashbot 352,750 bytes +20,082 zabe: run populateCulComment.php on all group0 and group1 wikis # T327290
  • curprev 01:1301:13, 18 January 2023imported>Stashbot 332,668 bytes +24,670 sukhe@cumin2002: END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host cp2031.codfw.wmnet

16 January 2023

14 January 2023

13 January 2023

  • curprev 23:3923:39, 13 January 2023imported>Stashbot 300,244 bytes +10,059 mutante: people2002 - systemctl reset-failed after removing auto_restart_rsync timers
  • curprev 01:2601:26, 13 January 2023imported>Stashbot 290,185 bytes +53,216 pt1979@cumin2002: END (PASS) - Cookbook sre.hardware.upgrade-firmware (exit_code=False) upgrade firmware for hosts ['an-mariadb1002']

12 January 2023

  • curprev 01:1501:15, 12 January 2023imported>Stashbot 236,969 bytes +44,353 marostegui@cumin1001: dbctl commit (dc=all): 'Repooling after maintenance db2176 (T321391)', diff saved to https://phabricator.wikimedia.org/P43056 and previous config saved to /var/cache/conftool/dbconfig/20230112-011526-marostegui.json

10 January 2023

  • curprev 23:5823:58, 10 January 2023imported>Stashbot 192,616 bytes +46,411 krinkle@deploy1002: Finished deploy [integration/docroot@b7c82a3]: (no justification provided) (duration: 00m 15s)
  • curprev 00:4800:48, 10 January 2023imported>Stashbot 146,205 bytes +26,510 bking@cumin1001: END (PASS) - Cookbook sre.elasticsearch.rolling-operation (exit_code=0) Operation.UPGRADE (3 nodes at a time) for ElasticSearch cluster search_codfw: plugin upgrade - bking@cumin1001 - T324247

6 January 2023

4 January 2023

3 January 2023

2 January 2023

  • curprev 10:0410:04, 2 January 2023imported>Stashbot 345 bytes +229 jelto@cumin1001: END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host otrs1001.eqiad.wmnet

1 January 2023

31 December 2022

  • curprev 19:1119:11, 31 December 2022imported>Stashbot 552,815 bytes +154 AndyRussG: payments-wiki upgraded c212825e -> f02e3585, config c1c4a9f6 -> 8103bce6

30 December 2022

  • curprev 21:3621:36, 30 December 2022imported>Stashbot 552,661 bytes +126 dcausse: restarting blazegraph on wdqs1006 and wdqs1013 (BlazegraphFreeAllocatorsDecreasingRapidly)

29 December 2022

  • curprev 23:2623:26, 29 December 2022imported>Stashbot 552,535 bytes +629 ryankemper@cumin2002: END (FAIL) - Cookbook sre.wdqs.data-reload (exit_code=99)

22 December 2022

  • curprev 18:2718:27, 22 December 2022imported>Stashbot 551,906 bytes +7,038 btullis@cumin1001: END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host kafka-jumbo1015.eqiad.wmnet with OS bullseye

21 December 2022

  • curprev 23:4123:41, 21 December 2022imported>Stashbot 544,868 bytes +1,082 ejegg: civicrm upgraded from d80f9550 to e3405a4e
  • curprev 00:1000:10, 21 December 2022imported>Stashbot 543,786 bytes +7,035 eileen: + fc0536195a12df9bc7a896f77db6b2c8e609352e Check for correct fin type name in hasEndowment

20 December 2022

18 December 2022

  • curprev 19:4019:40, 18 December 2022imported>Stashbot 520,139 bytes +785 sukhe: ran sudo cumin -b 1 -s 30 'A:mw-api and A:eqiad' 'restart-php7.4-fpm' [at 18:55 UTC]: T325477

17 December 2022

  • curprev 14:3614:36, 17 December 2022imported>Stashbot 519,354 bytes +264 aikochou@deploy1002: helmfile [ml-serve-codfw] Ran 'sync' command on namespace 'experimental' for release 'main' .

16 December 2022

  • curprev 19:5519:55, 16 December 2022imported>Stashbot 519,090 bytes +5,844 robh@cumin2002: END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host ganeti4007.ulsfo.wmnet with OS bullseye
  • curprev 00:5100:51, 16 December 2022imported>Stashbot 513,246 bytes +24,332 mutante: puppetmasters - merged gerrit:868481 to "revert" gerrit:866644,ran puppet and 'systemctl reset-failed' via cumin on 10 masters, resolved monitoring alerts

15 December 2022

  • curprev 00:5800:58, 15 December 2022imported>Stashbot 488,914 bytes +47,486 cwhite@cumin2002: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on logstash2026.codfw.wmnet with reason: host reimage

14 December 2022

  • curprev 01:2201:22, 14 December 2022imported>Stashbot 441,428 bytes +24,146 cwhite@cumin2002: END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host logstash2037.codfw.wmnet with OS bullseye

12 December 2022

10 December 2022

  • curprev 03:4603:46, 10 December 2022imported>Stashbot 402,542 bytes +1,087 ryankemper@cumin2002: END (FAIL) - Cookbook sre.elasticsearch.rolling-operation (exit_code=99) Operation.UPGRADE (3 nodes at a time) for ElasticSearch cluster search_codfw: search_codfw elasticsearch and plugin upgrade - ryankemper@cumin2002

9 December 2022

  • curprev 23:5923:59, 9 December 2022imported>Stashbot 401,455 bytes +16,799 bking@cumin2002: END (FAIL) - Cookbook sre.wdqs.data-reload (exit_code=99)
  • curprev 01:1101:11, 9 December 2022imported>Stashbot 384,656 bytes +64,721 eevans@cumin1001: START - Cookbook sre.hosts.reimage for host cassandra-dev2002.codfw.wmnet with OS buster

8 December 2022

  • curprev 01:0501:05, 8 December 2022imported>Stashbot 319,935 bytes +71,471 bblack: lvsNNNN: restart pybal to apply etcd key changes on all "high-traffic1" lvs at all sites - T324336

7 December 2022

  • curprev 00:2100:21, 7 December 2022imported>Stashbot 248,464 bytes +42,999 cmjohnson@cumin1001: END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host kubernetes1024.eqiad.wmnet with OS bullseye

6 December 2022

  • curprev 01:2501:25, 6 December 2022imported>Stashbot 205,465 bytes +81,524 ladsgroup@cumin1001: dbctl commit (dc=all): 'Repooling after maintenance db2178', diff saved to https://phabricator.wikimedia.org/P42379 and previous config saved to /var/cache/conftool/dbconfig/20221206-012539-ladsgroup.json

4 December 2022

  • curprev 04:1904:19, 4 December 2022imported>Stashbot 123,941 bytes +177 TheresNoTime: T302486 : `[samtar@mwmaint1002 ~]$ mwscript maintenance/fixMergeHistoryCorruption.php --wiki enwiki --dry-run --ns 828`

3 December 2022

  • curprev 00:1700:17, 3 December 2022imported>Stashbot 123,764 bytes +12,040 cwhite: draining shards from logstash1010, logstash1033, logstash1034, logstash1035 - T321410

2 December 2022

  • curprev 00:0900:09, 2 December 2022imported>Stashbot 111,724 bytes −1,825,217 rzl@cumin1001: conftool action : set/pooled=no; selector: name=mw14(45|46).eqiad.wmnet,cluster=jobrunner

30 November 2022

  • curprev 01:2201:22, 30 November 2022imported>Stashbot 1,936,941 bytes +129,140 marostegui@cumin1001: dbctl commit (dc=all): 'Repooling after maintenance db2176 (T321126)', diff saved to https://phabricator.wikimedia.org/P41834 and previous config saved to /var/cache/conftool/dbconfig/20221130-012218-marostegui.json

29 November 2022

  • curprev 01:1701:17, 29 November 2022imported>Stashbot 1,807,801 bytes +121,792 ladsgroup@cumin1001: dbctl commit (dc=all): 'Repooling after maintenance db1166 (T322618)', diff saved to https://phabricator.wikimedia.org/P41530 and previous config saved to /var/cache/conftool/dbconfig/20221129-011707-ladsgroup.json

27 November 2022

  • curprev 03:0103:01, 27 November 2022imported>Stashbot 1,686,009 bytes +943 ladsgroup@cumin1001: dbctl commit (dc=all): 'db2105 (re)pooling @ 100%: Maint', diff saved to https://phabricator.wikimedia.org/P41257 and previous config saved to /var/cache/conftool/dbconfig/20221127-030126-ladsgroup.json

26 November 2022

  • curprev 21:3421:34, 26 November 2022imported>Stashbot 1,685,066 bytes +3,790 urandom: initiating Cassandra bootstrap, aqs1021-b -- T307802
  • curprev 01:1601:16, 26 November 2022imported>Stashbot 1,681,276 bytes +58,470 ladsgroup@cumin1001: dbctl commit (dc=all): 'Repooling after maintenance db1188', diff saved to https://phabricator.wikimedia.org/P41244 and previous config saved to /var/cache/conftool/dbconfig/20221126-011647-ladsgroup.json
(newest | oldest) View (newer 50 | ) (20 | 50 | 100 | 250 | 500)