You are browsing a read-only backup copy of Wikitech. The live site can be found at wikitech.wikimedia.org

Related changes

Jump to navigation Jump to search

Enter a page name to see changes on pages linked to or from that page. (To see members of a category, enter Category:Name of category). Changes to pages on your Watchlist are in bold.

Recent changes options Show last 50 | 100 | 250 | 500 changes in last 1 | 3 | 7 | 14 | 30 days
Hide registered users | Hide anonymous users | Hide my edits | Hide bots | Hide minor edits
Show new changes starting from 06:23, 12 August 2022
   
Page name:
List of abbreviations:
N
This edit created a new page (also see list of new pages)
m
This is a minor edit
b
This edit was performed by a bot
(±123)
The page size changed by this number of bytes

12 August 2022

     01:03  Server Admin Log diffhist +25,321 Stashbot (ladsgroup@cumin1001: dbctl commit (dc=all): 'Depooling db1121 (T312863)', diff saved to https://phabricator.wikimedia.org/P32369 and previous config saved to /var/cache/conftool/dbconfig/20220812-010312-ladsgroup.json)

11 August 2022

     00:58  Server Admin Log diffhist +35,722 Stashbot (sukhe@puppetmaster1001: conftool action : set/pooled=no; selector: name=cp2042.codfw.wmnet,service=varnish-fe)

9 August 2022

     23:17  Server Admin Log diffhist +16,655 Stashbot (bking@cumin1001: conftool action : set/weight=10:pooled=yes; selector: name=wdqs1011.eqiad.wmnet)
 m   14:39  Conftool diffhist +134 Bking (add example for depooling nodes from a specific DC)

8 August 2022

     23:52  Server Admin Log diffhist +14,190 Stashbot (tstarling@deploy1002: Synchronized wmf-config/InitialiseSettings.php: clean up testwiki experiments T314750 (duration: 03m 19s))
     11:05  Netbox diffhist −675 Ayounsi (Remove mentions to CSV dumps)

7 August 2022

     19:58  Server Admin Log diffhist +3,230 Stashbot (taavi: taavi@mwmaint1002 ~ $ echo "https://upload.wikimedia.org/wikipedia/commons/1/15/Keep_tidy_ask.svg" | mwscript purgeList.php --wiki enwiki # T314712)

6 August 2022

     17:59  Server Admin Log diffhist +2,395 Stashbot (ladsgroup@cumin1001: dbctl commit (dc=all): 'Depooling db1149 (T312863)', diff saved to https://phabricator.wikimedia.org/P32295 and previous config saved to /var/cache/conftool/dbconfig/20220806-175916-ladsgroup.json)

5 August 2022

     22:20  Server Admin Log‎‎ 2 changes history +59,372 [Stashbot‎ (2×)]
     
22:20 (cur | prev) +9,421 Stashbot (dcausse@deploy1002: Finished deploy [wikimedia/discovery/analytics@71fe016]: Fix schedule_interval for image_recommendation_weekly (duration: 02m 01s))
     
00:53 (cur | prev) +49,951 Stashbot (dzahn@cumin1001: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 8 days, 0:00:00 on gerrit2001.wikimedia.org with reason: decom, replaced by gerrit2002)

4 August 2022

     01:23  Server Admin Log diffhist +66,383 Stashbot (marostegui@cumin1001: dbctl commit (dc=all): 'Repooling after maintenance db1146:3312 (T312972)', diff saved to https://phabricator.wikimedia.org/P32278 and previous config saved to /var/cache/conftool/dbconfig/20220804-012341-marostegui.json)

3 August 2022

     07:48  Icinga diffhist +286 Filippo Giunchedi (Add runbook for IcingaOverload)

2 August 2022

     22:39  Server Admin Log‎‎ 2 changes history −683,333 [Stashbot‎ (2×)]
     
22:39 (cur | prev) +58,081 Stashbot (mwdebug-deploy@deploy1002: helmfile [codfw] DONE helmfile.d/services/mwdebug: apply)
     
00:41 (cur | prev) −741,414 Stashbot (mwdebug-deploy@deploy1002: helmfile [codfw] DONE helmfile.d/services/mwdebug: apply)
     06:05  LibreNMS diffhist −774 Ayounsi (→‎Features)

1 August 2022

     01:00  Server Admin Log diffhist +3,017 Stashbot (krinkle@deploy1002: Synchronized multiversion/: Ic0dbcba9f60f20a (duration: 03m 31s))

30 July 2022

     01:44  Server Admin Log‎‎ 2 changes history +11,196 [Stashbot‎ (2×)]
     
01:44 (cur | prev) +392 Stashbot (bking@cumin1001: END (FAIL) - Cookbook sre.elasticsearch.rolling-operation (exit_code=99) Operation.REIMAGE (1 nodes at a time) for ElasticSearch cluster search_codfw: codfw cluster reimage (bullseye upgrade) - bking@cumin1001 - T289135)
     
00:55 (cur | prev) +10,804 Stashbot (bking@cumin1001: START - Cookbook sre.hosts.reimage for host elastic2028.codfw.wmnet with OS bullseye)

29 July 2022

     00:48  Server Admin Log diffhist +35,853 Stashbot (TimStarling: slowly restarting (with batch 1 sleep 5) trafficserver on text caches to fully deploy g 817086 T313578)

28 July 2022

     01:26  Server Admin Log diffhist +36,833 Stashbot (mwdebug-deploy@deploy1002: helmfile [codfw] START helmfile.d/services/mwdebug: apply)

26 July 2022

     23:59  Server Admin Log‎‎ 2 changes history +59,606 [Stashbot‎ (2×)]
     
23:59 (cur | prev) +28,393 Stashbot (tzatziki: removing one file for legal compliance)
     
00:11 (cur | prev) +31,213 Stashbot (TimStarling: restarted php7.2-fpm on the 9 canary hosts in eqiad T313770)
     19:44  Dbctl diffhist +42 Krinkle (wikify headings and format, h1 is page title, h2 is top-most heading level)

24 July 2022

     20:54  Server Admin Log‎‎ 2 changes history +22,439 [Stashbot‎ (2×)]
     
20:54 (cur | prev) +4,271 Stashbot (btullis@cumin1001: END (PASS) - Cookbook sre.ganeti.reboot-vm (exit_code=0) for VM archiva1002.wikimedia.org)
     
00:37 (cur | prev) +18,168 Stashbot (ladsgroup@cumin1001: dbctl commit (dc=all): 'Depooling db1158 (T312863)', diff saved to https://phabricator.wikimedia.org/P31802 and previous config saved to /var/cache/conftool/dbconfig/20220724-003718-ladsgroup.json)

23 July 2022

     01:37  Server Admin Log diffhist +27,357 Stashbot (ladsgroup@cumin1001: dbctl commit (dc=all): 'Repooling after maintenance db1170:3317', diff saved to https://phabricator.wikimedia.org/P31750 and previous config saved to /var/cache/conftool/dbconfig/20220723-013755-ladsgroup.json)

22 July 2022

     00:44  Server Admin Log diffhist +68,956 Stashbot (mwdebug-deploy@deploy1002: helmfile [codfw] DONE helmfile.d/services/mwdebug: apply)

21 July 2022

     00:44  Server Admin Log diffhist +51,704 Stashbot (bking@cumin1001: END (ERROR) - Cookbook sre.elasticsearch.rolling-operation (exit_code=97) Operation.REIMAGE (1 nodes at a time) for ElasticSearch cluster search_codfw: codfw cluster reimage (bullseye upgrade) - bking@cumin1001 - T289135)

20 July 2022

     12:21  Grafana.wikimedia.org diffhist +398 Filippo Giunchedi (→‎Features)
     06:19  Netbox diffhist +91 Ayounsi (→‎Monitoring)
     01:27  Server Admin Log diffhist +56,169 Stashbot (bking@cumin1001: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on elastic2052.codfw.wmnet with reason: host reimage)

18 July 2022

     23:58  Server Admin Log diffhist +61,137 Stashbot (andrew@cumin1001: END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host cloudvirt1050.eqiad.wmnet)

17 July 2022

     18:05  Server Admin Log‎‎ 2 changes history +24,033 [Stashbot‎ (2×)]
     
18:05 (cur | prev) +10,758 Stashbot (ladsgroup@cumin1001: dbctl commit (dc=all): 'Repooling after maintenance db1161 (T312984)', diff saved to https://phabricator.wikimedia.org/P31256 and previous config saved to /var/cache/conftool/dbconfig/20220717-180539-ladsgroup.json)
     
00:48 (cur | prev) +13,275 Stashbot (ladsgroup@cumin1001: dbctl commit (dc=all): 'Repooling after maintenance db1101:3317', diff saved to https://phabricator.wikimedia.org/P31225 and previous config saved to /var/cache/conftool/dbconfig/20220717-004804-ladsgroup.json)

16 July 2022

     00:47  Server Admin Log diffhist +27,543 Stashbot (ryankemper@cumin1001: END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host elastic2064.codfw.wmnet with OS bullseye)

15 July 2022

     09:44  Netbox diffhist +381 Ayounsi (→‎Troubleshooting)
     00:30  Server Admin Log diffhist +31,156 Stashbot (TimStarling: on ms-fe1010 restarting swift-proxy)

14 July 2022

 m   20:17  Server Lifecycle/Reimage diffhist +377 Bking (added NIC firmware failure scenario)
 m   09:56  Cumin diffhist −260 Volans (Reverted edits by Volans (talk) to last revision by Krinkle)
     05:22  Dbctl diffhist +53 Krinkle
     05:16  Conftool diffhist +55 Krinkle (+{{Navigation Wikimedia infrastructure|expand=infrafun}})
     05:16  Spicerack diffhist +52 Krinkle ({{Navigation Wikimedia infrastructure|expand=infrafun}})
     00:44  Server Admin Log diffhist +16,545 Stashbot (krinkle@deploy1002: Synchronized php-1.39.0-wmf.19/includes/ResourceLoader/: Ie11bdfdcf5e6724 (duration: 02m 55s))