You are browsing a read-only backup copy of Wikitech. The live site can be found at wikitech.wikimedia.org
Server Admin Log: Difference between revisions
Jump to navigation
Jump to search
imported>Stashbot (urbanecm@deploy1001: Synchronized php-1.36.0-wmf.20/vendor/: 3278ffd107888757c4620383160a6d5fa67d05b5: Bump wikimedia/parsoid to v0.13.0-a19 (T269685) (duration: 01m 16s)) |
imported>Stashbot (ejegg: updated payments-wiki from 756c2f7ce0 to df80a99b40) |
||
Line 1: | Line 1: | ||
== 2020-12-10 == | |||
* 00:42 ejegg: updated payments-wiki from {{Gerrit|756c2f7ce0}} to {{Gerrit|df80a99b40}} | |||
* 00:26 robh: cr2-eqsin bad fan being swapped via [[phab:T267544|T267544]] | |||
== 2020-12-09 == | == 2020-12-09 == | ||
* 23:21 mutante: repooling parse2001 after buster reimage - [[phab:T268524|T268524]] | |||
* 23:19 dzahn@cumin1001: conftool action : set/pooled=no; selector: name=mw2243.codfw.wmnet | |||
* 23:16 mutante: repooling parse2001 after buster reimage - [[phab:T245757|T245757]] | |||
* 23:15 dzahn@cumin1001: conftool action : set/pooled=yes; selector: name=parse2001.codfw.wmnet | |||
* 23:04 mutante: zero.wikimedia.beta.wmflabs.org removed from beta_sites (deployment-prep) [[phab:T187716|T187716]] | |||
* 22:32 dzahn@cumin1001: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) | |||
* 22:30 dzahn@cumin1001: START - Cookbook sre.hosts.downtime | |||
* 21:40 bstorm: shutting down labstore1006 for maintenance [[phab:T268285|T268285]] | |||
* 20:27 mutante: mw1281,mw1282,mw1283 - scap pull | |||
* 20:26 mutante: repooling mw1281,mw1282,mw1283 - now in rack A8 | |||
* 20:26 dzahn@cumin1001: conftool action : set/pooled=yes; selector: name=mw128[1-3].eqiad.wmnet | |||
* 20:22 dzahn@cumin1001: conftool action : set/pooled=no; selector: name=mw1283.eqiad.wmnet | |||
* 20:22 dzahn@cumin1001: conftool action : set/pooled=no; selector: name=mw1282.eqiad.wmnet | |||
* 20:21 dzahn@cumin1001: conftool action : set/pooled=no; selector: name=mw1281.eqiad.wmnet | |||
* 20:18 twentyafterfour: wmf.21 looks good on group1 wikis. Still seeing [[phab:T269603|T269603]] but not at an increased rate. (refs [[phab:T264801|T264801]]) | |||
* 20:13 twentyafterfour@deploy1001: Synchronized php: group1 wikis to 1.36.0-wmf.21 (duration: 01m 02s) | |||
* 20:12 twentyafterfour@deploy1001: rebuilt and synchronized wikiversions files: group1 wikis to 1.36.0-wmf.21 | |||
* 19:38 urbanecm@deploy1001: Synchronized wmf-config/InitialiseSettings.php: {{Gerrit|ce01bbe7b05eda8065fc57c865a69370e8aae797}}: Enable ArticlePlaceholder at papwiki ([[phab:T223693|T223693]]) (duration: 01m 02s) | |||
* 19:17 twentyafterfour@deploy1001: Synchronized php-1.36.0-wmf.21/includes/page/Article.php: deploy {{Gerrit|0d99fe6d54}} Article::view - remove the old subtitle from doOutputFromParserCache. Bug: [[phab:T269727|T269727]] (duration: 01m 04s) | |||
* 18:59 mutante: testreduce1001 - installed make | |||
* 18:48 cmjohnson@cumin1001: END (PASS) - Cookbook sre.dns.netbox (exit_code=0) | |||
* 18:43 dzahn@cumin1001: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) | |||
* 18:42 cmjohnson@cumin1001: START - Cookbook sre.dns.netbox | |||
* 18:41 dzahn@cumin1001: START - Cookbook sre.hosts.downtime | |||
* 18:17 dzahn@cumin1001: conftool action : set/pooled=inactive; selector: name=mw2243.codfw.wmnet | |||
* 18:16 mutante: depooling mw2243 (jobrunner) for reimaging ([[phab:T245757|T245757]]) | |||
* 18:15 dzahn@cumin1001: conftool action : set/pooled=no; selector: name=mw2243.codfw.wmnet | |||
* 18:12 dzahn@cumin1001: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) | |||
* 18:12 dzahn@cumin1001: START - Cookbook sre.hosts.downtime | |||
* 18:05 mutante: mw1281,mw1282,mw1283 shut down for [[phab:T266164|T266164]] | |||
* 18:02 dzahn@cumin1001: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) | |||
* 18:02 dzahn@cumin1001: START - Cookbook sre.hosts.downtime | |||
* 18:02 dzahn@cumin1001: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) | |||
* 18:02 dzahn@cumin1001: START - Cookbook sre.hosts.downtime | |||
* 18:01 dzahn@cumin1001: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) | |||
* 18:01 dzahn@cumin1001: START - Cookbook sre.hosts.downtime | |||
* 17:59 clarakosi@deploy1001: helmfile [codfw] Ran 'sync' command on namespace 'changeprop-jobqueue' for release 'production' . | |||
* 17:58 clarakosi@deploy1001: helmfile [eqiad] Ran 'sync' command on namespace 'changeprop-jobqueue' for release 'production' . | |||
* 17:57 clarakosi@deploy1001: helmfile [staging] Ran 'sync' command on namespace 'changeprop-jobqueue' for release 'staging' . | |||
* 17:49 dzahn@cumin1001: conftool action : set/pooled=inactive; selector: name=mw128[1-3].eqiad.wmnet | |||
* 17:24 mutante: depooling 3 API appservers in eqiad to physically move to another rack | |||
* 17:23 dzahn@cumin1001: conftool action : set/pooled=no; selector: name=mw128[1-3].eqiad.wmnet | |||
* 16:52 mbsantos@deploy1001: helmfile [eqiad] Ran 'sync' command on namespace 'mobileapps' for release 'production' . | |||
* 16:49 mbsantos@deploy1001: helmfile [codfw] Ran 'sync' command on namespace 'mobileapps' for release 'production' . | |||
* 16:48 mbsantos@deploy1001: helmfile [staging] Ran 'sync' command on namespace 'mobileapps' for release 'staging' . | |||
* 16:10 ema: deployment-cache-text06: deploy varnish 6.0.0-1wm1 [[phab:T264398|T264398]] | |||
* 16:06 moritzm: updating mwdebug1003, parse2001, deploy1002, deploy2002 to wikidiff 1.10.0-1~wmf1+buster1 | |||
* 16:05 moritzm: importing wikidiff2 1.10.0-1~wmf1+buster1 to component/php72 [[phab:T250515|T250515]] | |||
* 15:56 hnowlan@puppetmaster1001: conftool action : set/pooled=yes; selector: dc=eqiad,cluster=maps,service=kartotherian,name=maps1001.eqiad.wmnet | |||
* 15:47 hnowlan: reimaging restbase2009 after disk replacement | |||
* 15:29 moritzm: restarting nginx on htmldump1001 to pick up OpenSSL security updates | |||
* 13:54 godog: experiment with rsync.service increased niceness on ms-be2057 - [[phab:T269337|T269337]] | |||
* 13:27 jmm@cumin2001: END (FAIL) - Cookbook sre.hosts.reboot-single (exit_code=99) | |||
* 13:25 jmm@cumin2001: START - Cookbook sre.hosts.reboot-single | |||
* 13:03 XioNoX: standardize Private-Peer BGP group on all cr* | |||
* 12:30 hnowlan@puppetmaster1001: conftool action : set/pooled=no; selector: dc=eqiad,cluster=maps,service=kartotherian,name=maps1001.eqiad.wmnet | |||
* 12:29 hnowlan@cumin1001: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) | |||
* 12:29 hnowlan@cumin1001: START - Cookbook sre.hosts.downtime | |||
* 12:24 Urbanecm: Eu B&C window done | |||
* 12:23 urbanecm@deploy1001: Synchronized w/static.php: {{Gerrit|cfb36023ac873c00e680032999b7c21c2a105132}}: Remove unsupported arg in MediaWiki::doPostOutputShutdown() call (duration: 01m 02s) | |||
* 12:20 hnowlan@puppetmaster1001: conftool action : set/pooled=no; selector: dc=codfw,cluster=restbase,service=restbase,name=restbase2009.codfw.wmnet | |||
* 12:16 urbanecm@deploy1001: Synchronized wmf-config/InitialiseSettings.php: {{Gerrit|3414289c8c7272185e30cacc3df5d5dbc719219d}}: Add extended-confirmed group and restriction level for bgwiki ([[phab:T269709|T269709]]) (duration: 01m 19s) | |||
* 11:06 godog: reboot ms-be1019 / ms-be1020 - [[phab:T268435|T268435]] | |||
* 10:56 godog: change librenms alerts and transport groups to use alertmanager - [[phab:T267018|T267018]] | |||
* 10:45 moritzm: installing openssl updates on Buster | |||
* 09:24 jbond42: make message mandatory for disable-puppet | |||
* 09:03 godog: swift codfw-prod: add ms-be20[58-61] - [[phab:T269337|T269337]] | |||
* 01:07 jforrester@deploy1001: Synchronized wmf-config/InitialiseSettings.php: Explicitly set wgAbuseFilterAflFilterMigrationStage ahead of train roll-out [[phab:T269712|T269712]] (duration: 01m 03s) | |||
* 00:53 urbanecm@deploy1001: Synchronized php-1.36.0-wmf.20/vendor/: {{Gerrit|3278ffd107888757c4620383160a6d5fa67d05b5}}: Bump wikimedia/parsoid to v0.13.0-a19 ([[phab:T269685|T269685]]) (duration: 01m 16s) | * 00:53 urbanecm@deploy1001: Synchronized php-1.36.0-wmf.20/vendor/: {{Gerrit|3278ffd107888757c4620383160a6d5fa67d05b5}}: Bump wikimedia/parsoid to v0.13.0-a19 ([[phab:T269685|T269685]]) (duration: 01m 16s) | ||
Line 650: | Line 722: | ||
* 00:17 ryankemper@cumin2001: START - Cookbook sre.wdqs.data-reload | * 00:17 ryankemper@cumin2001: START - Cookbook sre.wdqs.data-reload | ||
* 00:16 ryankemper@cumin1001: START - Cookbook sre.wdqs.data-reload | * 00:16 ryankemper@cumin1001: START - Cookbook sre.wdqs.data-reload | ||