You are browsing a read-only backup copy of Wikitech. The primary site can be found at wikitech.wikimedia.org
Sandbox: Difference between revisions
Jump to navigation
Jump to search
imported>Jcrespo (test) |
imported>Krinkle (→x) |
||
Line 1: | Line 1: | ||
== x == | |||
Test. | |||
== x == | |||
Test. | |||
<div style="background:black;width:100%;height:2000px;">== 2017-07-13 == | |||
* 20:01 smalyshev@tin: Finished deploy [wdqs/wdqs@a32dbeb]: Redeploy GUI due to breakage in [[phab:T165228|T165228]] (duration: 02m 19s) | |||
* 19:59 smalyshev@tin: Started deploy [wdqs/wdqs@a32dbeb]: Redeploy GUI due to breakage in [[phab:T165228|T165228]] | |||
* 18:39 dzahn@neodymium: conftool action : set/pooled=yes; selector: name=mw2202.codfw.wmnet | |||
* 18:38 dzahn@neodymium: conftool action : set/pooled=yes; selector: name=mw2201.codfw.wmnet | |||
* 18:31 arlolra: Updated Parsoid to {{Gerrit|71c07681}} ([[phab:T169293|T169293]]) | |||
* 18:29 bblack: upgrading nginx on +wmf1 hosts: conf[1001-1003].eqiad.wmnet,cp1048.eqiad.wmnet,cp3036.esams.wmnet,elastic2020.codfw.wmnet,hassaleh.codfw.wmnet,hassium.eqiad.wmnet | |||
* 18:22 arlolra@tin: Finished deploy [parsoid/deploy@d0041f2]: Updating Parsoid to {{Gerrit|71c07681}} (duration: 11m 12s) | |||
* 18:11 arlolra@tin: Started deploy [parsoid/deploy@d0041f2]: Updating Parsoid to {{Gerrit|71c07681}} | |||
* 17:46 volans: re-enabling puppet and force run on 'R:Package = nginx-common' | |||
* 17:38 bblack: restarting varnish-be on cp1049 (mailbox lag) | |||
* 17:36 bblack: restarting puppetmasters, staggered | |||
* 17:06 volans: disabled puppet on nitrogen | |||
* 16:34 chasemp: labstore2001:~# systemctl disable lvm2-activation && systemctl disable lvm2-activation-early && systemctl reset-failed (slated to be reimaged by madhu -- this alert is non-actionable) | |||
* 16:19 urandom: Starting cassandra-a, restbase2007 (OOM) | |||
* 16:03 dzahn@neodymium: conftool action : set/pooled=no; selector: name=mw2202.codfw.wmnet | |||
* 16:03 dzahn@neodymium: conftool action : set/pooled=no; selector: name=mw2201.codfw.wmnet | |||
* 15:33 marostegui: Deploy alter table on s1 - labsdb1009 - [[phab:T166204|T166204]] | |||
* 15:14 ejegg: updated civicrm from {{Gerrit|0aa0f8fb45e161ba2e3a2e2353075cf6bdc67f6c}} to {{Gerrit|8840b94254bd258ae96157dd81adc4e2ebf68531}} | |||
* 14:49 marostegui: Skip maiwikimedia database creation which is breaking dbstore2001 replication - [[phab:T168788|T168788]] | |||
* 14:42 godog: roll-restart cassandra in services-test to pick up renewed certs | |||
* 14:21 marostegui: Run redact_sanitarium on db1069 and db1095 for maiwikimedia - [[phab:T168788|T168788]] | |||
* 14:19 Reedy: `mwscript extensions/WikimediaMaintenance/createExtensionTables.php --wiki=maiwikimedia Translate` for [[phab:T168782|T168782]] | |||
* 14:13 moritzm: rebooting graphite1* for kernel update | |||
* 13:11 zeljkof: EU SWAT finished | |||
* 13:09 zfilipin@tin: Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:364983{{!}}Add enwiki as import source for specieswiki (T170094)]] (duration: 00m 47s) | |||
* 12:52 moritzm: installing nginx security updates on cp1* | |||
* 12:12 marostegui@tin: Synchronized wmf-config/db-eqiad.php: Repool db1053 - [[phab:T168661|T168661]] (duration: 01m 03s) | |||
* 11:40 akosiaris: stop ircecho, icinga is misbehaving badly, no point it having it around | |||
* 11:28 akosiaris: restart icinga, it's reporting wrong stuff all over the place | |||
* 10:35 moritzm: installing nginx security updates on cp3* | |||
* 10:09 moritzm: rebooting graphite2* for kernel update | |||
* 10:04 ema: lvs[12]006: upgrade pybal to 1.13.9 [[phab:T82747|T82747]] [[phab:T154759|T154759]] | |||
* 09:43 ema: lvs1010: upgrade pybal to 1.13.9 [[phab:T82747|T82747]] [[phab:T154759|T154759]] | |||
* 09:41 ema: pybal 1.13.9 uploaded to apt.w.o | |||
* 09:21 moritzm: installing nginx security updates on cp2* | |||
* 08:32 moritzm: enabling jobrunner/jobchron on mw1260 (jessie video scaler) | |||
* 08:19 godog: upgrade grafana to 4.4.1 on krypton - [[phab:T169773|T169773]] | |||
* 08:11 jynus: powercycle pc2006, was down | |||
* 08:09 jmm@puppetmaster1001: conftool action : set/pooled=yes; selector: mw1260.eqiad.wmnet | |||
* 07:58 marostegui: Deploy alter table on s4 - db1053 - [[phab:T168661|T168661]] | |||
* 07:48 marostegui@tin: Synchronized wmf-config/db-eqiad.php: Depool db1053 - [[phab:T168661|T168661]] (duration: 00m 47s) | |||
* 07:33 moritzm: rebooting netmon1001 | |||
* 06:57 moritzm: installing apache security updates on remaining mw1* hosts | |||
* 06:51 moritzm: installing nginx security updates on cp4* | |||
* 06:51 marostegui: Manually deploy some alter tables on dbstore1001 for enwiki - [[phab:T166204|T166204]] | |||
* 06:42 _joe_: rolling restart of pybal on low-traffic balancers | |||
* 06:14 XioNoX: restricting ssh algorithms on network devices - [[phab:T170369|T170369]] | |||
* 06:11 moritzm: fixed salt setup for reimaged stat1006 | |||
* 03:09 l10nupdate@tin: ResourceLoader cache refresh completed at Thu Jul 13 03:09:35 UTC 2017 (duration 7m 8s) | |||
* 03:02 l10nupdate@tin: scap sync-l10n completed (1.30.0-wmf.9) (duration: 07m 57s) | |||
* 02:34 l10nupdate@tin: scap sync-l10n completed (1.30.0-wmf.7) (duration: 09m 54s) | |||
* 02:26 mutante: labtestpuppetmaster2001 - flapping icinga alerts about salt-minion starting and stopping constantly - there is an accepted salt-key but it was rejected by the master, server was reinstalled but still old key - deleted old key, accepted new key ([[phab:T167157|T167157]])</div> | |||
== x == | |||
Test. | |||
== x == | |||
Test. | |||
Revision as of 20:12, 13 July 2017
x
Test.
x
Test.
== 2017-07-13 ==
- 20:01 smalyshev@tin: Finished deploy [wdqs/wdqs@a32dbeb]: Redeploy GUI due to breakage in T165228 (duration: 02m 19s)
- 19:59 smalyshev@tin: Started deploy [wdqs/wdqs@a32dbeb]: Redeploy GUI due to breakage in T165228
- 18:39 dzahn@neodymium: conftool action : set/pooled=yes; selector: name=mw2202.codfw.wmnet
- 18:38 dzahn@neodymium: conftool action : set/pooled=yes; selector: name=mw2201.codfw.wmnet
- 18:31 arlolra: Updated Parsoid to 71c07681 (T169293)
- 18:29 bblack: upgrading nginx on +wmf1 hosts: conf[1001-1003].eqiad.wmnet,cp1048.eqiad.wmnet,cp3036.esams.wmnet,elastic2020.codfw.wmnet,hassaleh.codfw.wmnet,hassium.eqiad.wmnet
- 18:22 arlolra@tin: Finished deploy [parsoid/deploy@d0041f2]: Updating Parsoid to 71c07681 (duration: 11m 12s)
- 18:11 arlolra@tin: Started deploy [parsoid/deploy@d0041f2]: Updating Parsoid to 71c07681
- 17:46 volans: re-enabling puppet and force run on 'R:Package = nginx-common'
- 17:38 bblack: restarting varnish-be on cp1049 (mailbox lag)
- 17:36 bblack: restarting puppetmasters, staggered
- 17:06 volans: disabled puppet on nitrogen
- 16:34 chasemp: labstore2001:~# systemctl disable lvm2-activation && systemctl disable lvm2-activation-early && systemctl reset-failed (slated to be reimaged by madhu -- this alert is non-actionable)
- 16:19 urandom: Starting cassandra-a, restbase2007 (OOM)
- 16:03 dzahn@neodymium: conftool action : set/pooled=no; selector: name=mw2202.codfw.wmnet
- 16:03 dzahn@neodymium: conftool action : set/pooled=no; selector: name=mw2201.codfw.wmnet
- 15:33 marostegui: Deploy alter table on s1 - labsdb1009 - T166204
- 15:14 ejegg: updated civicrm from 0aa0f8f to 8840b94
- 14:49 marostegui: Skip maiwikimedia database creation which is breaking dbstore2001 replication - T168788
- 14:42 godog: roll-restart cassandra in services-test to pick up renewed certs
- 14:21 marostegui: Run redact_sanitarium on db1069 and db1095 for maiwikimedia - T168788
- 14:19 Reedy: `mwscript extensions/WikimediaMaintenance/createExtensionTables.php --wiki=maiwikimedia Translate` for T168782
- 14:13 moritzm: rebooting graphite1* for kernel update
- 13:11 zeljkof: EU SWAT finished
- 13:09 zfilipin@tin: Synchronized wmf-config/InitialiseSettings.php: SWAT: Add enwiki as import source for specieswiki (T170094) (duration: 00m 47s)
- 12:52 moritzm: installing nginx security updates on cp1*
- 12:12 marostegui@tin: Synchronized wmf-config/db-eqiad.php: Repool db1053 - T168661 (duration: 01m 03s)
- 11:40 akosiaris: stop ircecho, icinga is misbehaving badly, no point it having it around
- 11:28 akosiaris: restart icinga, it's reporting wrong stuff all over the place
- 10:35 moritzm: installing nginx security updates on cp3*
- 10:09 moritzm: rebooting graphite2* for kernel update
- 10:04 ema: lvs[12]006: upgrade pybal to 1.13.9 T82747 T154759
- 09:43 ema: lvs1010: upgrade pybal to 1.13.9 T82747 T154759
- 09:41 ema: pybal 1.13.9 uploaded to apt.w.o
- 09:21 moritzm: installing nginx security updates on cp2*
- 08:32 moritzm: enabling jobrunner/jobchron on mw1260 (jessie video scaler)
- 08:19 godog: upgrade grafana to 4.4.1 on krypton - T169773
- 08:11 jynus: powercycle pc2006, was down
- 08:09 jmm@puppetmaster1001: conftool action : set/pooled=yes; selector: mw1260.eqiad.wmnet
- 07:58 marostegui: Deploy alter table on s4 - db1053 - T168661
- 07:48 marostegui@tin: Synchronized wmf-config/db-eqiad.php: Depool db1053 - T168661 (duration: 00m 47s)
- 07:33 moritzm: rebooting netmon1001
- 06:57 moritzm: installing apache security updates on remaining mw1* hosts
- 06:51 moritzm: installing nginx security updates on cp4*
- 06:51 marostegui: Manually deploy some alter tables on dbstore1001 for enwiki - T166204
- 06:42 _joe_: rolling restart of pybal on low-traffic balancers
- 06:14 XioNoX: restricting ssh algorithms on network devices - T170369
- 06:11 moritzm: fixed salt setup for reimaged stat1006
- 03:09 l10nupdate@tin: ResourceLoader cache refresh completed at Thu Jul 13 03:09:35 UTC 2017 (duration 7m 8s)
- 03:02 l10nupdate@tin: scap sync-l10n completed (1.30.0-wmf.9) (duration: 07m 57s)
- 02:34 l10nupdate@tin: scap sync-l10n completed (1.30.0-wmf.7) (duration: 09m 54s)
- 02:26 mutante: labtestpuppetmaster2001 - flapping icinga alerts about salt-minion starting and stopping constantly - there is an accepted salt-key but it was rejected by the master, server was reinstalled but still old key - deleted old key, accepted new key (T167157)
x
Test.
x
Test.