You are browsing a read-only backup copy of Wikitech. The live site can be found at wikitech.wikimedia.org

Server Admin Log: Difference between revisions

From Wikitech-static
Jump to navigation Jump to search
imported>Stashbot
(ejegg: re-enabled fundraising cron jobs)
imported>Stashbot
(ejegg: updated Fundraising CiviCRM from d534f4e966 to 217a1f8c63)
Line 1: Line 1:
== 2020-01-02 ==
== 2020-01-02 ==
* 23:33 ejegg: updated Fundraising CiviCRM from {{Gerrit|d534f4e966}} to {{Gerrit|217a1f8c63}}
* 23:09 ejegg: updated Fundraising CiviCRM from {{Gerrit|6936aa0262}} to {{Gerrit|d534f4e966}}
* 22:44 ejegg: updated fundraising CiviCRM from {{Gerrit|f4db7fdb31}} to {{Gerrit|6936aa0262}}
* 20:48 ejegg: updated Fundraising CiviCRM from {{Gerrit|abf0019c44}} to {{Gerrit|f4db7fdb31}}
* 20:30 sbassett@deploy1001: Synchronized wmf-config/CommonSettings.php: Deploying revert of temporary patch for [[phab:T241503|T241503]] (permissions clean-up) (duration: 00m 53s)
* 19:57 sbassett@deploy1001: Synchronized wmf-config/CommonSettings.php: Deploying temporary patch for [[phab:T241503|T241503]] (permissions clean-up) (duration: 00m 54s)
* 18:53 ejegg: re-enabled fundraising cron jobs
* 18:29 ejegg: disabled fundraising cron jobs
* 16:15 moritzm: restarting Apache on graphite* hosts to pick up SASL security update
* 16:11 moritzm: restarting Apache on webperf* hosts to pick up SASL security update
* 15:52 moritzm: restarting Apache on puppetboard* hosts to pick up SASL security update
* 15:46 moritzm: restarting FPM on parsoid canary to pick up SASL security update
* 14:27 marostegui: Deploy schema change on s6 codfw master (db2129) with replication - [[phab:T234052|T234052]]
* 14:22 marostegui: Deploy schema change on s5 eqiad hosts - [[phab:T234052|T234052]]
* 14:05 moritzm: restarting PHP/Apache on mw canaries to pick up SASL security update
* 13:47 moritzm: installing cyrus-sasl security updates on Stretch/Buster
* 13:23 marostegui: Deploy schema change on s5 codfw master (db2123) with replication - [[phab:T234052|T234052]]
* 13:17 moritzm: upgrading jessie servers to intel-microcode 3.20191115.2
* 13:14 foks: scramble password for Windy906
* 13:00 XioNoX: enable BFD traceoptions on cr1-eqiad and cr3-knams - [[phab:T240659|T240659]]
* 12:41 moritzm: upgrade recently reimaged hosts to puppet 5 [[phab:T239832|T239832]]
* 12:32 moritzm: upgrade recently reimaged hosts to facter 3 [[phab:T239832|T239832]]
* 12:09 jmm@cumin2001: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0)
* 12:07 jmm@cumin2001: START - Cookbook sre.hosts.downtime
* 11:53 moritzm: restarting FPM on scandium to clear opcache health
* 11:42 moritzm: reimaging mw2277 to validate fix for puppet5/facter3 installation on new installs [[phab:T239832|T239832]]
* 11:23 arturo: import more openstack packages into stretch-wikimedia thirdparty/openstack-pike-stretch ([[phab:T241347|T241347]])
* 10:43 filippo@cumin1001: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0)
* 10:40 filippo@cumin1001: START - Cookbook sre.hosts.downtime
* 09:58 filippo@cumin1001: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0)
* 09:58 filippo@cumin1001: START - Cookbook sre.hosts.downtime
* 08:58 marostegui@cumin1001: dbctl commit (dc=all): 'Depool db2076 [[phab:T241647|T241647]]', diff saved to https://phabricator.wikimedia.org/P10021 and previous config saved to /var/cache/conftool/dbconfig/20200102-085806-marostegui.json
* 08:35 marostegui: Upgrade db2090
* 08:26 marostegui: Upgrade db2075
* 08:10 marostegui: Deploy schema change on officewiki.flow_wiki_ref on s3 master (db1123) [[phab:T241387|T241387]]
* 07:49 marostegui: Deploy schema change on techconductwiki.flow_wiki_ref (empty table) on s3 master (db1123) [[phab:T241387|T241387]]
* 07:26 marostegui: Upgrade db2079
* 07:18 marostegui: Deploy schema change on labswiki.flow_wiki_ref (empty table) [[phab:T241387|T241387]]
* 06:46 marostegui: Deploy schema change on db2131 - [[phab:T241387|T241387]]
* 06:44 marostegui: Repool labsdb1009
* 06:30 marostegui: Upgrade labsdb1009
* 06:29 marostegui: Remove revision partitions from db2087:3316 [[phab:T239453|T239453]]
* 06:26 marostegui@cumin1001: dbctl commit (dc=all): 'Depool db2087:3316 - [[phab:T239453|T239453]]', diff saved to https://phabricator.wikimedia.org/P10020 and previous config saved to /var/cache/conftool/dbconfig/20200102-062650-marostegui.json
* 06:22 marostegui: Depool labsdb1009
* 00:22 ejegg: re-enabled fundraising cron jobs
* 00:22 ejegg: re-enabled fundraising cron jobs



Revision as of 23:33, 2 January 2020

2020-01-02

  • 23:33 ejegg: updated Fundraising CiviCRM from d534f4e966 to 217a1f8c63
  • 23:09 ejegg: updated Fundraising CiviCRM from 6936aa0262 to d534f4e966
  • 22:44 ejegg: updated fundraising CiviCRM from f4db7fdb31 to 6936aa0262
  • 20:48 ejegg: updated Fundraising CiviCRM from abf0019c44 to f4db7fdb31
  • 20:30 sbassett@deploy1001: Synchronized wmf-config/CommonSettings.php: Deploying revert of temporary patch for T241503 (permissions clean-up) (duration: 00m 53s)
  • 19:57 sbassett@deploy1001: Synchronized wmf-config/CommonSettings.php: Deploying temporary patch for T241503 (permissions clean-up) (duration: 00m 54s)
  • 18:53 ejegg: re-enabled fundraising cron jobs
  • 18:29 ejegg: disabled fundraising cron jobs
  • 16:15 moritzm: restarting Apache on graphite* hosts to pick up SASL security update
  • 16:11 moritzm: restarting Apache on webperf* hosts to pick up SASL security update
  • 15:52 moritzm: restarting Apache on puppetboard* hosts to pick up SASL security update
  • 15:46 moritzm: restarting FPM on parsoid canary to pick up SASL security update
  • 14:27 marostegui: Deploy schema change on s6 codfw master (db2129) with replication - T234052
  • 14:22 marostegui: Deploy schema change on s5 eqiad hosts - T234052
  • 14:05 moritzm: restarting PHP/Apache on mw canaries to pick up SASL security update
  • 13:47 moritzm: installing cyrus-sasl security updates on Stretch/Buster
  • 13:23 marostegui: Deploy schema change on s5 codfw master (db2123) with replication - T234052
  • 13:17 moritzm: upgrading jessie servers to intel-microcode 3.20191115.2
  • 13:14 foks: scramble password for Windy906
  • 13:00 XioNoX: enable BFD traceoptions on cr1-eqiad and cr3-knams - T240659
  • 12:41 moritzm: upgrade recently reimaged hosts to puppet 5 T239832
  • 12:32 moritzm: upgrade recently reimaged hosts to facter 3 T239832
  • 12:09 jmm@cumin2001: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0)
  • 12:07 jmm@cumin2001: START - Cookbook sre.hosts.downtime
  • 11:53 moritzm: restarting FPM on scandium to clear opcache health
  • 11:42 moritzm: reimaging mw2277 to validate fix for puppet5/facter3 installation on new installs T239832
  • 11:23 arturo: import more openstack packages into stretch-wikimedia thirdparty/openstack-pike-stretch (T241347)
  • 10:43 filippo@cumin1001: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0)
  • 10:40 filippo@cumin1001: START - Cookbook sre.hosts.downtime
  • 09:58 filippo@cumin1001: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0)
  • 09:58 filippo@cumin1001: START - Cookbook sre.hosts.downtime
  • 08:58 marostegui@cumin1001: dbctl commit (dc=all): 'Depool db2076 T241647', diff saved to https://phabricator.wikimedia.org/P10021 and previous config saved to /var/cache/conftool/dbconfig/20200102-085806-marostegui.json
  • 08:35 marostegui: Upgrade db2090
  • 08:26 marostegui: Upgrade db2075
  • 08:10 marostegui: Deploy schema change on officewiki.flow_wiki_ref on s3 master (db1123) T241387
  • 07:49 marostegui: Deploy schema change on techconductwiki.flow_wiki_ref (empty table) on s3 master (db1123) T241387
  • 07:26 marostegui: Upgrade db2079
  • 07:18 marostegui: Deploy schema change on labswiki.flow_wiki_ref (empty table) T241387
  • 06:46 marostegui: Deploy schema change on db2131 - T241387
  • 06:44 marostegui: Repool labsdb1009
  • 06:30 marostegui: Upgrade labsdb1009
  • 06:29 marostegui: Remove revision partitions from db2087:3316 T239453
  • 06:26 marostegui@cumin1001: dbctl commit (dc=all): 'Depool db2087:3316 - T239453', diff saved to https://phabricator.wikimedia.org/P10020 and previous config saved to /var/cache/conftool/dbconfig/20200102-062650-marostegui.json
  • 06:22 marostegui: Depool labsdb1009
  • 00:22 ejegg: re-enabled fundraising cron jobs

2020-01-01

  • 21:13 ejegg: stopped fundraising cron jobs to calculate EOY summaries
  • 04:57 andrewbogott: depooling labweb1002 so I can hotfix labweb1001 for T240734


Archives

See Server admin log/Archives.