You are browsing a read-only backup copy of Wikitech. The live site can be found at wikitech.wikimedia.org

Nova Resource:Admin/SAL: Revision history

Jump to navigation Jump to search

Diff selection: Mark the radio buttons of the revisions to compare and hit enter or the button at the bottom.
Legend: (cur) = difference with latest revision, (prev) = difference with preceding revision, m = minor edit.

(newest | oldest) View (newer 50 | ) (20 | 50 | 100 | 250 | 500)

29 June 2022

  • curprev 08:4508:45, 29 June 2022imported>Stashbot 221,866 bytes +217 wm-bot2: Finished rebooting node cloudcephosd1021.eqiad.wmnet - cookbook ran by dcaro@vulcanus

28 June 2022

  • curprev 13:0313:03, 28 June 2022imported>Stashbot 221,649 bytes +137 taavi: grant the tools project access to the g3.cores16.ram64.disk20.10xiops flavor T301949

22 June 2022

  • curprev 16:4816:48, 22 June 2022imported>Stashbot 221,512 bytes +278 taavi: restart designate-*.service on both cloudservices nodes

21 June 2022

  • curprev 04:4804:48, 21 June 2022imported>Stashbot 221,234 bytes +230 andrewbogott: stopping nova-fullstack agent on cloudcontrol1003; it's going to page us otherwise and we're all AFK tomorrow

17 June 2022

  • curprev 17:5317:53, 17 June 2022imported>Stashbot 221,004 bytes +251 andrewbogott: switching to a new python-based health check for galera and haproxy. This may make things more stable, or it may not. T310664

15 June 2022

  • curprev 11:3411:34, 15 June 2022imported>Stashbot 220,753 bytes +86 taavi: restart neutron-linuxbridge-agent on cloudvirt1022

14 June 2022

  • curprev 16:2616:26, 14 June 2022imported>Stashbot 220,667 bytes +1,288 wm-bot2: OSDs (['cloudcephosd1001', 'cloudcephosd1002', 'cloudcephosd1003', 'cloudcephosd1004', 'cloudcephosd1005', 'cloudcephosd1006', 'cloudcephosd1007', 'cloudcephosd1008', 'cloudcephosd1009', 'cloudcephosd1010', 'cloudcephosd1011', 'cloudcephosd1012', 'cloudcephosd1013', 'cloudcephosd1014', 'cloudcephosd1015', 'cloudcephosd1016', 'cloudcephosd1017', 'cloudcephosd1018', 'cloudcephosd1019', 'cloudcephosd1020', 'cloudcephosd1021', 'cl

13 June 2022

  • curprev 11:1411:14, 13 June 2022imported>Stashbot 219,379 bytes +876 wm-bot2: Finished rebooting node cloudcephosd1021.eqiad.wmnet (T309789) - cookbook ran by dcaro@vulcanus

6 June 2022

  • curprev 13:2113:21, 6 June 2022imported>Stashbot 218,503 bytes +133 andrewbogott: restarting mysql/galera on cloudcontrol100x in an attempt to stabilize some flapping there

2 June 2022

  • curprev 07:5107:51, 2 June 2022imported>Stashbot 218,370 bytes +99 taavi: restart neutron-linuxbridge-agent.service on cloudvirt1034 T309732
  • curprev 00:3700:37, 2 June 2022imported>Stashbot 218,271 bytes +388 andrewbogott: updated nameservers for codfw1dev instances via 'openstack subnet set --dns-nameserver etc.'

30 May 2022

  • curprev 17:4317:43, 30 May 2022imported>Stashbot 217,883 bytes +110 andrewbogott: restarting neutron-rpc and neutron-api services on cloudcontrol1xxx

29 May 2022

  • curprev 14:5514:55, 29 May 2022imported>Stashbot 217,773 bytes +223 andrewbogott: restarting nova services on all eqiad1 cloudcontrol nodes to recover from rabbit breakage

25 May 2022

  • curprev 20:0120:01, 25 May 2022imported>Stashbot 217,550 bytes +175 balloons: clean up cinder backup a bit, restart service due to network outage

19 May 2022

  • curprev 15:2115:21, 19 May 2022imported>Stashbot 217,375 bytes +176 andrewbogott: resetting password for the 'troveguest' rabbitmq user. I think I may have broken this during a recent rebuild of the rabbitmq cluster

18 May 2022

  • curprev 15:4215:42, 18 May 2022imported>Stashbot 217,199 bytes +109 andrewbogott: updated the 'debian-11.0-bullseye' glance image with a fresh build

14 May 2022

  • curprev 11:3311:33, 14 May 2022imported>Stashbot 217,090 bytes +103 taavi: deleted projects 'ores' and 'ores-staging' T308102

13 May 2022

  • curprev 06:2006:20, 13 May 2022imported>Stashbot 216,987 bytes +11,620 wm-bot2: Safe reboot of 'cloudvirt1045.eqiad.wmnet' finished successfully. - cookbook ran by andrew@buster
  • curprev 01:0001:00, 13 May 2022imported>Stashbot 205,367 bytes +14,074 wm-bot2: Draining 'cloudvirt1035.eqiad.wmnet'. - cookbook ran by andrew@buster

11 May 2022

  • curprev 18:4818:48, 11 May 2022imported>Stashbot 191,293 bytes +3,204 wm-bot2: Set cloudvirt 'cloudvirt1022.eqiad.wmnet' maintenance. - cookbook ran by andrew@buster

10 May 2022

  • curprev 21:4321:43, 10 May 2022imported>Stashbot 188,089 bytes +3,450 wm-bot: Set cloudvirt 'cloudvirt1021.eqiad.wmnet' maintenance. - cookbook ran by andrew@buster

7 May 2022

  • curprev 01:3301:33, 7 May 2022imported>Stashbot 184,639 bytes +483 wm-bot: Drained 'cloudvirt1016.eqiad.wmnet'. - cookbook ran by andrew@buster

3 May 2022

  • curprev 20:3820:38, 3 May 2022imported>Stashbot 184,156 bytes +173 andrewbogott: upgrading clouddb2001-dev in place

2 May 2022

29 April 2022

  • curprev 14:2214:22, 29 April 2022imported>Stashbot 183,921 bytes +270 andrewbogott: changing login.toolforge.org, bastion.toolforge.org, and dev.toolforge.org dns entries to refer to the new Buster bastions T277653 https://wikitech.wikimedia.org/wiki/News/Toolforge_Stretch_deprecation#Timeline

27 April 2022

  • curprev 14:5114:51, 27 April 2022imported>Stashbot 183,651 bytes +8,234 wm-bot: Finished rebooting the nodes ['cloudcephosd1001', 'cloudcephosd1002', 'cloudcephosd1003', 'cloudcephosd1004', 'cloudcephosd1005', 'cloudcephosd1006', 'cloudcephosd1007', 'cloudcephosd1008', 'cloudcephosd1009', 'cloudcephosd1010', 'cloudcephosd1011', 'cloudcephosd1012', 'cloudcephosd1013', 'cloudcephosd1014', 'cloudcephosd1015', 'cloudcephosd1016', 'cloudcephosd1017', 'cloudcephosd1018', 'cloudcephosd1019', 'cloudcephosd1020', 'cloud

26 April 2022

  • curprev 10:3610:36, 26 April 2022imported>Stashbot 175,417 bytes +227 taavi: [codfw1dev] updated designate pool to 2004/2005-dev according to the instructions on https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/DNS/Designate#Initial_designate/pdns_node_setup

22 April 2022

  • curprev 10:3310:33, 22 April 2022imported>Stashbot 175,190 bytes +130 taavi: [codfw1dev] restart designate-sink on both new cloudservices host to fix rabbitmq connectivity

21 April 2022

  • curprev 05:3805:38, 21 April 2022imported>Stashbot 175,060 bytes +100 andrewbogott: replaced cloudservices200[2,3] with cloudservices200[4,5]

19 April 2022

  • curprev 15:2915:29, 19 April 2022imported>Stashbot 174,960 bytes +92 andrewbogott: stopping all VMs on cloudvirt1019, reimaging host

18 April 2022

  • curprev 15:2315:23, 18 April 2022imported>Stashbot 174,868 bytes +205 andrewbogott: reimaging cloudvirt1020, leaving VMs in place

14 April 2022

  • curprev 20:1420:14, 14 April 2022imported>Stashbot 174,663 bytes +147 andrewbogott: restarting nova-api and nova-conductor services in a superstitious attempt to reduce open DB connections

13 April 2022

  • curprev 22:0122:01, 13 April 2022imported>Stashbot 174,516 bytes +116 andrewbogott: restarting galera on cloudcontrols (one by one) to clear open connections

11 April 2022

9 April 2022

  • curprev 19:5519:55, 9 April 2022imported>Stashbot 174,329 bytes +236 andrewbogott: reimaging cloudbackup1001-dev to bullseye

7 April 2022

  • curprev 12:5112:51, 7 April 2022imported>Stashbot 174,093 bytes +152 wm-bot: Set cloudvirt 'cloudvirt1016.eqiad.wmnet' maintenance. (T305631) - cookbook ran by arturo@nostromo

6 April 2022

  • curprev 09:1209:12, 6 April 2022imported>Stashbot 173,941 bytes +713 arturo: [codf1dev] installing python3-eventlet 0.30.2-5~bpo11+1 on all required servers (cloudvirt, cloudnet, cloudcontrol) (T305157)

30 March 2022

  • curprev 11:2011:20, 30 March 2022imported>Stashbot 173,228 bytes +114 arturo: apply urpf strict filter to eqiad cloud-hosts vlan - T285461

29 March 2022

23 March 2022

  • curprev 22:5322:53, 23 March 2022imported>Stashbot 173,032 bytes +6,374 wm-bot: Drained 'cloudvirt1045.eqiad.wmnet'. (T281276) - cookbook ran by andrew@buster

22 March 2022

  • curprev 22:5922:59, 22 March 2022imported>Stashbot 166,658 bytes +263 wm-bot: Set cloudvirt 'cloudvirt1027.eqiad.wmnet' maintenance. (T281276) - cookbook ran by andrew@buster

17 March 2022

  • curprev 01:0901:09, 17 March 2022imported>Stashbot 166,395 bytes +509 wm-bot: Drained 'cloudvirt1016.eqiad.wmnet'. (T281276) - cookbook ran by andrew@buster

15 March 2022

  • curprev 20:5820:58, 15 March 2022imported>Stashbot 165,886 bytes +941 wm-bot: Drained 'cloudvirt1026.eqiad.wmnet'. (T281276) - cookbook ran by andrew@buster

14 March 2022

  • curprev 21:2421:24, 14 March 2022imported>Stashbot 164,945 bytes +3,074 wm-bot: Drained 'cloudvirt1025.eqiad.wmnet'. (T281276) - cookbook ran by andrew@buster

8 March 2022

  • curprev 18:2918:29, 8 March 2022imported>Stashbot 161,871 bytes +3,117 wm-bot: Set cloudvirt 'cloudvirt1022.eqiad.wmnet' maintenance. (T281276) - cookbook ran by andrew@buster

3 March 2022

  • curprev 08:4908:49, 3 March 2022imported>Stashbot 158,754 bytes +105 taavi: deploying cloudmetrics grafana to grafana 8, T282863

2 March 2022

  • curprev 09:0609:06, 2 March 2022imported>Stashbot 158,649 bytes +138 arturo: merging core router firewall change https://gerrit.wikimedia.org/r/c/operations/homer/public/+/701347

28 February 2022

  • curprev 15:3015:30, 28 February 2022imported>Stashbot 158,511 bytes +132 dcaro: cleaning up leftover snapshots from failed backups of the maps volume (T302720)

24 February 2022

  • curprev 17:0417:04, 24 February 2022imported>Stashbot 158,379 bytes +464 andrewbogott: upgrading eqiad1 and codfw1dev to mariadb 10.5.15+maria~bullseye via 'apt-get install libmariadb3:amd64 galera-4 mariadb-server'

23 February 2022

  • curprev 20:3920:39, 23 February 2022imported>Stashbot 157,915 bytes +1,620 taavi: added domain-wide 'designateadmin' and 'observer' roles to project-proxy-dns-manager service account T295246
(newest | oldest) View (newer 50 | ) (20 | 50 | 100 | 250 | 500)