You are browsing a read-only backup copy of Wikitech. The live site can be found at wikitech.wikimedia.org

Nova Resource:Admin/SAL: Revision history

Jump to navigation Jump to search

Diff selection: Mark the radio buttons of the revisions to compare and hit enter or the button at the bottom.
Legend: (cur) = difference with latest revision, (prev) = difference with preceding revision, m = minor edit.

(newest | oldest) View (newer 50 | ) (20 | 50 | 100 | 250 | 500)

6 June 2023

  • curprev 19:0919:09, 6 June 2023imported>Stashbot 543,222 bytes +7,942 andrewbogott: also increased RAM and secgroup-rule quota for Trove T337882

5 June 2023

  • curprev 09:4109:41, 5 June 2023imported>Stashbot 535,280 bytes +142 arturo: [codfw1dev] rebooting bastion-codfw1dev-02 (no IP address in the main interface) T336963

2 June 2023

  • curprev 14:4014:40, 2 June 2023imported>Stashbot 535,138 bytes +2,438 wm-bot2: Restarting openstack services on cloudcontrol2001-dev: ['nova-conductor', 'nova-scheduler', 'nova-api', 'nova-api-metadata', 'cinder-scheduler', 'cinder-volume', 'neutron-api', 'neutron-rpc-server', 'trove-api', 'trove-conductor', 'trove-taskmanager', 'keystone', 'keystone-admin', 'glance-api', 'magnum-api', 'magnum-conductor', 'heat-api', 'heat-api-cfn', 'heat-engine'] - cookbook ran by arturo@nostromo

26 May 2023

  • curprev 16:0316:03, 26 May 2023imported>Stashbot 532,700 bytes +133 andrewbogott: "maintain-views --all-databases --replace-all" on clouddb1021 for T337446

22 May 2023

  • curprev 19:5419:54, 22 May 2023imported>Stashbot 532,567 bytes +159 andrewbogott: deleting project 'citelearn' as per https://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2022_Purge#SHUTDOWN_citelearn

21 May 2023

  • curprev 23:2923:29, 21 May 2023imported>Stashbot 532,408 bytes +5,574 wm-bot2: Restarting openstack services on cloudservices2004-dev: ['designate-mdns', 'designate-sink', 'designate-central', 'designate-producer', 'designate-worker', 'designate-agent'] - cookbook ran by andrew@bullseye

19 May 2023

  • curprev 14:5314:53, 19 May 2023imported>Stashbot 526,834 bytes +2,797 wm-bot2: Restarting openstack services on cloudservices2004-dev: ['designate-mdns', 'designate-sink', 'designate-central', 'designate-producer', 'designate-worker', 'designate-agent'] - cookbook ran by andrew@bullseye

18 May 2023

  • curprev 21:3921:39, 18 May 2023imported>Stashbot 524,037 bytes +10,772 andrewbogott: deleting obsolete roles '4d8cad783d6342efa8414d7d36fbc034 | projectadmin_renamed_for_T330759' and 'f473273fac7146b3bdbf22e5d4504f95 | user_renamed_for_T330759' on eqiad1. State pre-deletion is dumped to /root/allassignmentspredeletion.txt on cloudcontrol1007.

15 May 2023

  • curprev 14:2814:28, 15 May 2023imported>Stashbot 513,265 bytes +11,699 wm-bot2: Drained cloudvirt1034.eqiad.wmnet - cookbook ran by andrew@bullseye

12 May 2023

  • curprev 17:5217:52, 12 May 2023imported>Stashbot 501,566 bytes +444 wm-bot2: Restarting openstack services on cloudcontrol2001-dev: ['nova-conductor', 'nova-scheduler', 'nova-api', 'nova-api-metadata', 'cinder-scheduler', 'cinder-volume', 'neutron-api', 'neutron-rpc-server', 'trove-api', 'trove-conductor', 'trove-taskmanager', 'keystone', 'keystone-admin', 'glance-api', 'magnum-api', 'magnum-conductor', 'heat-api', 'heat-api-cfn', 'heat-engine'] - cookbook ran by andrew@bullseye

10 May 2023

  • curprev 16:0916:09, 10 May 2023imported>Stashbot 501,122 bytes +25,407 wm-bot2: Restarting openstack services on cloudservices1005: ['designate-producer', 'designate-sink', 'designate-worker', 'designate-central', 'designate-mdns', 'designate-agent'] - cookbook ran by andrew@bullseye

5 May 2023

  • curprev 16:0716:07, 5 May 2023imported>Stashbot 475,715 bytes +1,780 wm-bot2: Drained cloudvirt1024.eqiad.wmnet (T336064) - cookbook ran by andrew@bullseye

4 May 2023

  • curprev 22:4922:49, 4 May 2023imported>Stashbot 473,935 bytes +216 andrewbogott: removed fullstack-* puppet reports on puppetmaster-02.cloudinfra-codfw1dev.codfw1dev.wikimedia.cloud and cloud-puppetmaster-03.cloudinfra.eqiad.wmflabs to free up disk space

2 May 2023

  • curprev 13:0113:01, 2 May 2023imported>Stashbot 473,719 bytes +1,046 wm-bot2: Adding OSD cloudcephosd2001-dev.codfw.wmnet... (1/1) - cookbook ran by dcaro@vulcanus

1 May 2023

  • curprev 17:0917:09, 1 May 2023imported>Stashbot 472,673 bytes +784 wm-bot2: Adding OSD cloudcephosd2001-dev.codfw.wmnet... (1/1) - cookbook ran by dcaro@vulcanus

18 April 2023

  • curprev 22:5222:52, 18 April 2023imported>Stashbot 471,889 bytes +18,480 wm-bot2: Restarting openstack services on cloudcontrol1007: ['neutron-api', 'neutron-rpc-server'] - cookbook ran by andrew@bullseye

17 April 2023

  • curprev 08:4908:49, 17 April 2023imported>Stashbot 453,409 bytes +146 wm-bot2: Increased quotas by 9 cores, 1 instances, 16 ram (T334695) - cookbook ran by dcaro@vulcanus

6 April 2023

  • curprev 17:0317:03, 6 April 2023imported>Stashbot 453,263 bytes +122 andrewbogott: running wmcs-wikireplica-dns on cloudcontrol1005 to update tools-db dns entries

4 April 2023

  • curprev 17:2317:23, 4 April 2023imported>Stashbot 453,141 bytes +213 andrewbogott: resetting all three rabbitmq nodes and restarting all openstack services as per https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Rabbitmq#Resetting_the_HA_setup

28 March 2023

  • curprev 13:5613:56, 28 March 2023imported>Stashbot 452,928 bytes +361 andrewbogott: depooling cloudweb1003 before switch upgrade

27 March 2023

  • curprev 14:3014:30, 27 March 2023imported>Stashbot 452,567 bytes +1,800 wm-bot2: Drained cloudvirt1024.eqiad.wmnet - cookbook ran by andrew@bullseye

22 March 2023

8 March 2023

  • curprev 21:4521:45, 8 March 2023imported>Stashbot 450,671 bytes +172 bd808: maintain-kubeusers container in CrashLoopBackoff, investigating

7 March 2023

  • curprev 16:0616:06, 7 March 2023imported>Stashbot 450,499 bytes +691 andrewbogott: updated application credential roles, replacing 'user' with 'reader' and 'projectadmin' with 'member': update application_credential_role set role_id='f75a3c410bca4e96a1cf6ac103b0ccaf' where role_id='f473273fac7146b3bdbf22e5d4504f95' and update application_credential_role set role_id='38676f30eaeb44518bf7e144a73c8da6' where role_id='4d8cad783d6342efa8414d7d36fbc034'

3 March 2023

2 March 2023

  • curprev 16:1716:17, 2 March 2023imported>Stashbot 449,718 bytes +1,892 wm-bot2: The cluster is now rebalanced after adding the new OSDs ['cloudcephosd1010.eqiad.wmnet'] (T329504) - cookbook ran by dcaro@vulcanus

28 February 2023

  • curprev 22:4722:47, 28 February 2023imported>Stashbot 447,826 bytes +1,434 andrewbogott: adding new 'member' role assignment to every user/project pair that currently has the 'user' assignment. T330759

27 February 2023

  • curprev 21:0121:01, 27 February 2023imported>Stashbot 446,392 bytes +2,790 wm-bot2: The cluster is now rebalanced after adding the new OSDs ['cloudcephosd1004.eqiad.wmnet'] (T329502) - cookbook ran by dcaro@vulcanus

22 February 2023

  • curprev 08:2508:25, 22 February 2023imported>Stashbot 443,602 bytes +1,244 wm-bot2: Depooled and destroyed OSD daemons [31, 30, 29, 28, 27, 26, 25, 24] and removed the OSD host cloudcephosd1004 from the CRUSH map. (T329502) - cookbook ran by dcaro@vulcanus

21 February 2023

  • curprev 20:2720:27, 21 February 2023imported>Stashbot 442,358 bytes +879 andrewbogott: deleted 200 more orphaned VM images with wmcs-novastats-cephleaks

16 February 2023

  • curprev 19:1419:14, 16 February 2023imported>Stashbot 441,479 bytes +3,906 wm-bot2: The cluster is now rebalanced after adding the new OSDs ['cloudcephosd1002.eqiad.wmnet'] (T329498) - cookbook ran by dcaro@vulcanus

15 February 2023

  • curprev 14:5314:53, 15 February 2023imported>Stashbot 437,573 bytes +906 andrewbogott: deleting another 100 leaked VM images with wmcs-novastats-cephleaks

14 February 2023

  • curprev 13:1713:17, 14 February 2023imported>Stashbot 436,667 bytes +135 andrewbogott: restarting all eqiad1 openstack services because that seems to sometimes help things *shrug*

13 February 2023

  • curprev 14:0614:06, 13 February 2023imported>Stashbot 436,532 bytes +285 wm-bot2: Set the ceph cluster for eqiad1 in maintenance, alert silence ids: 8fbf6bfd-eec1-4d81-8e0d-ea431d8411ee (T329498) - cookbook ran by dcaro@vulcanus

9 February 2023

  • curprev 21:1721:17, 9 February 2023imported>Stashbot 436,247 bytes +152 andrewbogott: deleted 10% of leaked VM ceph images using wmcs-novastats-cephleaks (only 10% out of an abundance of caution)

8 February 2023

  • curprev 17:0817:08, 8 February 2023imported>Stashbot 436,095 bytes +112 arturo: changing to cloudgw network setup, make VIPs /32 (T295774)

7 February 2023

  • curprev 11:2611:26, 7 February 2023imported>Stashbot 435,983 bytes +138 arturo: [codfw1dev] testing network changes in cloudgw, expect unrealiable network (T295774)

4 February 2023

  • curprev 13:4413:44, 4 February 2023imported>Stashbot 435,845 bytes +118 taavi: drop old columns from oathauth_users table on labtestwiki T328131

3 February 2023

  • curprev 15:0015:00, 3 February 2023imported>Stashbot 435,727 bytes +205 andrewbogott: restarted nova services in eqiad1 in an attempt to eke out another day or two of stability

2 February 2023

  • curprev 13:1413:14, 2 February 2023imported>Stashbot 435,522 bytes +302 dcaro_away: draining osd.48 from node cloudcephosd1001 (T316544)

30 January 2023

  • curprev 22:3422:34, 30 January 2023imported>Stashbot 435,220 bytes +276 wm-bot2: Upgraded and rebooted host cloudrabbit1002.wikimedia.org - cookbook ran by andrew@bullseye

27 January 2023

  • curprev 20:0820:08, 27 January 2023imported>Stashbot 434,944 bytes +461 wm-bot2: Upgraded and rebooted host cloudcontrol2005-dev.wikimedia.org - cookbook ran by andrew@bullseye

26 January 2023

  • curprev 20:3420:34, 26 January 2023imported>Stashbot 434,483 bytes +136 andrewbogott: shutting down mariadb on cloudbackup2001-dev, testing the waters for T328079

22 January 2023

  • curprev 03:4203:42, 22 January 2023imported>Stashbot 434,347 bytes +111 andrewbogott: reset eqiad1 rabbitmq in an attempt to resolve some mild instability

20 January 2023

  • curprev 15:2615:26, 20 January 2023imported>Stashbot 434,236 bytes +801 wm-bot2: Removed cloudweb hosts (cloudweb2002-dev.wikimedia.org) from maintenance mode. - cookbook ran by andrew@bullseye

19 January 2023

  • curprev 18:0618:06, 19 January 2023imported>Stashbot 433,435 bytes +680 wm-bot2: Removed cloudweb hosts (cloudweb2002-dev.wikimedia.org) from maintenance mode. - cookbook ran by andrew@bullseye

18 January 2023

  • curprev 22:3222:32, 18 January 2023imported>Stashbot 432,755 bytes +7,287 wm-bot2: Set cloudweb cloudweb2002-dev.wikimedia.org maintenance (downtime id: 347cb75e-215e-4b85-ae14-4ce1934c70c7, use this to unset) - cookbook ran by andrew@bullseye

17 January 2023

  • curprev 19:3219:32, 17 January 2023imported>Stashbot 425,468 bytes +556 wm-bot2: Upgraded and rebooted host cloudbackup2002.codfw.wmnet - cookbook ran by andrew@bullseye

13 January 2023

  • curprev 17:3617:36, 13 January 2023imported>Stashbot 424,912 bytes +2,718 wm-bot2: Restarting openstack services on cloudcontrol2005-dev: ['nova-conductor', 'nova-scheduler', 'nova-api', 'nova-api-metadata'] - cookbook ran by andrew@bullseye

12 January 2023

  • curprev 22:3422:34, 12 January 2023imported>Stashbot 422,194 bytes +253 andrewbogott: updated the Bullseye base image with the upstream 20221219 build
(newest | oldest) View (newer 50 | ) (20 | 50 | 100 | 250 | 500)