You are browsing a read-only backup copy of Wikitech. The live site can be found at wikitech.wikimedia.org

Nova Resource:Admin/SAL: Revision history

View logs for this page

Jump to navigation Jump to search

Diff selection: Mark the radio buttons of the revisions to compare and hit enter or the button at the bottom.
Legend: (cur) = difference with latest revision, (prev) = difference with preceding revision, m = minor edit.

curprev 17:4317:43, 21 January 2020‎ imported>Stashbot‎ 27,054 bytes +253‎ bstorm_: remounting /mnt/nfs/dumps-labstore1007.wikimedia.org/ on all dumps-mounting projects

curprev 16:5916:59, 15 January 2020‎ imported>Stashbot‎ 26,801 bytes +144‎ bd808: Changed the config for cloud-announce mailing list so that lsit admins do not get bounce unsubscribe notices

curprev 14:0314:03, 14 January 2020‎ imported>Stashbot‎ 26,657 bytes +395‎ arturo: icinga downtime all cloudvirts for another 2h for fixing some icinga checks

curprev 13:3413:34, 13 January 2020‎ imported>Stashbot‎ 26,262 bytes +269‎ arturo: [¢odfw1dev] prevent neutron from allocating floating IPs from the wrong subnet by doing `neutron subnet-update --allocation-pool start=208.80.153.190,end=208.80.153.190 cloud-instances-transport1-b-codfw` (T242594)

curprev 13:2713:27, 10 January 2020‎ imported>Stashbot‎ 25,993 bytes +167‎ arturo: cloudvirt1009: virsh undefine i-000069b6. This is tools-elastic-01 which is running on cloudvirt1008 (so, leaked on cloudvirt1009)

curprev 11:1211:12, 9 January 2020‎ imported>Stashbot‎ 25,826 bytes +397‎ arturo: running `MariaDB [nova_eqiad1]> update quota_usages set in_use='0' where project_id='etytree';` (T242332)

curprev 10:5310:53, 8 January 2020‎ imported>Stashbot‎ 25,429 bytes +111‎ arturo: icinga downtime all cloudvirts for 30 minutes to re-create all canary VMs"

curprev 11:1211:12, 7 January 2020‎ imported>Stashbot‎ 25,318 bytes +228‎ arturo: icinga-downtime everything cloud* for 30 minutes to merge nova scheduler changes

curprev 13:4513:45, 6 January 2020‎ imported>Stashbot‎ 25,090 bytes +110‎ andrewbogott: restarting nova-api and nova-conductor on cloudcontrol1003 and 1004

curprev 16:3416:34, 4 January 2020‎ imported>Stashbot‎ 24,980 bytes +130‎ arturo: icinga downtime cloudvirt1024 for 2 months because hardware errors (T241884)

curprev 11:4611:46, 31 December 2019‎ imported>Stashbot‎ 24,850 bytes +158‎ andrewbogott: I couldn't!

curprev 10:1310:13, 25 December 2019‎ imported>Stashbot‎ 24,692 bytes +205‎ arturo: icinga downtime for 30 minutes the whole cloud* lab* fleet to merge https://gerrit.wikimedia.org/r/c/operations/puppet/+/560575 (will restart some openstack components)

curprev 15:1315:13, 24 December 2019‎ imported>Stashbot‎ 24,487 bytes +188‎ arturo: icinga downtime all the lab* fleet for nova password change for 1h

curprev 11:1311:13, 23 December 2019‎ imported>Stashbot‎ 24,299 bytes +174‎ arturo: enable puppet in cloudcontrol1003/1004

curprev 23:4823:48, 22 December 2019‎ imported>Stashbot‎ 24,125 bytes +290‎ andrewbogott: restarting nova-conductor and nova-api on cloudcontrol1003 and 1004

curprev 12:4312:43, 20 December 2019‎ imported>Stashbot‎ 23,835 bytes +83‎ arturo: icinga downtime cloudmetrics1001 for 128 hours

curprev 12:5512:55, 18 December 2019‎ imported>Stashbot‎ 23,752 bytes +191‎ arturo: [codfw1dev] created a new subnet neutron object to hold the new CIDR for floating IPs (cloud-codfw1dev-floating - 185.15.57.0/29) T239347

curprev 07:2107:21, 17 December 2019‎ imported>Stashbot‎ 23,561 bytes +85‎ andrewbogott: deploying horizon/train to labweb1001/1002

curprev 06:1106:11, 12 December 2019‎ imported>Stashbot‎ 23,476 bytes +173‎ arturo: schedule 4h downtime for labstores

curprev 06:2806:28, 2 December 2019‎ imported>Stashbot‎ 23,303 bytes +611‎ andrewbogott: running nova-manage db sync on eqiad1

curprev 19:2719:27, 18 November 2019‎ imported>Stashbot‎ 22,692 bytes +897‎ andrewbogott: repooling labsdb1011

curprev 20:0420:04, 15 November 2019‎ imported>Stashbot‎ 21,795 bytes +681‎ andrewbogott: repool labdb1011 (T237509)

curprev 13:1013:10, 11 November 2019‎ imported>Stashbot‎ 21,114 bytes +217‎ arturo: cloudweb2001-dev: disable puppet and redirect stderr in the loadExitNodes.php cron script to prevent cronspam while we investigate the cause of the issue (T237971)

curprev 11:5911:59, 5 November 2019‎ imported>Stashbot‎ 20,897 bytes +171‎ arturo: icinga downtime for 1h cloudcontrol1004, cloudnet1003, cloudvirt1017/1020/1022 for PDU operations in the rack T227542

curprev 21:5521:55, 4 November 2019‎ imported>Stashbot‎ 20,726 bytes +145‎ andrewbogott: deleting a ton of wikitech hiera pages that were either no-ops or refer to nonexistent VMs or prefixes

curprev 11:0111:01, 31 October 2019‎ imported>Stashbot‎ 20,581 bytes +151‎ arturo: icinga-downtimed cloudvirt1030 and cloudservices1003 for 1h due to PDU upgrade operations T227543

curprev 22:4322:43, 30 October 2019‎ imported>Stashbot‎ 20,430 bytes +232‎ jeh: reboot cloud-bootstrapvz-stretch to resolve bad bootstrapvz build

curprev 10:4510:45, 25 October 2019‎ imported>Stashbot‎ 20,198 bytes +176‎ arturo: icinga downtime toolschecker for 1 to upgrade clouddb1002 mariadb (toolsdb secondary) (T236384 , T236420)

curprev 12:3012:30, 24 October 2019‎ imported>Stashbot‎ 20,022 bytes +517‎ arturo: starting cloudvirt1019, PDU operations ended (T227540)

curprev 09:2309:23, 23 October 2019‎ imported>Stashbot‎ 19,505 bytes +293‎ arturo: cloudvirt1026 reboot ended OK

curprev 16:0116:01, 18 October 2019‎ imported>Stashbot‎ 19,212 bytes +420‎ arturo: created the `eqiad1.wikimedia.cloud` DNS zone (T235846)

curprev 21:5921:59, 16 October 2019‎ imported>Stashbot‎ 18,792 bytes +512‎ jeh: resync wiki replica tool and user accounts T235697

curprev 13:3013:30, 15 October 2019‎ imported>Stashbot‎ 18,280 bytes +97‎ jeh: creating indexes and views for banwiki T234770

curprev 18:5518:55, 10 October 2019‎ imported>Stashbot‎ 18,183 bytes +250‎ bd808: Created indexes and views for nqowiki (T230543)

curprev 10:4410:44, 9 October 2019‎ imported>Stashbot‎ 17,933 bytes +531‎ arturo: cloudvirt1013 rebooted well

curprev 14:0714:07, 7 October 2019‎ imported>Stashbot‎ 17,402 bytes +196‎ arturo: horizon is disabled for maintenance (T212302)

curprev 15:2315:23, 2 October 2019‎ imported>Stashbot‎ 17,206 bytes +779‎ arturo: codfw1dev renaming net/subnet objects to a more modern naming scheme T233665

curprev 10:2110:21, 30 September 2019‎ imported>Stashbot‎ 16,427 bytes +290‎ arturo: we installed ferm in every VM by mistake. Deleting it and forcing a puppet agent run to try to go back to a clean state.

curprev 10:3910:39, 18 August 2019‎ imported>Stashbot‎ 16,137 bytes +149‎ arturo: rebooting cloudvirt1023 for new interface names configuration

curprev 17:1717:17, 5 August 2019‎ imported>Stashbot‎ 15,988 bytes +136‎ bd808: Set downtime on gridengine and kubernetes webservice checks in icinga until 2019-09-02 (flaky tests)

curprev 20:1420:14, 29 July 2019‎ imported>Stashbot‎ 15,852 bytes +114‎ bd808: Restarted maintain-kubeusers on tools-k8s-master-01 (T194859)

curprev 12:3212:32, 25 July 2019‎ imported>Stashbot‎ 15,738 bytes +688‎ arturo: eqiad1/glance: debian-9.9-stretch image deprecates debian-9.8-stretch (T228983)

curprev 19:4319:43, 23 July 2019‎ imported>Stashbot‎ 15,050 bytes +98‎ andrewbogott: restarting rabbitmq-server on cloudcontrol1003 and 1004

curprev 23:4423:44, 22 July 2019‎ imported>Stashbot‎ 14,952 bytes +114‎ bd808: Restarted maintain-kubeusers on tools-k8s-master-01 (T228529)

curprev 22:0722:07, 11 July 2019‎ imported>Stashbot‎ 14,838 bytes +343‎ bd808: Ran `sudo systemctl stop designate_floating_ip_ptr_records_updater.service` on cloudcontrol1003

curprev 16:0516:05, 25 June 2019‎ imported>Stashbot‎ 14,495 bytes +213‎ bstorm_: updated python3.4 to update4 wherever it was installed on Jessie VMs to prevent issues with broken update3.

curprev 15:5615:56, 3 June 2019‎ imported>Stashbot‎ 14,282 bytes +7,003‎ arturo: T221769 rebooting cloudservices1003 after bootstrapping is apparently completed

curprev 20:0020:00, 13 January 2019‎ imported>Stashbot‎ 7,279 bytes +441‎ andrewbogott: VPS proxies are now running in eqiad1 on proxy-01. Old VMs will wait a bit for deletion. T213540

curprev 22:2122:21, 9 January 2019‎ imported>Stashbot‎ 6,838 bytes +85‎ bd808: neutron quota-update --tenant-id tools --port 256

curprev 18:5918:59, 8 January 2019‎ imported>Stashbot‎ 6,753 bytes +257‎ bd808: Definately did NOT delete uid=novaadmin,ou=people,dc=wikimedia,dc=org

curprev 22:0322:03, 6 January 2019‎ imported>Stashbot‎ 6,496 bytes +126‎ bd808: Set floatingip quota of 60 for tools project in eqiad1-r region (T212360)

curprev 17:1017:10, 20 December 2018‎ imported>Stashbot‎ 6,370 bytes +100‎ arturo: T207663 renumbered transport network in eqiad1

curprev 17:5917:59, 5 December 2018‎ imported>Stashbot‎ 6,270 bytes +130‎ arturo: T207663 changed labtestn transport network addressing from private to public

curprev 13:2513:25, 3 December 2018‎ imported>Stashbot‎ 6,140 bytes +107‎ arturo: T202886 create again PTR records after dnsleak.py fix

curprev 14:0814:08, 30 November 2018‎ imported>Stashbot‎ 6,033 bytes +126‎ arturo: running dns leaks cleanup `root@cloudcontrol1003:~# /root/novastats/dnsleaks.py --delete`

curprev 17:3317:33, 28 November 2018‎ imported>Stashbot‎ 5,907 bytes +94‎ gtirloni: deleted contintcloud project (T209644)

curprev 13:3213:32, 27 November 2018‎ imported>Stashbot‎ 5,813 bytes +113‎ gtirloni: enabled DRBD stats collection on labstore100[4-5] T208446

curprev 07:1207:12, 22 November 2018‎ imported>Stashbot‎ 5,700 bytes +76‎ gtirloni: deployed new debian-9.6-stretch image

curprev 10:4810:48, 21 November 2018‎ imported>Stashbot‎ 5,624 bytes +134‎ arturo: re-created compat-net as not shared in labtestn to test stuff related to T209954

curprev 12:4312:43, 16 November 2018‎ imported>Stashbot‎ 5,490 bytes +244‎ gtirloni: armed keyholder on labpuppetmaster1001/1002 after reboots

curprev 17:1917:19, 14 November 2018‎ imported>Stashbot‎ 5,246 bytes +869‎ gtirloni: added cloudvirt1016 to scheduler pool (T209426)

curprev 18:1718:17, 9 November 2018‎ imported>Stashbot‎ 4,377 bytes +96‎ gtirloni: restarted neutron-linuxbridge-agent on cloudvirt1018/1023

curprev 11:0011:00, 8 November 2018‎ imported>Stashbot‎ 4,281 bytes +123‎ gtirloni: Added novaproxy-02 to $CACHES

curprev 13:4913:49, 7 November 2018‎ imported>Stashbot‎ 4,158 bytes +144‎ arturo: T208733 moving labvirt1017 from main deployment to eqiad1 and renaming it to cloudvirt1017

curprev 16:2416:24, 22 October 2018‎ imported>Stashbot‎ 4,014 bytes +248‎ arturo: T206261 another update to dmz_cidr in eqiad1

curprev 12:0212:02, 19 October 2018‎ imported>Stashbot‎ 3,766 bytes +392‎ arturo: revert change in dmz_cidr in eqiad1 for now (T206261)

curprev 10:4010:40, 26 September 2018‎ imported>Stashbot‎ 3,374 bytes +753‎ arturo: T205524 all sorts of restarts in all neutron daemons

curprev 22:0822:08, 17 September 2018‎ imported>Stashbot‎ 2,621 bytes +2,384‎ bd808: Granted gtirloni project roles of admin, projectadmin, and user

curprev 00:5500:55, 9 February 2018‎ imported>Stashbot‎ 237 bytes +211‎ bd808: Added Arturo Borrero Gonzalez and Bstorm as project members

curprev 21:0221:02, 8 October 2015‎ imported>Andrew Bogott‎ 26 bytes +26‎ No edit summary

Retrieved from "https://wikitech-static.wikimedia.org/wiki/Nova_Resource:Admin/SAL"