You are browsing a read-only backup copy of Wikitech. The live site can be found at wikitech.wikimedia.org

Nova Resource:Toolsbeta/SAL: Revision history

Jump to navigation Jump to search

Diff selection: Mark the radio buttons of the revisions to compare and hit enter or the button at the bottom.
Legend: (cur) = difference with latest revision, (prev) = difference with preceding revision, m = minor edit.

(newest | oldest) View (newer 250 | ) (20 | 50 | 100 | 250 | 500)

26 May 2023

  • curprev 12:4412:44, 26 May 2023imported>Stashbot 104,628 bytes +440 wm-bot2: deployed kubernetes component https://gitlab.wikimedia.org/repos/cloud/toolforge/buildpack-admission-controller (ef7f103) (T337218) - cookbook ran by dcaro@vulcanus

25 May 2023

  • curprev 08:4008:40, 25 May 2023imported>Stashbot 104,188 bytes +93 dcaro: releasing toolforge-weld 1.0.0 (T337218)

24 May 2023

23 May 2023

  • curprev 14:4014:40, 23 May 2023imported>Stashbot 103,937 bytes +179 wm-bot2: deployed kubernetes component https://github.com/toolforge/buildpack-admission-controller (0c7b25b) - cookbook ran by fran@wmf3169

16 May 2023

15 May 2023

  • curprev 13:3113:31, 15 May 2023imported>Stashbot 103,431 bytes +369 wm-bot2: deployed kubernetes component https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-builds-api (0277378) - cookbook ran by dcaro@vulcanus

9 May 2023

  • curprev 17:0517:05, 9 May 2023imported>Stashbot 103,062 bytes +438 wm-bot2: deployed kubernetes component https://gerrit.wikimedia.org/r/cloud/toolforge/ingress-admission-controller (e89c581) - cookbook ran by taavi@runko

5 May 2023

  • curprev 11:3311:33, 5 May 2023imported>Stashbot 102,624 bytes +184 wm-bot2: deployed kubernetes component https://gerrit.wikimedia.org/r/cloud/toolforge/jobs-framework-api (87937cd) - cookbook ran by taavi@runko

1 May 2023

  • curprev 23:2423:24, 1 May 2023imported>Stashbot 102,440 bytes +181 wm-bot2: deployed kubernetes component https://github.com/toolforge/buildpack-admission-controller (7199a9e) - cookbook ran by raymond@ubuntu

30 April 2023

  • curprev 14:5214:52, 30 April 2023imported>Stashbot 102,259 bytes +293 wm-bot2: removed instance toolsbeta-test-k8s-etcd-19 - cookbook ran by taavi@runko

19 April 2023

  • curprev 16:1716:17, 19 April 2023imported>Stashbot 101,966 bytes +839 wm-bot2: removed instance toolsbeta-test-k8s-etcd-21 - cookbook ran by taavi@runko

11 April 2023

  • curprev 14:1314:13, 11 April 2023imported>Stashbot 101,127 bytes +909 wm-bot2: deployed kubernetes component https://gerrit.wikimedia.org/r/cloud/toolforge/volume-admission-controller.git (d878e49) - cookbook ran by dcaro@vulcanus

5 April 2023

  • curprev 15:5315:53, 5 April 2023imported>Stashbot 100,218 bytes +445 wm-bot2: rebooted k8s node toolsbeta-test-k8s-worker-7 - cookbook ran by arturo@nostromo

3 April 2023

  • curprev 11:1411:14, 3 April 2023imported>Stashbot 99,773 bytes +1,490 wm-bot2: rebooted k8s node toolsbeta-test-k8s-control-4 - cookbook ran by arturo@nostromo

19 March 2023

  • curprev 09:3209:32, 19 March 2023imported>Stashbot 98,283 bytes +124 wm-bot2: cleaned up grid queue errors on toolsbeta-sgegrid-master - cookbook ran by taavi@runko

14 March 2023

  • curprev 10:3910:39, 14 March 2023imported>Stashbot 98,159 bytes +376 wm-bot2: deployed kubernetes component https://github.com/toolforge/buildpack-admission-controller (b70adc1) - cookbook ran by sstefanova@Slavinas-MBP-W.local

13 March 2023

  • curprev 09:2709:27, 13 March 2023imported>Stashbot 97,783 bytes +181 wm-bot2: deployed kubernetes component https://github.com/toolforge/buildpack-admission-controller (f90bd8f) - cookbook ran by dcaro@vulcanus

10 March 2023

  • curprev 16:3616:36, 10 March 2023imported>Stashbot 97,602 bytes +179 wm-bot2: deployed kubernetes component https://gerrit.wikimedia.org/r/labs/tools/maintain-kubeusers (8b42b15) - cookbook ran by taavi@runko

9 March 2023

  • curprev 10:0810:08, 9 March 2023imported>Stashbot 97,423 bytes +179 wm-bot2: deployed kubernetes component https://gerrit.wikimedia.org/r/labs/tools/maintain-kubeusers (53e7f81) - cookbook ran by taavi@runko

7 March 2023

6 March 2023

  • curprev 12:4812:48, 6 March 2023imported>Stashbot 97,155 bytes +669 wm-bot2: deployed kubernetes component https://gerrit.wikimedia.org/r/labs/tools/registry-admission-webhook (6688477) - cookbook ran by taavi@runko

5 March 2023

  • curprev 15:4115:41, 5 March 2023imported>Stashbot 96,486 bytes +179 wm-bot2: deployed kubernetes component https://gerrit.wikimedia.org/r/labs/tools/maintain-kubeusers (3e04025) - cookbook ran by taavi@runko

2 March 2023

  • curprev 11:3111:31, 2 March 2023imported>Stashbot 96,307 bytes +206 arturo: aborrero@toolsbeta-test-k8s-control-4:~$ sudo -i kubectl apply -f /etc/kubernetes/toolforge-tool-roles.yaml (https://gerrit.wikimedia.org/r/c/operations/puppet/+/889836)

1 March 2023

  • curprev 13:1513:15, 1 March 2023imported>Stashbot 96,101 bytes +184 wm-bot2: deployed kubernetes component https://gerrit.wikimedia.org/r/cloud/toolforge/jobs-framework-api (13eda9d) - cookbook ran by taavi@runko

28 February 2023

  • curprev 17:1817:18, 28 February 2023imported>Stashbot 95,917 bytes +506 wm-bot2: deployed kubernetes component https://gitlab.wikimedia.org/repos/cloud/toolforge/api-gateway (9252af7) - cookbook ran by taavi@runko

23 February 2023

  • curprev 16:3716:37, 23 February 2023imported>Stashbot 95,411 bytes +342 wm-bot2: deployed kubernetes component https://gitlab.wikimedia.org/repos/cloud/toolforge/api-gateway (efb60b3) - cookbook ran by taavi@runko

17 February 2023

  • curprev 11:2711:27, 17 February 2023imported>Stashbot 95,069 bytes +383 wm-bot2: deployed kubernetes component https://gerrit.wikimedia.org/r/cloud/toolforge/jobs-framework-api (eeeea4c) - cookbook ran by arturo@endurance

16 February 2023

  • curprev 16:0116:01, 16 February 2023imported>Stashbot 94,686 bytes +809 wm-bot2: renewed kubeadm certs on toolsbeta-test-k8s-control-6 - cookbook ran by arturo@nostromo

15 February 2023

  • curprev 09:3009:30, 15 February 2023imported>Stashbot 93,877 bytes +128 wm-bot2: cleaned up grid queue errors on toolsbeta-sgegrid-master - cookbook ran by arturo@nostromo

14 February 2023

13 February 2023

  • curprev 15:0315:03, 13 February 2023imported>Stashbot 93,500 bytes +1,290 wm-bot2: deployed kubernetes component https://gerrit.wikimedia.org/r/cloud/toolforge/jobs-framework-api (13d87c4) - cookbook ran by taavi@runko

10 February 2023

  • curprev 16:1416:14, 10 February 2023imported>Stashbot 92,210 bytes +100 wm-bot2: Adding a new k8s worker node - cookbook ran by arturo@nostromo

1 February 2023

  • curprev 15:4115:41, 1 February 2023imported>Stashbot 92,110 bytes +182 wm-bot2: deployed kubernetes component https://gitlab.wikimedia.org/repos/cloud/toolforge/image-config (372037f) - cookbook ran by taavi@runko

26 January 2023

  • curprev 14:3314:33, 26 January 2023imported>Stashbot 91,928 bytes +184 wm-bot2: deployed kubernetes component https://gerrit.wikimedia.org/r/cloud/toolforge/jobs-framework-api (307f302) - cookbook ran by taavi@runko

23 January 2023

  • curprev 11:2611:26, 23 January 2023imported>Stashbot 91,744 bytes +211 wm-bot2: deployed kubernetes component https://gerrit.wikimedia.org/r/cloud/toolforge/jobs-framework-api (d5ae229) (T311918) - cookbook ran by taavi@runko

20 January 2023

  • curprev 15:5815:58, 20 January 2023imported>Stashbot 91,533 bytes +335 wm-bot2: renewed kubeadm certs on toolsbeta-test-k8s-control-6 - cookbook ran by arturo@nostromo

19 January 2023

  • curprev 11:4611:46, 19 January 2023imported>Stashbot 91,198 bytes +157 arturo: `aborrero@toolsbeta-test-k8s-control-4:~$ sudo -i kubectl delete clusterrolebinding jobs-api-psp` (cleanup unused stuff)

18 January 2023

  • curprev 15:3615:36, 18 January 2023imported>Stashbot 91,041 bytes +188 wm-bot2: deployed kubernetes component https://gerrit.wikimedia.org/r/cloud/toolforge/jobs-framework-api (0ad4c66) - cookbook ran by arturo@nostromo

17 January 2023

  • curprev 13:5613:56, 17 January 2023imported>Stashbot 90,853 bytes +486 wm-bot2: deployed kubernetes component https://gerrit.wikimedia.org/r/cloud/toolforge/jobs-framework-api (8cf38a1) - cookbook ran by arturo@endurance

10 January 2023

  • curprev 11:5311:53, 10 January 2023imported>Stashbot 90,367 bytes +358 wm-bot2: deployed kubernetes component https://gerrit.wikimedia.org/r/cloud/toolforge/jobs-framework-api (8e0a2f9) - cookbook ran by arturo@endurance

9 December 2022

  • curprev 08:4508:45, 9 December 2022imported>Stashbot 90,009 bytes +108 dcaro: manually started puppetdb after killed by oom (T324812)

30 November 2022

  • curprev 10:3710:37, 30 November 2022imported>Stashbot 89,901 bytes +188 wm-bot2: deployed kubernetes component https://gerrit.wikimedia.org/r/cloud/toolforge/jobs-framework-api (bc3529d) - cookbook ran by arturo@nostromo

29 November 2022

  • curprev 12:3912:39, 29 November 2022imported>Stashbot 89,713 bytes +506 wm-bot2: deployed kubernetes component https://gitlab.wikimedia.org/repos/cloud/toolforge/image-config (864171a) - cookbook ran by taavi@runko

28 November 2022

  • curprev 18:3918:39, 28 November 2022imported>Stashbot 89,207 bytes +344 wm-bot2: deployed kubernetes component https://gitlab.wikimedia.org/repos/cloud/toolforge/image-config (ec5c82b) - cookbook ran by taavi@runko

15 November 2022

  • curprev 12:4012:40, 15 November 2022imported>Stashbot 88,863 bytes +290 wm-bot2: Updating the distroless/base image on docker-registry.tools.wmflabs.org/test-raymond - cookbook ran by raymond@ubuntu

14 November 2022

  • curprev 20:0520:05, 14 November 2022imported>Stashbot 88,573 bytes +753 wm-bot2: Updating the distroless/base image on docker-registry.tools.wmflabs.org/test-raymond - cookbook ran by raymond@ubuntu

7 November 2022

  • curprev 13:3213:32, 7 November 2022imported>Stashbot 87,820 bytes +179 wm-bot2: deployed kubernetes component https://github.com/toolforge/buildpack-admission-controller (b4e912e) - cookbook ran by fran@wmf3169

4 November 2022

  • curprev 12:2412:24, 4 November 2022imported>Stashbot 87,641 bytes +215 wm-bot2: deployed kubernetes component https://gerrit.wikimedia.org/r/cloud/toolforge/jobs-framework-api (d464be4) (T304900) - cookbook ran by arturo@nostromo

1 November 2022

  • curprev 12:4212:42, 1 November 2022imported>Stashbot 87,426 bytes +92 taavi: remove labstore1006/7 from acme-chief-1 fstab and reboot

24 October 2022

  • curprev 16:4216:42, 24 October 2022imported>Stashbot 87,334 bytes +278 wm-bot2: rebooted buster webgen grid workers - cookbook ran by andrew@bullseye

18 October 2022

  • curprev 10:2410:24, 18 October 2022imported>Stashbot 87,056 bytes +219 wm-bot2: deployed kubernetes component https://gerrit.wikimedia.org/r/cloud/toolforge/jobs-framework-emailer (64385e9) (T320405) - cookbook ran by arturo@nostromo

17 October 2022

  • curprev 14:3714:37, 17 October 2022imported>Stashbot 86,837 bytes +1,328 wm-bot2: Updating the distroless/base image on docker-registry.tools.wmflabs.org - cookbook ran by dcaro@vulcanus

14 October 2022

  • curprev 07:5307:53, 14 October 2022imported>Stashbot 85,509 bytes +184 wm-bot2: deployed kubernetes component https://gerrit.wikimedia.org/r/cloud/toolforge/jobs-framework-api (0cc020e) - cookbook ran by taavi@runko

12 October 2022

10 October 2022

  • curprev 08:4108:41, 10 October 2022imported>Stashbot 85,246 bytes +211 wm-bot2: deployed kubernetes component https://gerrit.wikimedia.org/r/cloud/toolforge/jobs-framework-api (afa90ed) (T320284) - cookbook ran by taavi@runko

28 September 2022

  • curprev 09:4809:48, 28 September 2022imported>Stashbot 85,035 bytes +135 arturo: manually starting gridengine-master.service on toolsbeta-sgegrid-master (T318788)

27 September 2022

24 August 2022

  • curprev 11:5511:55, 24 August 2022imported>Stashbot 84,831 bytes +183 wm-bot2: deployed kubernetes component https://gitlab.wikimedia.org/repos/cloud/toolforge/ingress-nginx (7d0e951) - cookbook ran by taavi@runko

12 August 2022

  • curprev 07:2407:24, 12 August 2022imported>Stashbot 84,648 bytes +158 dcaro_away: started postgresql on puppetdb-02, might have crashed during the ceph issues, now puppet runs on toolsbeta work again

3 August 2022

  • curprev 15:4615:46, 3 August 2022imported>Stashbot 84,490 bytes +262 dhinus: recreated jobs-api pods to pick up new ConfigMap

1 August 2022

  • curprev 14:0114:01, 1 August 2022imported>Stashbot 84,228 bytes +90 taavi: unbreak acme-chief after keystone communication issues

19 July 2022

  • curprev 15:4515:45, 19 July 2022imported>Stashbot 84,138 bytes +84 taavi: deploying and testing maintain-kubeusers updates

28 June 2022

  • curprev 15:2315:23, 28 June 2022imported>Stashbot 84,054 bytes +96 wm-bot2: Adding a new k8s worker node - cookbook ran by taavi@runko

24 June 2022

  • curprev 07:0107:01, 24 June 2022imported>Stashbot 83,958 bytes +522 wm-bot2: removing grid node toolsbeta-sgewebgrid-lighttpd-0901.toolsbeta.eqiad1.wikimedia.cloud - cookbook ran by taavi@runko

19 June 2022

  • curprev 16:2816:28, 19 June 2022imported>Stashbot 83,436 bytes +83 taavi: restart OOM'd puppetdb on toolsbeta-puppetdb-02

3 June 2022

  • curprev 13:1713:17, 3 June 2022imported>Stashbot 83,353 bytes +350 bd808: publish tools-webservice 0.86 (T309821)

30 May 2022

  • curprev 13:4213:42, 30 May 2022imported>Stashbot 83,003 bytes +103 taavi: run grid-configurator to remove stale config for some removed nodes

26 May 2022

  • curprev 15:3815:38, 26 May 2022imported>Stashbot 82,900 bytes +184 wm-bot2: deployed kubernetes component https://gerrit.wikimedia.org/r/cloud/toolforge/jobs-framework-api (e6fa299) - cookbook ran by taavi@runko

20 April 2022

  • curprev 07:5307:53, 20 April 2022imported>Stashbot 82,716 bytes +210 wm-bot: deployed kubernetes component https://gerrit.wikimedia.org/r/cloud/toolforge/jobs-framework-api (8f37a04) (T305592) - cookbook ran by taavi@runko

15 April 2022

  • curprev 13:2613:26, 15 April 2022imported>Stashbot 82,506 bytes +150 taavi: shutdown toolsbeta-services-01, not exactly sure what it does and it has no roles applied T306100

11 April 2022

  • curprev 14:4714:47, 11 April 2022imported>Stashbot 82,356 bytes +91 dcaro: deploying custom version of the regitsry admission hook

8 April 2022

  • curprev 10:4510:45, 8 April 2022imported>Stashbot 82,265 bytes +90 arturo: disabled debug mode on the k8s jobs-emailer component

5 April 2022

  • curprev 07:4307:43, 5 April 2022imported>Stashbot 82,175 bytes +245 wm-bot: deployed kubernetes component https://gerrit.wikimedia.org/r/cloud/toolforge/jobs-framework-api (d7d3463) - cookbook ran by arturo@nostromo

4 April 2022

  • curprev 16:5816:58, 4 April 2022imported>Stashbot 81,930 bytes +291 wm-bot: deployed kubernetes component https://gerrit.wikimedia.org/r/cloud/toolforge/jobs-framework-api (cbcfc47) - cookbook ran by arturo@nostromo

25 March 2022

  • curprev 11:3111:31, 25 March 2022imported>Stashbot 81,639 bytes +361 dcaro: All alerting VMs rebooted, checking that everything is "working" (T304672)

16 March 2022

  • curprev 15:2315:23, 16 March 2022imported>Stashbot 81,278 bytes +180 taavi: deploying https://gerrit.wikimedia.org/r/c/cloud/toolforge/volume-admission-controller/+/737171/ as a T292238 test to toolsbeta

15 March 2022

  • curprev 17:5517:55, 15 March 2022imported>Stashbot 81,098 bytes +191 wm-bot: deployed kubernetes component https://gerrit.wikimedia.org/r/cloud/toolforge/jobs-framework-emailer (084ee51) - cookbook ran by arturo@nostromo

14 March 2022

  • curprev 16:1416:14, 14 March 2022imported>Stashbot 80,907 bytes +141 wm-bot: Updating the distroless/base image on docker-registry.tools.wmflabs.org - cookbook ran by dcaro@vulcanus

11 March 2022

  • curprev 15:5515:55, 11 March 2022imported>Stashbot 80,766 bytes +396 dcaro: added provisional toolforg cli package to toolsbeta buster repo (T299026)

8 March 2022

7 March 2022

  • curprev 15:4415:44, 7 March 2022imported>Stashbot 80,291 bytes +123 dcaro: Deployed buildpack-admission-controller with the latest code (T297090)

17 February 2022

  • curprev 08:1608:16, 17 February 2022imported>Stashbot 80,168 bytes +129 taavi: made toolsbeta-puppetmaster-04 its own client to fix `puppet node deactivate` puppetdb access

8 February 2022

  • curprev 13:0413:04, 8 February 2022imported>Stashbot 80,039 bytes +310 arturo: livehacking puppetmaster with https://gerrit.wikimedia.org/r/c/operations/puppet/+/760933 (T284767)

4 February 2022

28 January 2022

  • curprev 16:2816:28, 28 January 2022imported>Stashbot 79,640 bytes +182 wm-bot: trying to join node toolsbeta-sgewebgen-09-1.toolsbeta.eqiad1.wikimedia.cloud to the grid cluster in toolsbeta. - cookbook ran by arturo@nostromo

25 January 2022

  • curprev 11:4511:45, 25 January 2022imported>Stashbot 79,458 bytes +120 wm-bot: reconfiguring the grid by using grid-configurator - cookbook ran by arturo@nostromo

20 January 2022

  • curprev 12:3512:35, 20 January 2022imported>Stashbot 79,338 bytes +298 wm-bot: removing grid node toolsbeta-sgeexec-1003 (depool/drain, remove VM and reconfigure grid) - cookbook ran by arturo@nostromo

19 January 2022

  • curprev 14:1114:11, 19 January 2022imported>Stashbot 79,040 bytes +199 arturo: craeted 'automated-toolforge-tests' tool account following https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Toolsbeta#create_a_tool_account_in_toolsbeta

18 January 2022

  • curprev 15:5615:56, 18 January 2022imported>Stashbot 78,841 bytes +464 wm-bot: removing grid node toolsbeta-sgewebgrid-generic-0901 (depool/drain, remove VM and reconfigure grid) - cookbook ran by andrew@buster

17 January 2022

  • curprev 18:0918:09, 17 January 2022imported>Stashbot 78,377 bytes +433 wm-bot: pooled grid node toolsbeta-sgewebgen-10-1 - cookbook ran by arturo@nostromo

14 January 2022

  • curprev 11:5611:56, 14 January 2022imported>Stashbot 77,944 bytes +785 wm-bot: removing grid node toolsbeta-sgewebgen-10-5 (depool/drain, remove VM and reconfigure grid) - cookbook ran by arturo@nostromo

12 January 2022

  • curprev 12:2812:28, 12 January 2022imported>Stashbot 77,159 bytes +462 wm-bot: created node toolsbeta-sgeweblight-10-1.toolsbeta.eqiad1.wikimedia.cloud and added it to the grid - cookbook ran by arturo@nostromo

11 January 2022

  • curprev 11:1111:11, 11 January 2022imported>Stashbot 76,697 bytes +251 wm-bot: created a grid exec node toolsbeta-sgeexec-10-5.toolsbeta.eqiad1.wikimedia.cloud - cookbook ran by arturo@nostromo

23 December 2021

  • curprev 13:3213:32, 23 December 2021imported>Stashbot 76,446 bytes +1,226 wm-bot: trying to join node toolsbeta-sgewebgen-10-3.toolsbeta.eqiad1.wikimedia.cloud to the grid cluster in toolsbeta. - cookbook ran by arturo@endurance

22 December 2021

  • curprev 12:0212:02, 22 December 2021imported>Stashbot 75,220 bytes +749 wm-bot: reconfiguring the grid by using grid-configurator - cookbook ran by arturo@endurance

21 December 2021

  • curprev 16:3216:32, 21 December 2021imported>Stashbot 74,471 bytes +1,599 wm-bot: removing instance toolsbeta-sgewebgen-10-2 - cookbook ran by arturo@endurance

16 December 2021

  • curprev 12:4612:46, 16 December 2021imported>Stashbot 72,872 bytes +172 wm-bot: Joining grid node toolsbeta-sgewebgen-10-1.toolsbeta.eqiad1.wikimedia.cloud to the toolsbeta cluster - cookbook ran by arturo@endurance

15 December 2021

  • curprev 14:0314:03, 15 December 2021imported>Stashbot 72,700 bytes +290 wm-bot: Adding a new grid webgrid generic node - cookbook ran by arturo@endurance

8 December 2021

  • curprev 05:1505:15, 8 December 2021imported>Stashbot 72,410 bytes +93 andrewbogott: moving toolsbeta-test-k8s-etcd-17 to cloudvirt1028

28 November 2021

  • curprev 17:4517:45, 28 November 2021imported>Stashbot 72,317 bytes +174 andrewbogott: moving toolsbeta-test-k8s-etcd-17 to cloudvirt1019; cloudvirt1018 (its old host) has a degraded raid which is affecting performance

16 November 2021

5 November 2021

28 October 2021

  • curprev 12:4812:48, 28 October 2021imported>Stashbot 71,981 bytes +107 arturo: update ingress-nginx via helm for `--watch-ingress-without-class=true`

25 October 2021

  • curprev 14:4114:41, 25 October 2021imported>Stashbot 71,874 bytes +141 majavah: deploy ingress-nginx v1.0.4 to toolsbeta via helm, diff only changes the image T292771

20 October 2021

  • curprev 12:1512:15, 20 October 2021imported>Stashbot 71,733 bytes +119 majavah: upload toolforge-webservice 0.78 to stretch,buster,bullsye-toolsbeta repositories

16 October 2021

  • curprev 07:4707:47, 16 October 2021imported>Stashbot 71,614 bytes +118 majavah: deployed cert-manager and wave as a test for automating T292238

14 October 2021

  • curprev 15:0215:02, 14 October 2021imported>Stashbot 71,496 bytes +470 wm-bot: Joining grid node toolsbeta-sgewebgen-09-1.toolsbeta.eqiad1.wikimedia.cloud to the toolsbeta cluster - cookbook ran by dcaro@vulcanus

13 October 2021

  • curprev 11:1811:18, 13 October 2021imported>Stashbot 71,026 bytes +434 wm-bot: Added a new grid webgrid generic node toolsbeta-sgewebgen-09-1.toolsbeta.eqiad1.wikimedia.cloud to the pool (T292465) - cookbook ran by dcaro@vulcanus

12 October 2021

  • curprev 16:1016:10, 12 October 2021imported>Stashbot 70,592 bytes +442 wm-bot: Adding a new grid webgrid generic node (T292465) - cookbook ran by dcaro@vulcanus

11 October 2021

  • curprev 15:2415:24, 11 October 2021imported>Stashbot 70,150 bytes +365 wm-bot: Adding a new grid webgrid generic node (T292465) - cookbook ran by dcaro@vulcanus

7 October 2021

  • curprev 14:2114:21, 7 October 2021imported>Stashbot 69,785 bytes +940 wm-bot: Adding a new grid webgrid generic node (T292465) - cookbook ran by dcaro@vulcanus

6 October 2021

  • curprev 10:3610:36, 6 October 2021imported>Stashbot 68,845 bytes +595 wm-bot: Adding a new grid webgrid generic node (T292465) - cookbook ran by dcaro@vulcanus

4 October 2021

1 October 2021

29 September 2021

28 September 2021

  • curprev 10:3210:32, 28 September 2021imported>Stashbot 67,487 bytes +111 majavah: removing all podpreset objects and disabling settings.k8s.io/v1alpha1 api

27 September 2021

  • curprev 16:1316:13, 27 September 2021imported>Stashbot 67,376 bytes +107 majavah: testing volume-admission fix for containers with some volumes mounted

23 September 2021

22 September 2021

  • curprev 18:0718:07, 22 September 2021imported>Stashbot 67,168 bytes +137 bstorm: launching toolsbeta-nfs-test-client-01 to run a "fair" test battery against T291406

15 September 2021

14 September 2021

13 September 2021

9 September 2021

3 September 2021

30 August 2021

21 August 2021

  • curprev 00:1800:18, 21 August 2021imported>Stashbot 65,859 bytes +251 bstorm: rebooting the control plane nodes for kubernetes because it can't make things worse T289390

12 August 2021

30 July 2021

  • curprev 08:0108:01, 30 July 2021imported>Stashbot 65,430 bytes +108 majavah: replace toolsbeta-sgeexec-1002 with -1004 for T287666

29 July 2021

23 July 2021

  • curprev 13:3113:31, 23 July 2021imported>Stashbot 65,148 bytes +102 majavah: upgrading toolsbeta to kubernetes 1.19, T280340

22 July 2021

21 July 2021

  • curprev 11:5811:58, 21 July 2021imported>Stashbot 64,968 bytes +591 arturo: deploying jobs-framework-api 07346d715d17585db9c16dd152cc91ef0bea33c3 (T286108)

20 July 2021

  • curprev 21:1821:18, 20 July 2021imported>Stashbot 64,377 bytes +282 bstorm: applied `login_server: true` to toolsbeta-sgecron-01 T287037

16 July 2021

  • curprev 19:5319:53, 16 July 2021imported>Stashbot 64,095 bytes +227 bstorm: set matchPolicy to equivalent on ingress admission controller for toolsbeta T280360

15 July 2021

  • curprev 15:3915:39, 15 July 2021imported>Stashbot 63,868 bytes +136 arturo: deploy toolforge-jobs-framework-api git version d85d93ee1c5d4be6a526cf83e806b2679dde3875

14 July 2021

12 July 2021

  • curprev 11:4211:42, 12 July 2021imported>Stashbot 63,640 bytes +82 majavah: rebooting toolsbeta-sgeexec-1002, nfs issues

7 July 2021

  • curprev 09:4809:48, 7 July 2021imported>Stashbot 63,558 bytes +131 majavah: set dummy values for openstack ldap user/pass hiera values for disable_tool manifests to work

1 July 2021

29 June 2021

  • curprev 09:2809:28, 29 June 2021imported>Stashbot 63,316 bytes +2,414 wm-bot: Depooled and removed worker toolsbeta-test-k8s-worker-3.toolsbeta.eqiad1.wikimedia.cloud. (T267140) - cookbook ran by dcaro@vulcanus

28 June 2021

  • curprev 14:4614:46, 28 June 2021imported>Stashbot 60,902 bytes +2,516 wm-bot: Adding a new k8s worker node - cookbook ran by dcaro@vulcanus

25 June 2021

  • curprev 15:2715:27, 25 June 2021imported>Stashbot 58,386 bytes +1,970 wm-bot: Adding a new k8s worker node - cookbook ran by dcaro@vulcanus

24 June 2021

  • curprev 15:5215:52, 24 June 2021imported>Stashbot 56,416 bytes +958 wm-bot: Adding a new k8s worker node - cookbook ran by dcaro@vulcanus

22 June 2021

  • curprev 18:2418:24, 22 June 2021imported>Stashbot 55,458 bytes +115 majavah: rolling out kubernetes patch release 1.18.20, cluster is currently at 1.18.18

17 June 2021

  • curprev 11:4411:44, 17 June 2021imported>Stashbot 55,343 bytes +148 majavah: toolsbeta-puppetdb-02: stop puppetdb to free up its ram usage, start postgres process, start puppetdb up again

16 June 2021

  • curprev 15:5315:53, 16 June 2021imported>Stashbot 55,195 bytes +142 majavah: add default security group rule allowing prometheus01.metricsinfra to connect to node-exporter port 9100

15 June 2021

  • curprev 16:1016:10, 15 June 2021imported>Stashbot 55,053 bytes +82 majavah: set toolsbeta-bastion-05 as grid submit host

14 June 2021

  • curprev 21:2921:29, 14 June 2021imported>Stashbot 54,971 bytes +292 bstorm: deploy package with the staged patch to switch away from os.execv to QA in toolsbeta as toollabs-webservice version 0.75 T282975

12 June 2021

  • curprev 14:4214:42, 12 June 2021imported>Stashbot 54,679 bytes +84 majavah: sync hiera key prometheus_nodes to match tools

11 June 2021

  • curprev 15:2515:25, 11 June 2021imported>Stashbot 54,595 bytes +159 majavah: undeploy nginx-ingress-jobs from kubernetes

8 June 2021

  • curprev 15:1115:11, 8 June 2021imported>Stashbot 54,436 bytes +501 majavah: updating k8s worker nodes to 1.18 T280299

3 June 2021

  • curprev 16:5516:55, 3 June 2021imported>Stashbot 53,935 bytes +198 majavah: renew ingress-admission-controller certificates T280301

25 May 2021

  • curprev 17:1417:14, 25 May 2021imported>Stashbot 53,737 bytes +344 andrewbogott: deleting old ingress controllers toolsbeta-test-k8s-ingress-1 and toolsbeta-test-k8s-ingress-2

24 May 2021

  • curprev 19:4019:40, 24 May 2021imported>Stashbot 53,393 bytes +93 andrewbogott: replacing existing etcd nodes with localdisk nodes

19 May 2021

  • curprev 11:3511:35, 19 May 2021imported>Stashbot 53,300 bytes +159 Majavah: testing https://gerrit.wikimedia.org/r/c/operations/puppet/+/692875/

15 May 2021

  • curprev 07:5207:52, 15 May 2021imported>Stashbot 53,141 bytes +164 Majavah: set profile::wmcs::kubeadm::control::apiserver_cert_alternative_names hiera key and adjust config map T262562

14 May 2021

  • curprev 11:2211:22, 14 May 2021imported>Stashbot 52,977 bytes +340 arturo: allowed VIP address from the new port 172.16.3.26 into the ports of toolsbeta-redis-[1-3] (T153810)

13 May 2021

  • curprev 08:0708:07, 13 May 2021imported>Stashbot 52,637 bytes +154 Majavah: creating toolsbeta-redis-[1-3] as g3.cores1.ram2.disk20 to experiment with redis-sentinel / T153810

10 May 2021

  • curprev 19:4219:42, 10 May 2021imported>Stashbot 52,483 bytes +370 bstorm: setting profile::wmcs::kubeadm::docker_vol: false on ingress nodes

8 May 2021

  • curprev 10:4210:42, 8 May 2021imported>Stashbot 52,113 bytes +110 Majavah: create new ingress node toolsbeta-k8s-ingress-3 T264221

7 May 2021

  • curprev 17:0017:00, 7 May 2021imported>Stashbot 52,003 bytes +743 bstorm: deleted "toolsbeta-test-k8s-haproxy-2", "toolsbeta-test-k8s-haproxy-1" when the dns caches finally dropped T282227

5 May 2021

4 May 2021

  • curprev 10:4710:47, 4 May 2021imported>Stashbot 51,138 bytes +89 arturo: rebase & resolve merge conflicts in labs/private.git

3 May 2021

  • curprev 13:2313:23, 3 May 2021imported>Stashbot 51,049 bytes +153 arturo: livehacking puppetmaster with https://gerrit.wikimedia.org/r/c/operations/puppet/+/684032 (T278109)

29 April 2021

23 April 2021

  • curprev 17:2417:24, 23 April 2021imported>Stashbot 50,829 bytes +117 bstorm: rebooting toolsbeta-test-k8s-control-6 because it was "notready" for some reason

20 April 2021

  • curprev 19:0119:01, 20 April 2021imported>Stashbot 50,712 bytes +153 bstorm: updated the maintain-kubeusers:beta image to https://gerrit.wikimedia.org/r/c/labs/tools/maintain-kubeusers/+/680244

13 April 2021

8 April 2021

  • curprev 18:2718:27, 8 April 2021imported>Stashbot 50,141 bytes +229 bstorm: cleaned up the deprecated entries in /data/project/.system_sge/gridengine/etc/submithosts for toolsbeta-sgegrid-master and toolsbeta-sgegrid-shadow using the old fqdns T277653

6 April 2021

  • curprev 13:1113:11, 6 April 2021imported>Stashbot 49,912 bytes +160 dcaro: Removing etcd member toolsbeta-test-k8s-etcd-7.tools.eqiad1.wikimedia.cloud to get an odd number (T267082)

1 April 2021

  • curprev 15:1715:17, 1 April 2021imported>Stashbot 49,752 bytes +194 dcaro: etcd cluster shrunk 3 members (using wmcs.toolforge.remove_etcd_node cookbook)

31 March 2021

  • curprev 18:2218:22, 31 March 2021imported>Stashbot 49,558 bytes +155 bstorm: redeploy ingress-admission controller with `kubectl apply -k deploys/toolsbeta` from the repo T275478

24 March 2021

  • curprev 12:1712:17, 24 March 2021imported>Stashbot 49,403 bytes +445 arturo: attach the `toolsbeta-docker-registry-data` volume to the `toolsbeta-docker-registry-02` VM

23 March 2021

  • curprev 11:2211:22, 23 March 2021imported>Stashbot 48,958 bytes +214 arturo: drop and build again the VM toolsbeta-sgregrid-master (T277653)

18 March 2021

  • curprev 18:5518:55, 18 March 2021imported>Stashbot 48,744 bytes +1,082 bstorm: set profile::toolforge::infrastructure across the entire project with login_server set on the bastion prefix

17 March 2021

  • curprev 12:3912:39, 17 March 2021imported>Stashbot 47,662 bytes +444 arturo: created VM toolsbeta-buster-gridmaster (T277653)

16 March 2021

  • curprev 12:3212:32, 16 March 2021imported>Stashbot 47,218 bytes +184 arturo: added packages jobutils / misctools v1.41 to {stretch,buster}-toolsbeta aptly repository in tools-sge-services-03

11 March 2021

  • curprev 12:3312:33, 11 March 2021imported>Stashbot 47,034 bytes +155 arturo: livehacking puppetmaster with https://gerrit.wikimedia.org/r/c/operations/puppet/+/667144 for T275865

10 March 2021

  • curprev 16:4816:48, 10 March 2021imported>Stashbot 46,879 bytes +104 arturo: briefly stopping VM toolsbeta-test-k8s-etcd-8 to migrate hypervisor

26 February 2021

19 February 2021

10 February 2021

  • curprev 12:3412:34, 10 February 2021imported>Stashbot 45,575 bytes +382 arturo: live-hacking puppetmaster with https://gerrit.wikimedia.org/r/c/operations/puppet/+/662941 (T274139)

8 February 2021

  • curprev 11:4811:48, 8 February 2021imported>Stashbot 45,193 bytes +112 arturo: trying to introduce TLS support in the front proxy T274123

5 February 2021

  • curprev 00:3600:36, 5 February 2021imported>Stashbot 45,081 bytes +106 bstorm: updated jobutils and miscutils to 1.40 in aptly for toolsbeta testing

21 January 2021

  • curprev 15:2915:29, 21 January 2021imported>Stashbot 44,975 bytes +137 bstorm: pushed the maintain-kubeusers:beta tag with the new code to the docker repo T271847

13 January 2021

22 December 2020

  • curprev 10:4810:48, 22 December 2020imported>Stashbot 44,454 bytes +97 arturo: rebase & resolve ugly git merge conflict in labs/private.git

18 December 2020

  • curprev 10:5210:52, 18 December 2020imported>Stashbot 44,357 bytes +160 arturo: live-hacking local puppetmaster with https://gerrit.wikimedia.org/r/c/operations/puppet/+/650470 (T267966)

14 December 2020

  • curprev 19:2719:27, 14 December 2020imported>Stashbot 44,197 bytes +210 bstorm: create temporary instance toolsbeta-test-io-unthrottled T267966

11 December 2020

  • curprev 23:3123:31, 11 December 2020imported>Stashbot 43,987 bytes +157 bstorm: increasing the output throttle for toolsbeta-test-k8s-haproxy-* nodes in order to figure out what's up with the timeouts

10 December 2020

  • curprev 08:5808:58, 10 December 2020imported>Stashbot 43,830 bytes +133 dcaro: starting a new etcd instance completely from ansible playbook (etcd-8) (T267412)

9 December 2020

  • curprev 15:3015:30, 9 December 2020imported>Stashbot 43,697 bytes +113 dcaro: Playing aronud adding a new etcd node (k8s-etcd-7) (T267412)

4 December 2020

  • curprev 11:1711:17, 4 December 2020imported>Stashbot 43,584 bytes +255 dcaro: Created a new 'standardized' security froup for k8s from ansible toolsbeta-k8s-full-connectivity (T267412)

23 November 2020

18 November 2020

17 November 2020

  • curprev 15:3215:32, 17 November 2020imported>Stashbot 42,392 bytes +625 dcaro: Creating new toolsbeta-test-k8s-control-4 node and adding it to the cluster (T267140)

16 November 2020

  • curprev 11:4411:44, 16 November 2020imported>Stashbot 41,767 bytes +272 dcaro: etcd5 member added, creating instance toolsbeta-test-k8s-etcd6 and adding to the etcd cluster (T267140)

10 November 2020

  • curprev 19:4219:42, 10 November 2020imported>Stashbot 41,495 bytes +642 bstorm: safelisted "argocd" namespace with namespaceSelector for registry-admission controller

6 November 2020

  • curprev 23:4423:44, 6 November 2020imported>Stashbot 40,853 bytes +593 bstorm: toolsbeta k8s cluster fully upgraded to 1.17.13 T263284

5 November 2020

4 November 2020

  • curprev 15:4215:42, 4 November 2020imported>Stashbot 40,049 bytes +598 dcaro: re-creating the toolsbeta-proxy-03, used wrong image on the first try (T267140)

3 November 2020

2 November 2020

29 October 2020

  • curprev 22:2022:20, 29 October 2020imported>Stashbot 38,984 bytes +111 legoktm: switched test tool over to use buildpack image (T265681)

28 October 2020

  • curprev 18:5818:58, 28 October 2020imported>Stashbot 38,873 bytes +106 andrewbogott: deleting toolsbeta-puppetmaster-03 — seems broken and unused

22 October 2020

10 September 2020

9 September 2020

  • curprev 11:5011:50, 9 September 2020imported>Stashbot 38,234 bytes +721 arturo: after force-rebooting everything, the k8s cluster seems to have recovered itself. magic.

15 July 2020

  • curprev 21:3521:35, 15 July 2020imported>Stashbot 37,513 bytes +118 bstorm: set all of toolsbeta to mount NFS 4.2 except the bastion T257945

14 July 2020

  • curprev 22:2822:28, 14 July 2020imported>Stashbot 37,395 bytes +95 bstorm: rebooting toolsbeta-sgebastion-04 during NFS testing thing

8 July 2020

  • curprev 11:0811:08, 8 July 2020imported>Stashbot 37,300 bytes +154 arturo: live-hacking puppetmaster with https://gerrit.wikimedia.org/r/c/operations/puppet/+/610029 (T234617)

26 June 2020

  • curprev 12:1212:12, 26 June 2020imported>Stashbot 37,146 bytes +156 arturo: puppetmaster live-hacking with https://gerrit.wikimedia.org/r/#/c/operations/puppet/+/608005 (T120210)

24 June 2020

  • curprev 12:5512:55, 24 June 2020imported>Stashbot 36,990 bytes +564 arturo: live-hacking puppetmaster with https://gerrit.wikimedia.org/r/c/operations/puppet/+/607279 (T120225)

23 June 2020

  • curprev 13:1013:10, 23 June 2020imported>Stashbot 36,426 bytes +668 arturo: added herron to the test tool for email testing

16 June 2020

15 June 2020

  • curprev 21:5421:54, 15 June 2020imported>Stashbot 35,698 bytes +149 bstorm_: removed killgridjobs.sh from toolsbeta bastion T157792

12 June 2020

  • curprev 19:4119:41, 12 June 2020imported>Stashbot 35,549 bytes +132 bstorm_: set `profile::wmcs::nfsclient::mode: soft` on toolsbeta-workflow-test T127559

11 June 2020

  • curprev 12:4212:42, 11 June 2020imported>Stashbot 35,417 bytes +1,241 arturo: introduce puppet profile 'toolsbeta-docker-registry' and relocate some hiera config there

4 June 2020

  • curprev 21:0621:06, 4 June 2020imported>Stashbot 34,176 bytes +89 andrewbogott: added krenair to toolsbeta.admin group in ldap

28 May 2020

27 May 2020

  • curprev 12:0212:02, 27 May 2020imported>Stashbot 33,763 bytes +850 arturo: the k8s cluster is now running v1.16.10 (T246122)

26 May 2020

  • curprev 16:1716:17, 26 May 2020imported>Stashbot 32,913 bytes +909 bstorm_: fix incorrect volume name in kubeadm-config T246122

21 May 2020

  • curprev 22:1422:14, 21 May 2020imported>Stashbot 32,004 bytes +92 bd808: Building tools-webservice 0.70 via wmcs-package-build.py

19 May 2020

  • curprev 12:2012:20, 19 May 2020imported>Stashbot 31,912 bytes +208 arturo: trying to install tesseract 4.1.0 in toolsbeta-sgebastion-04 (T247422)

15 May 2020

  • curprev 20:4820:48, 15 May 2020imported>Stashbot 31,704 bytes +243 bstorm_: found an error in the new version of maintain-kubeusers, removing the deployment for now T246059

14 May 2020

  • curprev 12:0912:09, 14 May 2020imported>Stashbot 31,461 bytes +195 arturo: created puppet prefix toolsbeta-acme-chief in horizon (T252762)

12 May 2020

  • curprev 18:3518:35, 12 May 2020imported>Stashbot 31,266 bytes +418 bstorm_: upgraded to using typha and rolled back to not doing so -- no affect on existing network T250863

8 May 2020

  • curprev 12:4812:48, 8 May 2020imported>Stashbot 30,848 bytes +251 arturo: allocated floating IP `185.15.56.12` for the VM `toolsbeta-email-01` and FQDN `mail.toolsbeta.wmflabs.org` (T120225)

7 May 2020

  • curprev 16:3316:33, 7 May 2020imported>Stashbot 30,597 bytes +495 arturo: livehack toolsbeta-puppetmaster-03 with https://gerrit.wikimedia.org/r/c/operations/puppet/+/594945 (T251297 and T250866)

6 May 2020

  • curprev 19:1119:11, 6 May 2020imported>Stashbot 30,102 bytes +233 bstorm_: updated toollabs-webservice to 0.69 for toolsbeta

5 May 2020

  • curprev 10:0410:04, 5 May 2020imported>Stashbot 29,869 bytes +204 arturo: add herron as user and projectadmin, we will work on the email setup (T120225)

4 May 2020

  • curprev 13:0213:02, 4 May 2020imported>Stashbot 29,665 bytes +203 arturo: `aborrero@toolsbeta-puppetdb-02:~ $ sudo systemctl restart puppetdb.service` trying to bring back puppetdb, which is preventing puppet agent runs in the whole project

29 April 2020

  • curprev 19:4819:48, 29 April 2020imported>Stashbot 29,462 bytes +122 bstorm_: ran the scary rewrite-psp-preset.sh script across toolsbeta T247455

20 April 2020

10 April 2020

8 April 2020

  • curprev 01:1001:10, 8 April 2020imported>Stashbot 28,644 bytes +105 bstorm_: upgrade toollabs-webservice to 0.66 for qa T249390

31 March 2020

  • curprev 23:3923:39, 31 March 2020imported>Stashbot 28,539 bytes +84 bstorm_: deployed toollabs-webservice-0.65 to toolsbeta

30 March 2020

  • curprev 10:3510:35, 30 March 2020imported>Stashbot 28,455 bytes +256 arturo: remove local changes in the puppet tree in toolsbeta-puppetmaster-03 (docker mount point)

24 March 2020

  • curprev 18:4518:45, 24 March 2020imported>Stashbot 28,199 bytes +154 jeh: cleanup and remove toolsbeta-elastic7-[1,2,3] VMs (re-configuring hypervisor for local storage) T243327

19 March 2020

  • curprev 23:1823:18, 19 March 2020imported>Stashbot 28,045 bytes +253 Krenair: Shut down toolsbeta-puppet(db-01|master-02) - T241719

16 March 2020

  • curprev 21:3821:38, 16 March 2020imported>Stashbot 27,792 bytes +1,212 bstorm_: removed lots of hiera related to the legacy k8s cluster T246689

11 March 2020

  • curprev 21:3221:32, 11 March 2020imported>Stashbot 26,580 bytes +92 bstorm_: deployed jobutils_1.39 and miscutils_1.39 to toolsbeta

9 March 2020

  • curprev 13:1113:11, 9 March 2020imported>Stashbot 26,488 bytes +167 arturo: created VM `toolsbeta-legacy-redirector` (T247236)

6 March 2020

  • curprev 16:2216:22, 6 March 2020imported>Stashbot 26,321 bytes +100 bstorm_: updating maintain-kubeusers image to filter invalid tool names

5 March 2020

  • curprev 21:2221:22, 5 March 2020imported>Stashbot 26,221 bytes +118 bstorm_: updated maintain-kubeusers to the latest version for toolsbeta only to live test

27 February 2020

  • curprev 19:1919:19, 27 February 2020imported>Stashbot 26,103 bytes +247 bstorm_: upgraded toollabs-webservice to 0.64 on stretch-toolsbeta for testing

26 February 2020

18 February 2020

  • curprev 23:2023:20, 18 February 2020imported>Stashbot 25,728 bytes +194 bstorm_: added toolsbeta-sgegrid-master.toolsbeta.eqiad1.wikimedia.cloud and toolsbeta-sgegrid-shadow.toolsbeta.eqiad1.wikimedia.cloud to gridengine admin host lists
(newest | oldest) View (newer 250 | ) (20 | 50 | 100 | 250 | 500)