Revision history of "Nova Resource:Tools/SAL"

Jump to navigation Jump to search

Diff selection: Mark the radio boxes of the revisions to compare and hit enter or the button at the bottom.
Legend: (cur) = difference with latest revision, (prev) = difference with preceding revision, m = minor edit.

(newest | oldest) View ( | older 50) (20 | 50 | 100 | 250 | 500)
  • curprev 18:09, 24 October 2017imported>Stashbot 175,293 bytes +201 madhuvishy: Disable puppet on tools-package-builder-01 temporarily (T178920)
  • curprev 14:49, 23 October 2017imported>Stashbot 175,092 bytes +92 chasemp: wall message and scheduled reboot in 5m for bastion-03
  • curprev 21:36, 18 October 2017imported>Stashbot 175,000 bytes +275 chasemp: stop basebot -- it is going crazy and spamming email w/ failing to log to error.log. Need to figure out how to notify but it's clearly in a failure loop.
  • curprev 16:57, 12 October 2017imported>Stashbot 174,725 bytes +163 bd808: Rebuilding all Kubernetes Docker images to include toollabs-webservice 0.38
  • curprev 15:33, 6 October 2017imported>Stashbot 174,562 bytes +67 bd808: Upgrade jobutils to 1.25 (T177614)
  • curprev 00:27, 6 October 2017imported>Stashbot 174,495 bytes +142 bd808: Updated misctools to 1.24
  • curprev 15:46, 5 October 2017imported>Stashbot 174,353 bytes +169 chasemp: tools-bastion-03 has tons of local tools running long lived NFS intensive processes. I'm rebooting rather than playing whackamole.
  • curprev 19:30, 3 October 2017imported>Stashbot 174,184 bytes +103 bd808: `kubectl --namespace=prod delete pod --all` on tools-paws-master-01
  • curprev 21:46, 1 October 2017imported>Stashbot 174,081 bytes +108 madhuvishy: Cold migrating tools-clushmaster-01 from labvirt1015 to labvirt1017
  • curprev 19:49, 29 September 2017imported>Stashbot 173,973 bytes +88 andrewbogott: migration tools-clushmaster-01 to labvirt1015
  • curprev 15:14, 25 September 2017imported>Stashbot 173,885 bytes +224 andrewbogott: rebooting tools-paws-worker-1006 since I can't access it
  • curprev 16:52, 20 September 2017imported>Stashbot 173,661 bytes +922 madhuvishy: apt-get install --only-upgrade apache2; service apache2 restart on tools-puppetmaster-01
  • curprev 01:09, 13 September 2017imported>Stashbot 172,739 bytes +397 bd808: Removed user WiktCAPT from project
  • curprev 20:33, 31 August 2017imported>Stashbot 172,342 bytes +503 madhuvishy: Updated certs and ran puppet, restarted nginx on tools-proxy-* and tools-static-* (T174611)
  • curprev 19:59, 24 August 2017imported>Stashbot 171,839 bytes +140 bd808: restarted nslcd and nscd on tools-bastion-03
  • curprev 19:20, 22 August 2017imported>Stashbot 171,699 bytes +108 andrewbogott: deleted tools-puppetmaster-02, it was replaced a month ago by -01
  • curprev 18:38, 12 August 2017imported>Stashbot 171,591 bytes +61 chasemp: retart admin webservice
  • curprev 16:09, 11 August 2017imported>Stashbot 171,530 bytes +67 chasemp: qdel -f -j 7441503
  • curprev 14:59, 10 August 2017imported>Stashbot 171,463 bytes +117 chasemp: 'become stimmberechtigung && restart' && 'become intersect-contribs && restart'
  • curprev 17:28, 9 August 2017imported>Stashbot 171,346 bytes +74 chasemp: webservices restart tools.orphantalk
  • curprev 00:47, 3 August 2017imported>Stashbot 171,272 bytes +244 bd808: tools-bastion-03 not usably responsive to interactive commands; will reboot
  • curprev 15:28, 31 July 2017imported>Stashbot 171,028 bytes +82 chasemp: remove python-keystoneclient from bastion-03
  • curprev 23:27, 27 July 2017imported>Stashbot 170,946 bytes +353 bd808: Killed python procs owned by sdesabbata on tools-login that were stealing all cpu/io
  • curprev 22:33, 26 July 2017imported>Stashbot 170,593 bytes +95 chasemp: hotpatching an hiera value on tools master to see effects
  • curprev 19:48, 20 July 2017imported>Stashbot 170,498 bytes +694 bd808: Clearing all Eqw state jobs in all queues with: qstat -u '*' | grep Eqw | awk '{print $1;}' | xargs -L1 qmod -cj
  • curprev 23:52, 19 July 2017imported>Stashbot 169,804 bytes +302 bd808: Restarted cron on tools-cron-01; toolschecker job showing user not found errors
  • curprev 19:51, 18 July 2017imported>Stashbot 169,502 bytes +112 andrewbogott: enabling puppet on tools-proxy-02. I don't know why it was disabled.
  • curprev 01:43, 17 July 2017imported>Stashbot 169,390 bytes +182 bd808: Uncordoned tools-worker-1020 after it deleted pods with local storage that were filling the entire disk
  • curprev 21:59, 13 July 2017imported>Stashbot 169,208 bytes +376 bd808: Elasticsearch cluster upgraded to 5.3.2
  • curprev 15:46, 12 July 2017imported>Stashbot 168,832 bytes +122 chasemp: push out puppet run across tools
  • curprev 18:26, 7 July 2017imported>Stashbot 168,710 bytes +88 bd808: Forced puppet runs on tools-redis-* for security fix
  • curprev 04:26, 3 July 2017imported>Stashbot 168,622 bytes +224 bd808: cdnjs on tools-static-10 is up to date
  • curprev 19:40, 1 July 2017imported>Stashbot 168,398 bytes +175 bd808: Disabled puppet on tools-k8s-master-01 to try and fix maintain-kubeusers
  • curprev 01:33, 30 June 2017imported>Stashbot 168,223 bytes +144 chasemp: time for i in `cat tools-hosts`; do ssh -i ~/.ssh/labs_root_id_rsa root@$i.eqiad.wmflabs 'hostname -f; uptime; tc-setup'; done
  • curprev 01:29, 30 June 2017imported>Stashbot 168,079 bytes +1,063 andrewbogott: rebooting tools-cron-01
  • curprev 21:32, 27 June 2017imported>Stashbot 167,016 bytes +128 andrewbogott: moving all tools nodes to new puppetmaster, tools-puppetmaster-01.tools.eqiad.wmflabs
  • curprev 15:13, 25 June 2017imported>Stashbot 166,888 bytes +78 madhuvishy: Restarted webservice on tools.fatameh
  • curprev 16:01, 24 June 2017imported>Stashbot 166,810 bytes +133 bd808: Created and provisioned elasticsearch password for tools.wmde-uca-test (T167971)
  • curprev 20:20, 23 June 2017imported>Stashbot 166,677 bytes +175 bd808: Reindexing various elasticsearch indexes created before we upgraded to v2.x
  • curprev 17:03, 22 June 2017imported>Stashbot 166,502 bytes +287 bd808: Rolled back attempt at Elasticsearch upgrade. Indices need to be rebuilt with 2.x before 5.x can be installed. T164842
  • curprev 00:12, 22 June 2017imported>Stashbot 166,215 bytes +3,075 bd808: Set ownership and permissions on $HOME/.kube for all tools (T165875)
  • curprev 22:09, 14 June 2017imported>Stashbot 163,140 bytes +83 bd808: Restarted apache2 proc on tools-puppetmaster-02
  • curprev 18:14, 8 June 2017imported>Stashbot 163,057 bytes +369 madhuvishy: Also delete from /tmp on tools-webgrid-lighttpd-1411 xvfb-run.*, calibre_* and ws-*.epub
  • curprev 19:05, 7 June 2017imported>Stashbot 162,688 bytes +94 madhuvishy: Killed scp job run by user torin8 on tools-bastion-02
  • curprev 20:30, 6 June 2017imported>Stashbot 162,594 bytes +142 chasemp: rebooting tools-bastion-02 as unresponsive (up 76 days and lots of seemingly left behind things running)
  • curprev 23:44, 5 June 2017imported>Stashbot 162,452 bytes +390 bd808: Deleted tools.iabot crontab that somehow got locally installed on tools-exec-1412 on 2017-05-24T20:55Z
  • curprev 15:15, 1 June 2017imported>Stashbot 162,062 bytes +124 andrewbogott: depooling/rebooting/repooling tools-exec-1403 as part of old kernel-purge testing
  • curprev 19:29, 31 May 2017imported>Stashbot 161,938 bytes +668 bd808: Rebuiding all Docker images to pick up toollabs-webservice v0.37 (T163355)
  • curprev 22:32, 30 May 2017imported>Stashbot 161,270 bytes +1,004 andrewbogott: migrating tools-webgrid-lighttpd-1406, tools-exec-1410 from labvirt1006 to labvirt1009 to balance cpu usage
  • curprev 20:32, 26 May 2017imported>Stashbot 160,266 bytes +160,266 bd808: Added tools-webgrid-lighttpd-14{19,2[0-8]} as submit hosts
(newest | oldest) View ( | older 50) (20 | 50 | 100 | 250 | 500)