You are browsing a read-only backup copy of Wikitech. The live site can be found at wikitech.wikimedia.org

Release Engineering/SAL: Revision history

Jump to navigation Jump to search

Diff selection: Mark the radio buttons of the revisions to compare and hit enter or the button at the bottom.
Legend: (cur) = difference with latest revision, (prev) = difference with preceding revision, m = minor edit.

(newest | oldest) View ( | ) (20 | 50 | 100 | 250 | 500)

1 October 2016

  • curprev 09:4109:41, 1 October 2016imported>Labslogbot 132,886 bytes +137 beta: shutdown deployment-db1 and deployment-db2 . Databases have been migrated to other hosts T138778 (hashar)

29 September 2016

  • curprev 15:4315:43, 29 September 2016imported>Labslogbot 132,749 bytes +641 logstash-beta: refreshed the field list via https://logstash-beta.wmflabs.org/app/kibana#/settings/indices/logstash (hashar)

28 September 2016

  • curprev 23:5623:56, 28 September 2016imported>Labslogbot 132,108 bytes +1,698 Deleted varnish cache files on deployment-cache-upload04 to free up space, disk full (MaxSem)

27 September 2016

  • curprev 20:1120:11, 27 September 2016imported>Labslogbot 130,410 bytes +195 Reloading Zuul to deploy 3c3289aa1a for T143938 and T146783 (hashar)

26 September 2016

24 September 2016

  • curprev 20:0820:08, 24 September 2016imported>Labslogbot 129,651 bytes +400 deployment-tin is shutdown. Replaced by Jessie deployment-tin02 (hashar)

23 September 2016

  • curprev 20:2120:21, 23 September 2016imported>Labslogbot 129,251 bytes +686 integration: salt -v '*trusty*' cmd.run 'service mysql start' (hashar)

22 September 2016

  • curprev 19:2919:29, 22 September 2016imported>Labslogbot 128,565 bytes +241 switching Jenkins slaves workspace from /mnt/jenkins-workspace to /srv/jenkins-workspace (actually the same dir/inode on the filesystem) (hasharAway)

21 September 2016

20 September 2016

  • curprev 21:4921:49, 20 September 2016imported>Labslogbot 126,058 bytes +2,278 Deleting deployment-mira02 /srv was too small. Replaced by deployment-mira (hashar)

19 September 2016

17 September 2016

16 September 2016

  • curprev 21:0321:03, 16 September 2016imported>Labslogbot 122,412 bytes +1,025 deployment-tin did a git gc on /srv/deployment/ores That freed up disk space and cleared an alarm on co master mira02 (hashar)

15 September 2016

  • curprev 22:2922:29, 15 September 2016imported>Labslogbot 121,387 bytes +1,969 sudo salt '*precise*' cmd.run 'service mysql start', all mysql's are down (legoktm)

14 September 2016

  • curprev 21:3721:37, 14 September 2016imported>Labslogbot 119,418 bytes +537 integration: setting "ulimit -c 2097152" on all slaves due to Zend PHP segfaulting T142158 (hashar)

13 September 2016

  • curprev 17:0217:02, 13 September 2016imported>Labslogbot 118,881 bytes +1,525 re-enabling beta cluster jenkins jobs following maintenance window (marxarelli)

12 September 2016

  • curprev 14:4114:41, 12 September 2016imported>Labslogbot 117,356 bytes +588 applied base::firewall, beta::deployaccess, mediawiki::conftool, role::mediawiki::appserver to deployment-mediawiki04.deployment-prep.eqiad.wmflabs (Debian jessie instance) - T144006 (elukey)

11 September 2016

9 September 2016

8 September 2016

  • curprev 21:3321:33, 8 September 2016imported>Labslogbot 116,286 bytes +1,462 Reloading Zuul to deploy https://gerrit.wikimedia.org/r/309413 " Inject PHP_BIN=php5 for php53 jobs" (hashar)

7 September 2016

6 September 2016

5 September 2016

  • curprev 14:0814:08, 5 September 2016imported>Labslogbot 112,066 bytes +130 Refreshing Nodepool base images for Trusty and Jessie. Managed to build new ones after T143769 (hashar)

2 September 2016

1 September 2016

  • curprev 19:0019:00, 1 September 2016imported>Labslogbot 111,759 bytes +670 T130861: Restarting Cassandra on deployment-restbase0[1-2] (urandom)

31 August 2016

  • curprev 23:4023:40, 31 August 2016imported>Labslogbot 111,089 bytes +986 forced puppet run on deployment-salt02. Had not run automatically for 8 hours (bd808)

30 August 2016

  • curprev 23:3123:31, 30 August 2016imported>Labslogbot 110,103 bytes +2,327 cherry-picking https://gerrit.wikimedia.org/r/#/c/307656/ fixed puppet on the elasticsearch machines! (yuvipanda)

29 August 2016

  • curprev 07:5607:56, 29 August 2016imported>Labslogbot 107,776 bytes +226 hard rebooting integration-slave-trusty-1012 via horizon and restarting puppet manually (hashar)

27 August 2016

  • curprev 20:5120:51, 27 August 2016imported>Labslogbot 107,550 bytes +412 integration: tweak sudo policy for jenkins-deploy running cowbuilder: env_keep+=DEB_BUILD_OPTIONS (hashar)

26 August 2016

  • curprev 22:2922:29, 26 August 2016imported>Labslogbot 107,138 bytes +551 deploying https://gerrit.wikimedia.org/r/307025 (legoktm)
  • curprev 00:2800:28, 26 August 2016imported>Labslogbot 106,587 bytes +795 restarted puppetmaster service on deployment-puppetmaster (twentyafterfour)

24 August 2016

23 August 2016

  • curprev 18:2118:21, 23 August 2016imported>Labslogbot 105,304 bytes +409 deploying https://gerrit.wikimedia.org/r/306257 (legoktm)

22 August 2016

18 August 2016

  • curprev 22:0322:03, 18 August 2016imported>Labslogbot 104,823 bytes +334 deployment-fluorine02: Hack 'datasets:x:10003:997::/home/datasets:/bin/bash' into /etc/passwd for T117028 (bd808)

17 August 2016

  • curprev 22:2822:28, 17 August 2016imported>Labslogbot 104,489 bytes +524 deploying https://gerrit.wikimedia.org/r/305408 (legoktm)

16 August 2016

  • curprev 23:1023:10, 16 August 2016imported>Labslogbot 103,965 bytes +350 max_servers at 6, seeing 6 allocated instances, still seeing 403 already used 10 of 10 instances :(( (thcipriani)

15 August 2016

  • curprev 21:3021:30, 15 August 2016imported>Labslogbot 103,615 bytes +710 update scap on beta to 3.2.3-1 bugfix release (thcipriani)

13 August 2016

10 August 2016

  • curprev 23:5623:56, 10 August 2016imported>Labslogbot 102,533 bytes +347 deploying https://gerrit.wikimedia.org/r/304149 (legoktm)

9 August 2016

  • curprev 23:2123:21, 9 August 2016imported>Labslogbot 102,186 bytes +412 ladsgroup@deployment-sca03:~$ sudo service celery-ores-worker restart (Amir1)
  • curprev 00:5600:56, 9 August 2016imported>Labslogbot 101,774 bytes +341 deploying https://gerrit.wikimedia.org/r/303726 (legoktm)

7 August 2016

  • curprev 12:0112:01, 7 August 2016imported>Labslogbot 101,433 bytes +604 Nodepool: can't spawn instances due to: Forbidden: Quota exceeded for instances: Requested 1, but already used 10 of 10 instances (HTTP 403) (hashar)

6 August 2016

  • curprev 12:3112:31, 6 August 2016imported>Labslogbot 100,829 bytes +240 restarting uwsgi-ores and celery-ores-worker in deployment-sca03 (Amir1)

5 August 2016

  • curprev 17:5417:54, 5 August 2016imported>Labslogbot 100,589 bytes +251 Cherry-picked https://gerrit.wikimedia.org/r/#/c/299825/3 for testing (bd808)
  • curprev 00:4100:41, 5 August 2016imported>Labslogbot 100,338 bytes +421 Reloading Zuul to deploy https://gerrit.wikimedia.org/r/303113 (Krinkle)

1 August 2016

  • curprev 20:2820:28, 1 August 2016imported>Labslogbot 99,917 bytes +170 restarting deployment-ms-be01, not responding to ssh, mw-fe01 requests timing out (thcipriani)

29 July 2016

  • curprev 23:2723:27, 29 July 2016imported>Labslogbot 99,747 bytes +842 Rebooting deployment-logstash2; Console showed hung task timeouts (P3606) (bd808)

28 July 2016

  • curprev 21:4621:46, 28 July 2016imported>Labslogbot 98,905 bytes +580 xintegration: change sudo policy for jenkins-deploy to help on T141538 : env_keep+=WORKSPACE (hashar_)

27 July 2016

  • curprev 16:1316:13, 27 July 2016imported>Labslogbot 98,325 bytes +878 salt -v '*slave-trusty*' cmd.run 'service mysql start' ( was missing on integration-slave-trusty-1011.integration.eqiad.wmflabs ) (hashar)

26 July 2016

  • curprev 20:1320:13, 26 July 2016imported>Labslogbot 97,447 bytes +795 Zuul deployed https://gerrit.wikimedia.org/r/301093 which adds 'debian-glue' job on all of operations/debs/ repos (hashar)
  • curprev 01:0801:08, 26 July 2016imported>Labslogbot 96,652 bytes +341 deployed ores a291da1 in sca03, ores-beta.wmflabs.org works as expected (Amir1)

23 July 2016

  • curprev 20:0620:06, 23 July 2016imported>Labslogbot 96,311 bytes +316 Cleanup jobrunner01 logs via -- sudo logrotate --force /etc/logrotate.d/mediawiki_jobrunner (bd808)

22 July 2016

  • curprev 20:2620:26, 22 July 2016imported>Labslogbot 95,995 bytes +1,322 T141114 upgraded jenkins-debian-glue from v0.13.0 to v0.17.0 on integration-slave-jessie-1001 and integration-slave-jessie-1002 (hashar)

21 July 2016

  • curprev 16:1216:12, 21 July 2016imported>Labslogbot 94,673 bytes +640 Updated our JJB fork cherry picking f74501e781f by madhuvishy. Was made to support the maven release plugin. Branch bump is 10f2bcd..6fcaf39 (hashar)
  • curprev 00:1300:13, 21 July 2016imported>Labslogbot 94,033 bytes +1,279 Cherry-picked https://gerrit.wikimedia.org/r/#/c/299825/ to deployment-puppetmaster so wdqs nginx log parsing can be tested (bd808)

18 July 2016

  • curprev 20:5620:56, 18 July 2016imported>Labslogbot 92,754 bytes +385 Deleted deployment-fluorine:/srv/mw-log/archive/*-201605* freed 30 GB (thcipriani)

16 July 2016

15 July 2016

  • curprev 08:3408:34, 15 July 2016imported>Labslogbot 92,317 bytes +132 Unpooling integration-slave-precise-1002 will use it as a zuul-server test instance temporarily (hashar)

14 July 2016

  • curprev 18:5418:54, 14 July 2016imported>Labslogbot 92,185 bytes +316 deployment-prep manually edited elasticsearch.yml on deployment-elastic05 and restarted to get it listening on eth0. Still looking into why puppet wrote out wrong config file (ebernhardson)

13 July 2016

  • curprev 16:0516:05, 13 July 2016imported>Labslogbot 91,869 bytes +512 Installing Cassandra 2.2.6-wmf1 on deployment-restbase0[1-2].deployment-prep.eqiad.wmflabs : T126629 (urandom)

12 July 2016

  • curprev 20:2920:29, 12 July 2016imported>Labslogbot 91,357 bytes +643 integration: force running unattended upgrade on all instances: salt --batch 4 -v '*' cmd.run 'unattended-upgrade' . That upgrades diamond and hhvm among others. imagemagick-common has a prompt though (hashar)

11 July 2016

  • curprev 14:2414:24, 11 July 2016imported>Labslogbot 90,714 bytes +579 Removing ZeroMQ config from the Jenkins jobs. It is now enabled globally. T139923 (hashar)

9 July 2016

  • curprev 18:5718:57, 9 July 2016imported>Labslogbot 90,135 bytes +223 deploying https://gerrit.wikimedia.org/r/297731 and https://gerrit.wikimedia.org/r/298142 (legoktm)

8 July 2016

  • curprev 16:0816:08, 8 July 2016imported>Labslogbot 89,912 bytes +817 scandium: git -C /srv/ssd/zuul/git/mediawiki/services/graphoid remote set-head origin --auto (hashar)

7 July 2016

  • curprev 21:4121:41, 7 July 2016imported>Labslogbot 89,095 bytes +283 Chowned php-master/vendor back to jenkins-deploy (MaxSem)
  • curprev 01:1401:14, 7 July 2016imported>Labslogbot 88,812 bytes +1,085 Restarted logstash on deployment-logstash2 (bd808)

5 July 2016

  • curprev 21:5421:54, 5 July 2016imported>Labslogbot 87,727 bytes +201 CI has drained the gate-and-submit queue (hasharAway)

4 July 2016

  • curprev 18:5818:58, 4 July 2016imported>Labslogbot 87,526 bytes +170 Upgrading arcanist on permanent CI slaves since xhpast was broken T137770 (hashar)

3 July 2016

  • curprev 13:1013:10, 3 July 2016imported>Labslogbot 87,356 bytes +238 phabricator Update phab-01 and phab-05 (phab-02) and phab-03 to fix a security bug in phabricator (Did the update last night but forgot to log it) (paladox)

2 July 2016

  • curprev 13:3813:38, 2 July 2016imported>Labslogbot 87,118 bytes +74 reloading zuul for 15127b2..7e6a2e2 (jzerebecki)

30 June 2016

  • curprev 10:3110:31, 30 June 2016imported>Labslogbot 87,044 bytes +492 Deleting integration-slave-trusty-1015 . Can not bring up mysql T138074 and the ssh slave connection would not hold anyway. Must be broken somehow (hashar)

28 June 2016

27 June 2016

  • curprev 22:3222:32, 27 June 2016imported>Labslogbot 86,456 bytes +680 deployment-prep deployed gerrit.wikimedia.org/r/296279 to puppetmaster to test kibana4 role (eberhardson)

24 June 2016

  • curprev 15:0415:04, 24 June 2016imported>Labslogbot 85,776 bytes +372 switch apps-android-wikimedia-* jobs to Jessie T138506 (hashar)

23 June 2016

  • curprev 13:5813:58, 23 June 2016imported>Labslogbot 85,404 bytes +391 Reloading Zuul to deploy https://gerrit.wikimedia.org/r/295691 (Krinkle)

17 June 2016

  • curprev 10:3510:35, 17 June 2016imported>Labslogbot 85,013 bytes +181 offlined integration-slave-trusty-1015 T138074 (jzerebecki)

14 June 2016

  • curprev 14:2214:22, 14 June 2016imported>Labslogbot 84,832 bytes +275 T136971 on tin MediaWiki 1.28.0-wmf.6, from 1.28.0-wmf.6, successfully checked out. Applying security patches (hashar)

13 June 2016

  • curprev 21:1121:11, 13 June 2016imported>Labslogbot 84,557 bytes +898 https://integration.wikimedia.org/ci/computer/integration-slave-trusty-1015/ put offline. Jenkins cant ssh / pool it for some reason (hashar)

10 June 2016

  • curprev 15:4915:49, 10 June 2016imported>Labslogbot 83,659 bytes +779 reloading zuul for 8c048fb..272d1ec (jzerebecki)

9 June 2016

  • curprev 18:4918:49, 9 June 2016imported>Labslogbot 82,880 bytes +372 restarting nutcracker on deployment-mediawiki02 (hashar)

8 June 2016

7 June 2016

  • curprev 19:2819:28, 7 June 2016imported>Labslogbot 82,364 bytes +449 Nodepool has troubles spawning instances probably due to on going (?) labs maintenance (hashar)

6 June 2016

  • curprev 19:2619:26, 6 June 2016imported>Labslogbot 81,915 bytes +308 Regenerating Nodepool snapshots for Trusty and Jessie (hasharAway)

4 June 2016

  • curprev 00:0900:09, 4 June 2016imported>Labslogbot 81,607 bytes +562 krinkle@integration-slave-trusty-1017:~$ sudo rm -rf /mnt/jenkins-workspace/workspace/mediawiki-extensions-hhvm/src/extensions/Babel (T86730) (Krinkle)

2 June 2016

  • curprev 12:1012:10, 2 June 2016imported>Labslogbot 81,045 bytes +129 Upgraded Zuul upstream code being 66c8e52..30a433b package is 2.1.0-151-g30a433b-wmf1precise1 (hashar)

1 June 2016

  • curprev 17:4917:49, 1 June 2016imported>Labslogbot 80,916 bytes +888 Reloading Zuul to deploy https://gerrit.wikimedia.org/r/292186 (Krinkle)

31 May 2016

  • curprev 20:2420:24, 31 May 2016imported>Labslogbot 80,028 bytes +101 Reloading zuul to pick up I58f878f3fd19dfa21a46a52464575cb06aacbb22 (bd808)

30 May 2016

  • curprev 18:3918:39, 30 May 2016imported>Labslogbot 79,927 bytes +624 Upgraded our Jenkins Job Builder fork to 1.5.0 + a couple of cherry picks: cd63874...10f2bcd (hashar)

28 May 2016

  • curprev 04:4304:43, 28 May 2016imported>Labslogbot 79,303 bytes +95 depooling integration-slave-trusty-1015 to profile phpunit runs (ori)

27 May 2016

26 May 2016

  • curprev 22:2322:23, 26 May 2016imported>Labslogbot 78,916 bytes +588 salt -v '*trusty*' cmd.run 'puppet agent --disable "Chromium needs to be v49. See T136188"' (hashar)

25 May 2016

  • curprev 22:3822:38, 25 May 2016imported>Labslogbot 78,328 bytes +1,025 running puppet agent manually on sca01 (Amir1)

24 May 2016

  • curprev 07:0307:03, 24 May 2016imported>Labslogbot 77,303 bytes +75 rebooting deployment-tin, can't log in (mobrovac)

23 May 2016

  • curprev 19:3519:35, 23 May 2016imported>Labslogbot 77,228 bytes +1,024 killed all mysqld process on Trusty CI slaves (hashar)

20 May 2016

  • curprev 20:3020:30, 20 May 2016imported>Labslogbot 76,204 bytes +151 Killing https://integration.wikimedia.org/ci/job/mediawiki-extensions-qunit/43608/ which has been running for 5 hours (bd808)

19 May 2016

  • curprev 16:4716:47, 19 May 2016imported>Labslogbot 76,053 bytes +778 deployment-tin jenkins worker seems to be back online after [https://www.mediawiki.org/wiki/Continuous_integration/Jenkins#Hung_beta_code.2Fdb_update some prodding] (thcipriani)

18 May 2016

  • curprev 13:1613:16, 18 May 2016imported>Labslogbot 75,275 bytes +413 deploying a05e830 to ores nodes (sca01 and ores-web) (Amir1)

13 May 2016

  • curprev 14:3914:39, 13 May 2016imported>Labslogbot 74,862 bytes +601 remove shadow l10nupdate user from deployment-tin and mira in beta (thcipriani)
(newest | oldest) View ( | ) (20 | 50 | 100 | 250 | 500)