You are browsing a read-only backup copy of Wikitech. The live site can be found at wikitech.wikimedia.org

Release Engineering/SAL: Revision history

Jump to navigation Jump to search

Diff selection: Mark the radio buttons of the revisions to compare and hit enter or the button at the bottom.
Legend: (cur) = difference with latest revision, (prev) = difference with preceding revision, m = minor edit.

(newest | oldest) View ( | ) (20 | 50 | 100 | 250 | 500)

12 May 2016

  • curprev 22:5322:53, 12 May 2016imported>Labslogbot 74,261 bytes +86 Started dead mysql on integration-slave-precise-1011 (bd808)

11 May 2016

  • curprev 21:0521:05, 11 May 2016imported>Labslogbot 74,175 bytes +1,452 Reloading Zuul to deploy https://gerrit.wikimedia.org/r/288128 #T134946 (hashar)

10 May 2016

  • curprev 19:1719:17, 10 May 2016imported>Labslogbot 72,723 bytes +1,609 beta / CI purging old Linux kernels: salt -v '*' cmd.run 'dpkg -l|grep ^rc|awk "{ print \$2 }"|grep linux-image|xargs dpkg --purge' (hashar)

9 May 2016

  • curprev 20:5820:58, 9 May 2016imported>Labslogbot 71,114 bytes +890 Unbroke puppet on integration-raita.integration.eqiad.wmflabs . Puppet was blocked because role::ci::raita was no more. Fixed by rebasing https://gerrit.wikimedia.org/r/#/c/208024 T115330 (hashar)

6 May 2016

  • curprev 19:4519:45, 6 May 2016imported>Labslogbot 70,224 bytes +172 Restart cassandra-metrics-collector on deployment-restbase0[1-2] (urandom)

5 May 2016

  • curprev 22:0922:09, 5 May 2016imported>Labslogbot 70,052 bytes +139 Promoted Yurik and Jgirault to sysops on beta enwiki. Through shell because logging in is broken for me. (MaxSem)

4 May 2016

  • curprev 21:2821:28, 4 May 2016imported>Labslogbot 69,913 bytes +1,227 deployed puppet FQDN domain patch for OCG: https://gerrit.wikimedia.org/r/286068 and restarted ocg on deployment-pdf0[12] (cscott)

3 May 2016

  • curprev 23:2123:21, 3 May 2016imported>Labslogbot 68,686 bytes +1,748 Changed "Maximum Number of Retries" for ssh agent launch in jenkins for deployment-tin from "0" to "10" (bd808)

2 May 2016

  • curprev 21:2721:27, 2 May 2016imported>Labslogbot 66,938 bytes +1,284 updated OCG to version b775e612520f9cd4acaea42226bcf34df07439f7 (cscott)

30 April 2016

  • curprev 18:3118:31, 30 April 2016imported>Labslogbot 65,654 bytes +136 deploying d4f63a3 from github.com/wiki-ai/ores-wikimedia-config into targets in beta cluster via scap3 (Amir1)

29 April 2016

28 April 2016

  • curprev 22:0322:03, 28 April 2016imported>Labslogbot 65,189 bytes +1,833 deployment-restbase01 upgrade to 2.2.6 complete : T126629 (urandom)

27 April 2016

  • curprev 23:5723:57, 27 April 2016imported>Labslogbot 63,356 bytes +1,474 nodepool instances running again after an openstack rabbitmq restart by andrewbogott (thcipriani)

26 April 2016

  • curprev 20:4520:45, 26 April 2016imported>Labslogbot 61,882 bytes +875 Regenerating Nodepool Jessie snapshot to include composer and HHVM | T128092 (hashar)
  • curprev 00:4600:46, 26 April 2016imported>Labslogbot 61,007 bytes +1,084 temporary keyholder fix in place in beta (thcipriani)

24 April 2016

22 April 2016

  • curprev 18:1318:13, 22 April 2016imported>Labslogbot 59,858 bytes +148 deploying https://gerrit.wikimedia.org/r/284841 (legoktm)

21 April 2016

  • curprev 19:0719:07, 21 April 2016imported>Labslogbot 59,710 bytes +234 scap version testing should be done, puppet should no longer be disabled on hosts (thcipriani)

20 April 2016

  • curprev 22:2822:28, 20 April 2016imported>Labslogbot 59,476 bytes +541 rolling back scap version in beta, legit failure :( (thcipriani)

17 April 2016

  • curprev 01:0101:01, 17 April 2016imported>Labslogbot 58,935 bytes +223 deploying https://gerrit.wikimedia.org/r/283837 (legoktm)

13 April 2016

  • curprev 01:4801:48, 13 April 2016imported>Labslogbot 58,712 bytes +83 deploying https://gerrit.wikimedia.org/r/282952 (legoktm)

12 April 2016

  • curprev 19:4719:47, 12 April 2016imported>Labslogbot 58,629 bytes +869 Cleaned up large hhbc cache file on deployment-medaiwiki03 via `sudo service hhvm stop; sudo rm /var/cache/hhvm/fcgi.hhbc.sq3; sudo service hhvm start` (bd808)

11 April 2016

8 April 2016

  • curprev 22:4622:46, 8 April 2016imported>Labslogbot 57,302 bytes +563 Created blobs1 table for all wiki DBs on Beta Cluster (matt_flaschen)

7 April 2016

  • curprev 20:1620:16, 7 April 2016imported>Labslogbot 56,739 bytes +217 deployment-mediawiki02.deployment-prep.eqiad.wmflabs , cleared up random left over stuff / big logs etc (hashar)

5 April 2016

  • curprev 23:5623:56, 5 April 2016imported>Labslogbot 56,522 bytes +561 Removed cherry-pick and rebased /var/lib/git/operations/puppet on integration-puppetmaster after merge of https://gerrit.wikimedia.org/r/#/c/281706/ (marxarelli)

4 April 2016

  • curprev 17:3017:30, 4 April 2016imported>Labslogbot 55,961 bytes +400 Phabricator going down in about 10 minutes to hopefully address the overheating issue: T131742 (greg-g)

3 April 2016

  • curprev 07:0207:02, 3 April 2016imported>Labslogbot 55,561 bytes +157 deploying https://gerrit.wikimedia.org/r/281079 (legoktm)

2 April 2016

  • curprev 22:5822:58, 2 April 2016imported>Labslogbot 55,404 bytes +425 added local hack to pupetmaster to make scap3 provider more verbose (Amir1)

1 April 2016

  • curprev 22:1622:16, 1 April 2016imported>Labslogbot 54,979 bytes +960 Reloading Zuul to deploy https://gerrit.wikimedia.org/r/281046 (Krinkle)
  • curprev 00:1600:16, 1 April 2016imported>Labslogbot 54,019 bytes +413 created oathauth_users table on centralauth db in beta (csteipp)

30 March 2016

  • curprev 19:3219:32, 30 March 2016imported>Labslogbot 53,606 bytes +709 deleted some nutcracker and hhvm log files on deployment-mediawiki01 to free space (twentyafterfour)

29 March 2016

  • curprev 23:2223:22, 29 March 2016imported>Labslogbot 52,897 bytes +365 running jenkins-jobs update config/ 'mwext-donationinterfacecore125-testextension-zend53' to deploy https://gerrit.wikimedia.org/r/#/c/280261/ (marxarelli)

26 March 2016

25 March 2016

  • curprev 23:5523:55, 25 March 2016imported>Labslogbot 52,458 bytes +1,083 deleting instances integration-slave-trusty-1002 and integration-slave-trusty-1005 (marxarelli)

24 March 2016

  • curprev 16:3916:39, 24 March 2016imported>Labslogbot 51,375 bytes +350 restarted rsync service on deployment-tin (thcipriani)

23 March 2016

  • curprev 23:0023:00, 23 March 2016imported>Labslogbot 51,025 bytes +200 rm-rf integration-slave-trusty-1013:/mnt/home/jenkins-deploy/tmpfs/jenkins-2/karma-54925082/ (bad permissions, caused Karma issues) (Krinkle)

22 March 2016

  • curprev 17:4017:40, 22 March 2016imported>Labslogbot 50,825 bytes +83 deploying https://gerrit.wikimedia.org/r/278926 (legoktm)

21 March 2016

  • curprev 21:5521:55, 21 March 2016imported>Labslogbot 50,742 bytes +1,183 zuul: almost all MediaWiki extensions migrated to run the npm job on Nodepool (with Node.js 4.3) T119143 . All tested. Will monitor the build results that ran overnight tomorrow (hashar)

19 March 2016

  • curprev 13:0413:04, 19 March 2016imported>Labslogbot 49,559 bytes +114 Jenkins: added ldap-labs-codfw.wikimedia.org as a fallback LDAP server T130446 (hashar)

18 March 2016

17 March 2016

  • curprev 21:1021:10, 17 March 2016imported>Labslogbot 49,371 bytes +318 updating scap on deployment-tin to test D133 (thcipriani)

16 March 2016

  • curprev 14:2814:28, 16 March 2016imported>Labslogbot 49,053 bytes +143 Updated jobs having the package manager cache system (castor) via https://gerrit.wikimedia.org/r/#/c/277774/ (hashar)

15 March 2016

  • curprev 15:1715:17, 15 March 2016imported>Labslogbot 48,910 bytes +542 added wikidata.beta.wmflabs.org in https://wikitech.wikimedia.org/wiki/Special:NovaAddress to deployment-cache-text04.deployment-prep.eqiad.wmflabs (jzerebecki)

14 March 2016

  • curprev 22:1822:18, 14 March 2016imported>Labslogbot 48,368 bytes +398 new jobs weren't processing in Zuul, lego fixed it and blamed Reedy (greg-g)

11 March 2016

  • curprev 22:4222:42, 11 March 2016imported>Labslogbot 47,970 bytes +235 deploying https://gerrit.wikimedia.org/r/276901 (legoktm)

10 March 2016

  • curprev 20:2220:22, 10 March 2016imported>Labslogbot 47,735 bytes +503 Nodepool Image ci-jessie-wikimedia-1457641052 in wmflabs-eqiad is ready (hashar)

9 March 2016

  • curprev 17:5617:56, 9 March 2016imported>Labslogbot 47,232 bytes +2,402 Cleaned up git clone state in deployment-tin.deployment-prep:/srv/mediawiki-staging/php-master and queued beta-code-update-eqiad to try again (T129371) (bd808)

7 March 2016

  • curprev 21:0321:03, 7 March 2016imported>Labslogbot 44,830 bytes +226 Nodepool upgraded to 0.1.1-wmf.4 , it no more waits 1 minute before deleted a used node | T118573 (hashar)

6 March 2016

  • curprev 10:2010:20, 6 March 2016imported>Labslogbot 44,604 bytes +83 deploying https://gerrit.wikimedia.org/r/274911 (legoktm)

4 March 2016

  • curprev 19:3119:31, 4 March 2016imported>Labslogbot 44,521 bytes +435 Nodepool Image ci-jessie-wikimedia-1457119603 in wmflabs-eqiad is ready - T128846 (hashar)
  • curprev 00:1100:11, 4 March 2016imported>Labslogbot 44,086 bytes +947 salt -v --show-timeout '*slave*' cmd.run "bash -c 'cd /srv/deployment/integration/slave-scripts; git pull'" (Krinkle)

2 March 2016

  • curprev 16:2216:22, 2 March 2016imported>Labslogbot 43,139 bytes +297 reloading zuul for 9398fa1..943f17b (jzerebecki)
  • curprev 01:1901:19, 2 March 2016imported>Labslogbot 42,842 bytes +1,454 force restarting zuul because the queue is very stuck https://www.mediawiki.org/wiki/Continuous_integration/Zuul#Restart (thcipriani)

29 February 2016

  • curprev 16:2316:23, 29 February 2016imported>Labslogbot 41,388 bytes +447 salt -v '*slave*' cmd.run 'rm -fR /mnt/jenkins-workspace/workspace/mwext*jslint' T127362 (hashar)

28 February 2016

  • curprev 01:3001:30, 28 February 2016imported>Labslogbot 40,941 bytes +119 Rebooting integration-slave-precise-1012 – Might help T109704 (MySQL not running) (Krinkle)

26 February 2016

  • curprev 15:1415:14, 26 February 2016imported>Labslogbot 40,822 bytes +1,342 salt -v --show-timeout '*slave*' cmd.run "bash -c 'cd /srv/deployment/integration/slave-scripts; git pull'" T128191 (jzerebecki)

25 February 2016

  • curprev 22:3822:38, 25 February 2016imported>Labslogbot 39,480 bytes +890 beta: maybe deployment-jobunner01 is processing jobs a bit faster now. Seems like hhvm went wild (hashar)
  • curprev 00:3100:31, 25 February 2016imported>Labslogbot 38,590 bytes +1,255 running puppet on beta to update scap to latest packaged version: sudo salt -b '10%' -G 'deployment_target:scap/scap' cmd.run 'puppet agent -t' (thcipriani)

23 February 2016

22 February 2016

  • curprev 22:0622:06, 22 February 2016imported>Labslogbot 37,039 bytes +498 Restarted puppetmaster service on deployment-puppetmaster to "fix" error "invalid byte sequence in US-ASCII" (bd808)

20 February 2016

  • curprev 20:1920:19, 20 February 2016imported>Labslogbot 36,541 bytes +415 beta-code-update-eqiad job repeatedly stuck at "IRC notifier plugin" (Krinkle)

19 February 2016

  • curprev 12:0912:09, 19 February 2016imported>Labslogbot 36,126 bytes +289 killed https://integration.wikimedia.org/ci/job/beta-code-update-eqiad/ been running for 13 hours. Blocked because slave went offline due to labs reboots yesterday (hashar)

18 February 2016

  • curprev 19:2019:20, 18 February 2016imported>Labslogbot 35,837 bytes +492 deploying https://gerrit.wikimedia.org/r/271583 and https://gerrit.wikimedia.org/r/271581, both no-ops (legoktm)

17 February 2016

  • curprev 07:3607:36, 17 February 2016imported>Labslogbot 35,345 bytes +65 deploying https://gerrit.wikimedia.org/r/271201 (legoktm)
  • curprev 01:0101:01, 17 February 2016imported>Labslogbot 35,280 bytes +1,635 attempting to turn off NFS on 52 instances on deployment-prep project (yuvipanda)

15 February 2016

14 February 2016

13 February 2016

12 February 2016

  • curprev 23:5423:54, 12 February 2016imported>Labslogbot 31,361 bytes +908 beta cluster broken since 20:30 UTC https://logstash-beta.wmflabs.org/#/dashboard/elasticsearch/fatalmonitor havent looked (hashar)

11 February 2016

10 February 2016

  • curprev 23:5423:54, 10 February 2016imported>Labslogbot 27,938 bytes +3,058 depooling Trusty slaves that only have 2GB of ram that is not enough. https://phabricator.wikimedia.org/T126545 (hashar_)
  • curprev 01:0301:03, 10 February 2016imported>Labslogbot 24,880 bytes +3,895 deploying https://gerrit.wikimedia.org/r/269576 (legoktm)

9 February 2016

  • curprev 00:3900:39, 9 February 2016imported>Labslogbot 20,985 bytes +2,174 gallium edited /usr/share/python/zuul/local/lib/python2.7/site-packages/zuul/trigger/gerrit.py and modified: replication_timeout = 300 -> replication_timeout = 10 (hashar)

8 February 2016

  • curprev 00:5700:57, 8 February 2016imported>Labslogbot 18,811 bytes +87 deploying https://gerrit.wikimedia.org/r/268031 (legoktm[NE])

6 February 2016

5 February 2016

  • curprev 13:3013:30, 5 February 2016imported>Labslogbot 18,650 bytes +739 beta cleaning out /data/project/logs/archive was from pre logstash area. We no more log this way since May 2015 apparently (hashar)

4 February 2016

  • curprev 22:0822:08, 4 February 2016imported>Labslogbot 17,911 bytes +201 reloading zuul for bed7be1..f57b7e2 (jzerebecki)
  • curprev 00:5700:57, 4 February 2016imported>Labslogbot 17,710 bytes +2,091 Got deployment-bastion processing Jenkins jobs again via instructions left by my past self at https://phabricator.wikimedia.org/T72597#747925 (bd808)

2 February 2016

31 January 2016

  • curprev 13:3513:35, 31 January 2016imported>Labslogbot 13,530 bytes +453 Jenkins IRC bot started falling at Jan 30 01:04:00 2016 for whatever reason.... Should be fine now (hashar)

30 January 2016

  • curprev 12:4612:46, 30 January 2016imported>Labslogbot 13,077 bytes +110 integration-slave-jessie-1001 : fixed puppet.con server name and ran puppet (hashar)

29 January 2016

28 January 2016

26 January 2016

  • curprev 16:5116:51, 26 January 2016imported>Labslogbot 9,728 bytes +472 updated OCG to version 64050af0456a43344b32e3e93561a79207565eaf (cscott)

25 January 2016

  • curprev 18:5918:59, 25 January 2016imported>Labslogbot 9,256 bytes +525 started redis-server on deployment-redis01 by commenting out latency-monitor-threshold from the redis.conf (twentyafterfour)

24 January 2016

22 January 2016

  • curprev 23:5823:58, 22 January 2016imported>Labslogbot 8,583 bytes +1,274 removed skins from mwext-qunit workspace on trusty-1013 slave (legoktm)

21 January 2016

  • curprev 21:4121:41, 21 January 2016imported>Labslogbot 7,309 bytes +757 restored role::mail::mx on deployment-mx (hashar)
  • curprev 01:0001:00, 21 January 2016imported>Labslogbot 6,552 bytes +1,287 jenkins-deploy@deployment-bastion:/srv/mediawiki-staging/php-master/extensions$ git pull && git submodule update --init --recursive (jzerebecki)

19 January 2016

17 January 2016

16 January 2016

15 January 2016

14 January 2016

13 January 2016

  • curprev 21:0621:06, 13 January 2016imported>Labslogbot 214,628 bytes +353 beta cluster code is up to date again. Got delayed by roughly 4 hours. (hashar)

12 January 2016

  • curprev 23:3023:30, 12 January 2016imported>Labslogbot 214,275 bytes +277 deploying https://gerrit.wikimedia.org/r/263757 https://gerrit.wikimedia.org/r/263756 (legoktm)

11 January 2016

  • curprev 22:2522:25, 11 January 2016imported>Labslogbot 213,998 bytes +501 Deleting old references on Zuul-merger for mediawiki/core : <tt>/usr/share/python/zuul/bin/python /home/hashar/zuul-clear-refs.py --until 15 /srv/ssd/zuul/git/mediawiki/core </tt> (hashar)
(newest | oldest) View ( | ) (20 | 50 | 100 | 250 | 500)