You are browsing a read-only backup copy of Wikitech. The live site can be found at wikitech.wikimedia.org

Recent changes

Jump to navigation Jump to search

Track the most recent changes to the wiki on this page. See main namespace without noise.

Recent changes options Show last 50 | 100 | 250 | 500 changes in last 1 | 3 | 7 | 14 | 30 days
Hide registered users | Hide anonymous users | Show my edits | Show bots | Show minor edits
Show new changes starting from 07:22, 5 June 2023
   
List of abbreviations:
N
This edit created a new page (also see list of new pages)
m
This is a minor edit
b
This edit was performed by a bot
(±123)
The page size changed by this number of bytes

4 June 2023

     22:05  Nova Resource:Tools.lexeme-forms/SAL diffhist +170 Stashbot (wm-bot: <lucaswerkmeister> deployed 08962e4902 (update past transgressive item ID after merge; only affects czech-verb-perfective))
     18:28  Nova Resource:Tools.botwikiawk/SAL diffhist +89 Stashbot (legoktm: sudo deleted job 490152 per IRC request from GreenC)
N    09:40  Tool:Itwiki diffhist +2,795 Valerio Bozzolan (→‎Known Kubernetes jobs: Help:Toolforge/Jobs framework)
     09:17  Nova Resource:Tools.itwiki/SAL diffhist +208 Stashbot (wm-bot: <valeriobozzolan> Update homepage info in https://itwiki.toolforge.org/)
N    08:59  Nova Resource:Tools.itwiki diffhist +25 Valerio Bozzolan (Redirected page to Tool:Itwiki)

3 June 2023

     17:28  Dumps/Dumpsdata hosts diffhist +282 Hokwelum (Updated Hardware and Disk Information of dumpsdata1006 and dumpsdata1007)
     13:41  Server Admin Log diffhist +556 Stashbot (elukey@cumin1001: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 30 days, 0:00:00 on an-test-worker1001.eqiad.wmnet with reason: Host under testing/upgrade)
     10:02  Stuck global renames diffhist −1 Aklapper (Update Phabricator project per phab:T299276)

2 June 2023

     21:44  Release Engineering/SAL diffhist +314 Stashbot (mutante: based on T336427#8890714 pending a response, everything already copied to gerrit1003, and extra paths being added to Bacule... shell access to gerrit1001 will be removed next week)
     21:40  Talk:SRE/business case/Disposable Development Environment diffhist +1,260 JHathaway (→‎The scope of the Dev envs isn't very clear: Reply)
     20:46  Domains diffhist +2 EpicPupper (https://www.merriam-webster.com/dictionary/up-to-date)
     20:35  Analytics/Systems/Cluster/Iceberg diffhist +856 Xcollazo (Fix code bits.)
     20:26  Analytics/Data Lake/Traffic/referrer daily diffhist +1,076 Xcollazo (Document Iceberg version of referrer_daily. Mark it as experimental for now.)
     20:16  Server Admin Log diffhist +4,802 Stashbot (apergos: rsync in ariel screen session, bwlimit 100000, running on dumpsdata1003, pulling from dumpsdata1002, copying over 'other dumps')
     19:34  Event Platform/Instrumentation How To diffhist −170 Ottomata (→‎Instrumentation Event Stream Lifecycle Example: removed WIP message)
     19:00  SRE/SRE Team requests diffhist +22 Aklapper (uhm, keep previous link name)
     18:05  NTP diffhist +487 Sukhbir Singh (add monitoring)
     14:49  Portal:Toolforge/Admin/Build Service diffhist +14,441 David Caro
     14:40  Nova Resource:Admin/SAL diffhist +2,438 Stashbot (wm-bot2: Restarting openstack services on cloudcontrol2001-dev: ['nova-conductor', 'nova-scheduler', 'nova-api', 'nova-api-metadata', 'cinder-scheduler', 'cinder-volume', 'neutron-api', 'neutron-rpc-server', 'trove-api', 'trove-conductor', 'trove-taskmanager', 'keystone', 'keystone-admin', 'glance-api', 'magnum-api', 'magnum-conductor', 'heat-api', 'heat-api-cfn', 'heat-engine'] - cookbook ran by arturo@nostromo)
     14:03 Upload log Imported>David Caro uploaded File:TBS components diagram.png(Diagram of the components of the toolforge build service)
N    14:03  File:TBS components diagram.png diffhist +70 David Caro (Diagram of the components of the toolforge build service)
N    13:42  Portal:Toolforge/Admin/Runbooks/ToolsToolsDBReplicationLagIsTooHigh diffhist +1,873 David Caro (Created page with "=== Overview === This happens when the secondary toolsdb host is not able to catch up with the primary one. {{Remark|The procedures in this runbook require admin permissions to complete.|reminder}} === Error / Incident === This usually comes in the form of an [https://prometheus-alerts.wmcloud.org/?q=alertname%3DToolsDBReplicationLagIsTooHigh alert in alertmanager]. There you will get which instances are involved (secondary, primary). === Debugging === You can ssh...")
     13:32  Portal:Toolforge/Admin/Runbooks/HarborDown diffhist +48 David Caro
     12:51  Portal:Toolforge/Admin/Kubernetes/Certificates diffhist +34 Arturo Borrero Gonzalez (→‎Operations: refresh steps with newer path for the ssl files in the ops/puppet git tree)
     12:49  Portal:Toolforge/Admin/Runbooks/TektonDown diffhist +948 David Caro (→‎Old incidents)
N    12:46  Search Platform/Weekly Updates/2023-06-02 diffhist +2,969 Gehel (Created page with "= Summary = We spent some time this week to deal with the aftermath of our recent WDQS outages. In particular, we are now equipped to diagnose and block problematic queries faster. Our work on SLOs for Search is unlikely to be completed this quarter. We now have a good working definition of what we want to measure, but we will need help to implement metric collection and create the appropriate dashboards. This is unlikely to be done before the end of the quarter. = Wha...")
     11:25  Portal:Toolforge/Admin diffhist +66 David Caro (→‎Kubernetes)
     09:17  SRE/Infrastructure Foundations/Team diffhist −1,137 Jobo
     08:31  IPoid diffhist +117 Kosta Harlan
     07:58  Portal:Data Services/Admin/Runbooks/Enable NFS for a project diffhist +1,248 David Caro (→‎Overview)
     02:11  Fundraising/Data and flow/Recurring‎‎ 2 changes history +1,946 [Cstone‎ (2×)]
     
02:11 (cur | prev) +1,653 Cstone (→‎Monthly Convert)
     
01:09 (cur | prev) +293 Cstone

1 June 2023

     21:06  Server Admin Log‎‎ 2 changes history −870,575 [Stashbot‎; Nhatminh01‎]
     
21:06 (cur | prev) +30,280 Stashbot (samtar@deploy1002: Finished scap: Backport for Remove deleted config wgVectorStickyHeaderEdit (T337955) (duration: 08m 30s))
     
00:18 (cur | prev) −900,855 Nhatminh01 (Moved sections to Server_Admin_Log/Archive 66 using SectionMover)
     20:03  Miscweb diffhist +37 Krinkle
     20:00  Superset diffhist +191 Nskaggs (Add image demonstrating dashboard publication)
N    19:49  Analytics/Systems/Cluster/Iceberg diffhist +5,805 Xcollazo (First dump of Iceberg effort at WMF.)
     19:45 Upload log Imported>Nskaggs uploaded File:Publish Dashboard on Superset.png
N    19:45  File:Publish Dashboard on Superset.png diffhist +74 Nskaggs
     18:50  Analytics/Cluster diffhist +538 Xcollazo
     16:31  MediaWiki Event Enrichment diffhist +151 Ottomata (Added link to page/change schema)
     15:54  Kubernetes/Clusters/Add or remove nodes diffhist +167 JMeybohm (→‎Step 3: Add to calico)
     15:45  Kubernetes/Clusters/New diffhist −1,943 JMeybohm (→‎Components: New hiera layout for kubernetes clusters)
     14:41  MediaWiki and EtcdConfig diffhist +36 Krinkle (+Category:SRE Service Operations)
     14:41  Statsd diffhist +31 Krinkle (+Category:SRE Observability)
     14:40  Nutcracker diffhist +36 Krinkle
     14:40  Memcached for MediaWiki/mcrouter diffhist +36 Krinkle
     14:29  HTTP proxy diffhist +142 Eevans (A word (or two) on getting ant to respect proxy settings)
     13:51  Kubernetes/Add a new service diffhist −1,231 JMeybohm (→‎Create deployment user/tokens: is not required anymore)
     13:48  Release Engineering/SAL diffhist +372 Stashbot (James_F: doc: `sudo -u doc-uploader rm -rf /srv/doc/cover-extensions/GWToolset/` for T337062)
     13:47  Talk:PAWS diffhist +806 Vivian Rook (→‎Any objections to advertise the OpenRefine instance on Wikimedia PAWS more widely?: Reply)
     13:27  Nova Resource:Cloudinfra/SAL diffhist +239 Stashbot (dhinus: cloud-cumin-04 successfully restored from backup (T332734))
     13:15  Portal:Cloud VPS/Admin/Instance backups diffhist +17 FNegri (Run rbd commands from cloudcontrol, as in rbd they fail because of a missing keyring)
     11:42  Kubernetes/Kubectl diffhist +303 Kamila Součková (→‎Using kube_env: add info about admin user)
     11:42  Help:Using Terraform on Cloud VPS diffhist +154 Majavah (→‎Terraform provider)
     11:42  Kubernetes/Kubectl/Cheat Sheet diffhist −209 JMeybohm (→‎Get elected master component leaders)
     10:07  Nova Resource:Tools/SAL diffhist +722 Stashbot (wm-bot2: deployed kubernetes component https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-builds-api (7e57832) (T337218) - cookbook ran by dcaro@vulcanus)
     10:04  Nova Resource:Toolsbeta/SAL diffhist +1,230 Stashbot (wm-bot2: deployed kubernetes component https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-builds-api (7e57832) (T337218) - cookbook ran by dcaro@vulcanus)
N    09:43  Incidents/2023-05-30 Unintentional +2 on a config patch without deployment diffhist +3,683 Filippo Giunchedi (Created page with "{{irdoc|status=draft}} == Summary == {{Incident scorecard | task = | paged-num = 0 | responders-num = Amir | coordinators = | start = 2023-05-26 | end = 2023-05-30 | impact = A patch to mediawiki-config was accidentally +2'd and not immediately deployed }} … <!-- Reminder: No private information on this page! --><nowiki>https://gerrit.wikimedia.org/r/c/operations/mediawiki-config/+/923650</nowiki> was accidentally +2'd and not immediately deployed, leading to conf...")
     09:30  Reporting a connectivity issue diffhist +1,013 Ayounsi (→‎Additional troubleshooting)
     08:47  Event Platform/EventStreams diffhist +65 Chlod Alejandro (wikimedia-streams filtering)
     01:47  Fundraising/Data and Integrated Processes/Acoustic Integration diffhist +1,193 Ejegg
N    00:21  Server Admin Log/Archive 66 diffhist +937,106 Nhatminh01 (→‎2023-05-01: add)
     00:19  Server Admin Log/Archives diffhist +55 Nhatminh01 (→‎2020s: add)
     00:00  Deployments diffhist +1,823 Daimona Eaytoy (→‎{{Deployment_day|date=2023-06-01}}: +1)

31 May 2023

     20:28  Nova Resource:Tools.lexeme-forms/SAL diffhist +143 Stashbot (wm-bot: <lucaswerkmeister> deployed 1ec8c72304 (Russian adjectivse: remove compound lexical categories))
     20:00  Performance/Runbook/Arc Lamp service diffhist −1 Krinkle
     19:59  XHGui diffhist −23 Krinkle
     19:24  Dumps/Dumpsdata hosts diffhist +237 ArielGlenn (→‎XML Dumpsdata hosts: update primary nfs share, add more spares to the list)
     19:04  Fundraising/External-facing/E-mail preference center diffhist +814 Ejegg
     15:53  Performance/Runbook/Webperf-processor services diffhist +180 Krinkle
     14:37  Search Platform/Accountability diffhist +329 Gehel (→‎Other components)
     14:05  Nova Resource:Tools.stewardbots/SAL diffhist +112 Stashbot (wm-bot: <anticomposite> SULWatcher/manage.sh restart # All SULWatchers disconnected)
     13:38  Data Engineering/Ops week diffhist +267 Aqu (Add wikistats weekly check instructions)
     13:21  MediaWiki Event Enrichment diffhist +104 Ottomata (Added link to SLO)
     13:09  Event Platform/Schemas/Guidelines diffhist +420 Ottomata (→‎No union types / No null values)
N    12:27  User:Wmr-bot diffhist +310 Wmr-bot
     11:56  MediaWiki Event Enrichment/SLO/Mediawiki Page Content Change Enrichment diffhist +142 Ottomata (→‎Troubleshooting)
N    09:56  User talk:Nsws diffhist +667 StrikerBot (Welcome to Toolforge!)
     09:35  Nova Resource:Tools.urbanecmbot/SAL diffhist +76 Stashbot (taavi: bump quotas per T337183)
     09:31  Nova Resource:Wikiwho/SAL diffhist +138 Stashbot (wm-bot2: Increased quotas by 24 cores, 124928 ram (T336685) - cookbook ran by dcaro@vulcanus)
     09:26  Help:Toolforge/Developing successful tools diffhist +248 FNegri (→‎Sharing files via NFS: Clarify read and write access to a tool's code)
N    09:06  User talk:NgocAnMaster diffhist +675 StrikerBot (Welcome to Toolforge!)
     08:35  Doc.wikimedia.org diffhist 0 EoghanGaffney
     07:05  Ganeti diffhist +256 Slyngshede
     06:31  Nova Resource:Tools.bridgebot/SAL diffhist +92 Stashbot (wm-bot: <lucaswerkmeister> Double IRC messages to other bridges)
     02:38  Nova Resource:Tools/SAL diffhist +102 Stashbot (andrewbogott: rebooted tools-sgeweblight-10-16, T337806)
     00:28  Fundraising diffhist +61 Cstone (→‎External-facing)
N    00:27  Fundraising/External-facing/CiviProxy diffhist +1,983 Cstone (Moved from mediawiki)

30 May 2023

     23:52  Gerrit/Running in Cloud VPS diffhist +141 Dzahn (The following instructions are outdated. Gerrit does not use MySQL anymore. It keeps all the data in in the local file system in .h2 files.)
     23:38  Server Admin Log diffhist +49,924 Stashbot (zabe@deploy1002: Finished scap: Backport for Start reading from rev_comment_id in group1 wikis (T299954) (duration: 08m 00s))
     23:00  MariaDB/misc diffhist +84 Krinkle
     21:50  Incidents/2023-05-05 wdqs not updating in codfw diffhist −89 Bking
     21:17  SLO/logstash diffhist −14 Cwhite (elastic->open)
     19:09  Template:Navigation Event Platform diffhist +205 Ottomata
     18:57  Nova Resource:Tools.copypatrol/SAL diffhist +103 Stashbot (TheresNoTime: `webservice restart` for T337791, no effect)
     18:35  Portal:Data Services/Admin/Wiki Replicas diffhist +632 Samtar (→‎Step 5: setting indexes: update link to wikireplicas/index-conf.yaml)
N    18:17  Event Platform/Stream Processing/Use cases diffhist +8,485 Ottomata (Moved from https://www.mediawiki.org/wiki/Platform_Engineering_Team/Event_Platform_Value_Stream/Event_Driven_Use_Cases)
N    18:15  Event Platform/Stream Processing/Framework Evaluation diffhist +14,878 Ottomata (Copied in from https://www.mediawiki.org/wiki/Platform_Engineering_Team/Event_Platform_Value_Stream/Stream_Processing_Framework_Evaluation)
N    17:50  MediaWiki Event Enrichment/SLO/Mediawiki Page Content Change Enrichment diffhist +3,742 Ottomata (→‎Operational)
     15:05  Deployments diffhist +1,195 Kimberly Sarabia (→‎Tuesday, May 30)
     14:49  VRT System/Failover diffhist +466 AOkoth
     12:43  SLO/Lift Wing diffhist +814 Klausman (→‎Calculate the ideal targets: Re-word to reflect consensus reached in the team meeting)
     12:43  Envoy diffhist +117 Jbond (→‎Building envoy for WMF)
     12:01  Server Lifecycle diffhist −27 Cathal Mooney (→‎Move existing server between rows/racks, changing IPs)
     11:47  User:Jbond diffhist −19 Jbond (→‎Comments)
N    11:47  User:Sebastian Berlin (WMSE)/common.js diffhist +129 Sebastian Berlin (WMSE) (Created page with "mw.loader.load('//meta.wikimedia.org/w/index.php?title=User:Sebastian_Berlin_(WMSE)/global.js&action=raw&ctype=text/javascript');")
     11:30  User:TiagoLubiana/Uploading a Flask app on Toolforge diffhist +106 TiagoLubiana
     11:11  Nova Resource:Tools.network-tests/SAL diffhist +69 Stashbot (arturo: delete pod by hand, it was stuck)
     11:06  Superset diffhist +116 Vivian Rook (→‎Run a SQL query?)
     01:36  Tool:Event Metrics diffhist +9 Samwilson (→‎Production: update hostname)
     00:23  Nova Resource:Tools/SAL diffhist +153 Stashbot (andrewbogott: rebooted tools-sgeweblight-10-30, oom)

29 May 2023

     22:37  User:TiagoLubiana/Uploading a Flask app on Toolforge diffhist −902 TiagoLubiana
     22:18  Deployments diffhist +645 Gergő Tisza (→‎Tuesday, May 30)
     17:29  VRT System/Failover diffhist −74 AOkoth
     15:19  Server Admin Log diffhist +7,988 Stashbot (eoghan@cumin1001: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 14 days, 0:00:00 on vrts2001.codfw.wmnet with reason: This is being worked on)
     15:13  Nova Resource:Tools.lexeme-forms/SAL diffhist +108 Stashbot (wm-bot: <lucaswerkmeister> deployed a5e90a0e02 (update dependencies))
     13:07  Nova Resource:Tools.guc/SAL diffhist +172 Stashbot (wm-bot: <lucaswerkmeister> deployed 83837bdcab (update db hostnames from .eqiad.wmflabs to .wikimedia.cloud; also many l10n updates))
     12:55  User:Jbond diffhist +1,607 Jbond (→‎Gerrit Review Expectations)
     12:01  Tool:XTools diffhist −2 Samwilson (→‎Production: fix hostname)
     11:49  Nova Resource:Quarry/SAL diffhist +110 Stashbot (framawiki: deployed https://github.com/toolforge/quarry/pull/22 on 3 prod servers)
     09:47  ORES diffhist +1,822 Elukey
N    09:42  Clinic duty diffhist +95 Jcrespo (clinic duty link for easier search)
N    09:08  User:Chlod Alejandro/Tips for EventStreams consumers diffhist +4,907 Chlod Alejandro (→‎Zombie connections: fix typo)
     06:57  Nova Resource:Tools.masto-collab/SAL diffhist +180 Stashbot (wm-bot: <legoktm> Updated from 7fbf277 to 0631e5f)

28 May 2023

     23:15  Help:Cloud Services introduction diffhist −23 JJMC89 (Help page, not a service)
     22:21  Performance diffhist +388 Krinkle
     13:19  Server Admin Log diffhist +471 Stashbot (oblivian@deploy1002: helmfile [eqiad] DONE helmfile.d/services/thumbor: sync)
     07:10  Deployments diffhist 0 RhinosF1 (→‎Week of May 29: fix date)

27 May 2023

     23:39  Nova Resource:Tools.prosesize/SAL diffhist +100 Stashbot (wm-bot: <legoktm> Updated from 19b91bd to c684be8)
     21:50  Nova Resource:Quarry/SAL diffhist +190 Stashbot (framawiki: shutdown potentially unused servers: quarry-nfs-1, quarry-puppet-master-02, quarry-dev-03 (this last one is started when there is need to test patchs))
     21:40  Server Admin Log‎‎ 2 changes history +18,025 [Stashbot‎ (2×)]
     
21:40 (cur | prev) +225 Stashbot (Amir1: insert into templatelinks (tl_from, tl_from_namespace, tl_target_id) values (686, 0, 199); on db1154:3113 (T337446))
     
00:03 (cur | prev) +17,800 Stashbot (tzatziki: removing 1 file for legal compliance)
     19:04  Nova Resource:Tools.lexeme-forms/SAL diffhist +419 Stashbot (wm-bot: <lucaswerkmeister> deployed 07deb7a083 (Punjabi additive double causative verbs))
     02:36  Nova Resource:Tools.poty-stuff/SAL diffhist +100 Stashbot (wm-bot: <legoktm> Updated from 6e90969 to 238b4b3)
     00:08  User:EpicPupper diffhist +52 EpicPupper (+)
N    00:07  User:EpicPupper/styles.css diffhist +92 EpicPupper (test)

26 May 2023

     19:38  Nova Resource:Policy-test-creation diffhist 0 Labslogbot (Auto update of instance info.)
     17:09  PyBal diffhist −8 Meno25 (update link)
     16:03  Nova Resource:Admin/SAL diffhist +133 Stashbot (andrewbogott: "maintain-views --all-databases --replace-all" on clouddb1021 for T337446)
N    15:35  Incidents/2023-05-25 eqiad/LVS diffhist +4,862 JMeybohm (Created page with "{{irdoc|status=draft}} == Summary == {{Incident scorecard | id = eqiad/LVS | task = T337497 | paged-num = 2 | responders-num = 7 | coordinators = Janis | start = 2023-05-25 14:04 | end = 2023-05-25 14:25 | metrics = edits per second, rps in general, 5xx responses from CDN, appserver latency | impact = For approximately 15-20 minutes logged in users connecting to to Wikimedia wikis through our Ashburn datacenter and editors in general may have received 503 errors }} …...")
N    15:29  User:BryanDavis/ diffhist +77 BryanDavis (directory listing)
     15:12  Release Engineering/SAL diffhist +113 Stashbot (hashar: Reloaded Zuul for https://gerrit.wikimedia.org/r/c/integration/config/+/923647)
     14:08  Template:TOU example/styles.css diffhist 0 Ladsgroup (Wikimedia colors https://design.wikimedia.org/style-guide/visual-style_colors.html)
     14:06  Module:Documentation/styles.css diffhist +11 Ladsgroup (Wikimedia colors https://design.wikimedia.org/style-guide/visual-style_colors.html)
     14:03  Wikitech-static:Cloud Services Terms of use diffhist +18 Ladsgroup (Wikimedia colors (https://design.wikimedia.org/style-guide/visual-style_colors.html))
     13:45  Machine Learning/LiftWing/Streams diffhist +254 Elukey (→‎Staging configuration and testing)
     13:31  Wikimedia Cloud Services team/EnhancementProposals/Iteration on network isolation diffhist +29 Cathal Mooney (→‎Potential Design)
     13:31 Upload log Imported>Cathal Mooney uploaded File:Cloud VRF Cloud Realm Networking 05.2023.png
N    13:31  File:Cloud VRF Cloud Realm Networking 05.2023.png diffhist 0 Cathal Mooney
     13:13  Nova Resource:Tools/SAL diffhist +340 Stashbot (wm-bot2: deployed kubernetes component https://gitlab.wikimedia.org/repos/cloud/toolforge/buildpack-admission-controller (ef7f103) (T337218) - cookbook ran by dcaro@vulcanus)
     12:48  Nova Resource:Cloudvirt-canary/SAL diffhist +107 Stashbot (wm-bot2: performing 43 changes to canary VMs - cookbook ran by andrew@bullseye)
     12:44  Nova Resource:Toolsbeta/SAL diffhist +440 Stashbot (wm-bot2: deployed kubernetes component https://gitlab.wikimedia.org/repos/cloud/toolforge/buildpack-admission-controller (ef7f103) (T337218) - cookbook ran by dcaro@vulcanus)
     10:39  Deployments‎‎ 2 changes history −6,787 [WMDE-leszek‎; DDesouza‎]
     
10:39 (cur | prev) +130 WMDE-leszek (→‎{{Deployment_day|date=2023-05-30}})
     
00:01 (cur | prev) −6,917 DDesouza
N    10:30  Nova Resource:Tools.lydia/SAL diffhist +88 Stashbot (wm-bot: <xtex> test)
     09:52  Search Platform/Intake Standards diffhist +3 Gehel
     09:39  Search Platform/Contact diffhist +191 Gehel
     09:34  Search Platform/Accountability diffhist +11 Gehel (→‎High level)
     09:33  Search Platform/Team diffhist +126 Gehel
N    09:12  Search Platform/Weekly Updates/2023-05-23 diffhist +1,760 Gehel (Created page with "= Summary = Another WDQS incident this week disrupted our flow of work. Dealing with page redirect in the context of the Search Update Pipeline is more complex than expected, and involves multiple teams (data engineering, mediawiki core, ML). Hopefully that additional work will benefit more teams, in particular ML. = What we've accomplished = == Improve multilingual zero-results rate == * documentation and some implementation of the framework to evaluate impact https:/...")
     08:07  Portal:Toolforge/Ongoing Efforts/Toolforge Build Service/Reports diffhist +355 David Caro (→‎Decision records)
N    07:48  Wikimedia Cloud Services team/EnhancementProposals/Decision record T335979 Decision request - Toolforge envvars/secrets service diffhist +3,019 David Caro (Created page with "'''<big>Origin task</big>''': phab:T335979 '''<big>Date of the decision</big>''': 2023-05-26 '''<big>No meeting, decision made in the task</big>''' == Decision taken == Option 2 was chosen. === Rationale === We opted for a simpler cli that tackles secret and potentially non-secret data by the name of <code>envvars</code>, making sure that there's enough documentation to clear any confusion on the user side on the secrecy of the data. == Problem == Currently use...")
N    07:37  Wikimedia Cloud Services team/EnhancementProposals/Decision request - How to provide a way to install system dependencies for buildpack-based images diffhist +2,599 David Caro
     02:36  Nova Resource:Tools.masto-collab/SAL diffhist +100 Stashbot (wm-bot: <legoktm> Updated from 5c77013 to e044fa2)
N    02:26  Portal:Toolforge/Tool sweep/Lists/3 diffhist +130,197 Komla Sapaty (→‎fun)
N    02:10  Portal:Toolforge/Tool sweep/Lists/12 diffhist +129,682 Komla Sapaty (added the batch of tools for december)
N    02:10  Portal:Toolforge/Tool sweep/Lists/11 diffhist +129,944 Komla Sapaty (added the batch of tools for november)
N    02:09  Portal:Toolforge/Tool sweep/Lists/10 diffhist +130,038 Komla Sapaty (added the batch of tools for october)
N    02:09  Portal:Toolforge/Tool sweep/Lists/9 diffhist +130,214 Komla Sapaty (added the batch of tools for september)
N    02:08  Portal:Toolforge/Tool sweep/Lists/8 diffhist +130,200 Komla Sapaty (added the batch of tools for august)
N    02:06  Portal:Toolforge/Tool sweep/Lists/7 diffhist +129,832 Komla Sapaty (added the batch of tools for july)
N    02:05  Portal:Toolforge/Tool sweep/Lists/6 diffhist +129,996 Komla Sapaty (added the batch of tools for june)
N    02:04  Portal:Toolforge/Tool sweep/Lists/5 diffhist +129,926 Komla Sapaty (added the batch of tools for may)
N    02:04  Portal:Toolforge/Tool sweep/Lists/4 diffhist +130,136 Komla Sapaty (added the batch of tools for april)
N    01:58  Portal:Toolforge/Tool sweep/Lists/2 diffhist +130,586 Komla Sapaty (added february list of tools)
     01:36  Superset diffhist +33 EpicPupper (fix)
N    01:35  Apache Superset diffhist +22 EpicPupper (redirect)
     01:12  Nova Resource:Tools.streaks/SAL diffhist +100 Stashbot (wm-bot: <legoktm> Updated from 974657a to 6aac196)

25 May 2023

     22:36  Deployments/Archive/2023/05 diffhist +20,354 Thcipriani
     22:14  Server Admin Log diffhist +42,819 Stashbot (zabe@deploy1002: Finished scap: Backport for Replace deprecated Hooks::runWithoutAbort (T335536), BannerRenderer: Make sure the language variant is valid (T337427) (duration: 09m 14s))
     21:16  Nova Resource:Tools.ifttt-dev/SAL diffhist +260 Stashbot (wm-bot: <bd808> Update to f50fbfd (T336273))
N    21:09  User:Irenemartinez391 diffhist +2,202 Ameisenigel (delete)
     20:15  Nova Resource:Tools.lexeme-forms/SAL diffhist +129 Stashbot (wm-bot: <lucaswerkmeister> deployed a50e668166 (l10n updates: ca, es, fa, fi, ru, tr, ur))
     19:19  Wikidata Query Service/Runbook diffhist +216 Bking (→‎Webrequest Live Dashboard Method: Fill in links. Still need more details.)
N    18:57  User:Neil Shah-Quinn (WMF) diffhist +49 Neil Shah-Quinn (WMF) (Add soft redirect to SUL user page)
     18:51  User:Neil P. Quinn-WMF diffhist +71 Neil P. Quinn-WMF (Point to my new account.)
     17:30  Release Engineering/SAL diffhist +551 Stashbot (hashar: gerrit2002 replication eventually has completed at some point: `Replication completed with some errors!` # T334521)
     15:09  MediaWiki talk:Titleblacklist diffhist +131 BryanDavis (→‎Exemption from the block on WMF accounts?: Reply)
     15:03  MediaWiki:Titlewhitelist diffhist +28 BryanDavis (phab:T337484)
N    14:00  User talk:Keo010122 diffhist +672 StrikerBot (Welcome to Toolforge!)
N    13:23  Wikitech-static:Cloud Services End User Terms of use diffhist +8,987 Andrew Bogott
     13:22  Wikitech-static:Cloud Services Terms of use diffhist +22,459 Andrew Bogott
     13:13  User:Andrew Bogott/toudraft diffhist −35,065 Andrew Bogott (Andrew Bogott moved page User:Andrew Bogott/toudraft to Wikitech:Cloud Services Terms of use: Replacing old page with new TOU)
     13:01  Template:Navigation Event Platform diffhist 0 Ottomata
     12:01  Analytics/Data Lake/Edits/Metrics diffhist +68 Andrew McAllister (WMDE) (Made the list of metrics an ordered list and added monthly_surviving_new_editors that was missing.)
     11:13  SRE/Dc-operations/Hardware Troubleshooting Runbook diffhist +436 Jcrespo (→‎Gathering Support Logs for Warranty Replacement: +This is how Jaime does it)
     08:40  Nova Resource:Toolsbeta/SAL diffhist +93 Stashbot (dcaro: releasing toolforge-weld 1.0.0 (T337218))
     08:28  Search Platform/Goals diffhist +62 Gehel (→‎Goals for each quarter)
     08:25  Puppet diffhist +82 Samtar (→‎More information: add link to https://doc.wikimedia.org/puppet/puppet_classes/ because I always lose that)
N    08:19  People diffhist +34 Samtar (Redirected page to People.wikimedia.org)
     07:19  User:Andrew Bogott/products diffhist +21 David Caro (→‎Where we are)

24 May 2023

     23:58  MediaWiki talk:Titleblacklist diffhist +4,268 Neil P. Quinn-WMF (→‎Exemption from the block on WMF accounts?: Reply)
     22:21  Help:Toolforge/My first NodeJS OAuth tool diffhist +50 BryanDavis (Use Template:Toolforge latest image for version numbers)
     22:00  User talk:Eatcha diffhist +1,011 Mdaniels5757 (+notice)
     21:51  Data Engineering/Show your work diffhist −14 BryanDavis (→‎Wikis: interwiki links)
     21:18  Server Admin Log‎‎ 2 changes history +60,852 [Stashbot‎ (2×)]
     
21:18 (cur | prev) +16,652 Stashbot (urbanecm@deploy1002: Finished scap: Backport for [Growth] Deploy Personalized praise to pilot wikis with notifications (T334630) (duration: 09m 40s))
     
01:10 (cur | prev) +44,200 Stashbot (dzahn@cumin1001: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 0:30:00 on contint2001.wikimedia.org with reason: maintenance)
     20:15  Deployments diffhist +1,182 Samtar (→‎{{Deployment_day|date=2023-05-24}}: + another backport)
     20:08  Event Platform/Producer Requirements diffhist +174 Ottomata (→‎Supported Event Platform producer clients)
     20:07  Event Platform/Event Utilities diffhist +5,279 Ottomata
     19:57  Template:Navigation Event Platform diffhist +8 Ottomata
N    19:56  MediaWiki Event Enrichment diffhist +6,636 Ottomata (Link to Event Platform/Event Utilities)
     19:33  Wikidata Query Service/Streaming Updater diffhist −2 Bking (update logstash query to find checkpoint)
     19:12  Analytics/Cluster diffhist −333 Xcollazo (→‎Glossary: Removing Cloudera. We don't use their Hadoop distribution anymore.)
     18:26  Analytics/Sessions diffhist +722 Tsevener (→‎iOS: Updated session logic in 7.3.0 to align more closely with Android)
N    17:51  Nova Resource:Lutz/SAL diffhist +349 Stashbot (wm-bot2: added user chicocvenancio to the project as member - cookbook ran by andrew@bullseye)
N    17:47  Nova Resource:Lutz diffhist +109 Labslogbot (Auto update of instance info.)
N    17:36  User:Mbch331/common.css diffhist +90 Mbch331 (Created page with ".diff-addedline, .diff-deletedline, .diff-context { font-family: sans-serif !important; }")
N    15:34  User:Andrew Bogott/products diffhist +2,780 Andrew Bogott (→‎Where we'd like to be)
     15:25  Nova Resource:Tools.poty-stuff/SAL diffhist +100 Stashbot (wm-bot: <legoktm> Updated from de4b61d to 6e90969)
N    15:20  User talk:Sifr88 diffhist +1,339 StrikerBot (Welcome to Toolforge!)
N    15:19  User talk:Keo010122Bot diffhist +675 StrikerBot (Welcome to Toolforge!)
     15:11  Nova Resource:Codesearch/SAL diffhist +110 Stashbot (legoktm: temporarily taking down to free up disk space (T337263))
     15:07  Requestctl diffhist +253 Effie Mouzeli (→‎Removing an object)
     14:30  Kubernetes/Images diffhist +100 Kamila Součková (→‎Production images: move note about merging)
     13:27  Portal:Toolforge/Ongoing Efforts/Toolforge Build Service/Reports diffhist +86 David Caro (→‎Ongoing)
     13:17  Help:Toolforge/Build Service diffhist +331 David Caro (→‎File permission issues)
     12:35  Incidents/2023-05-23 wdqs CODFW 5xx errors diffhist −11 Bking
     12:28  Nova Resource:Tools/SAL diffhist +158 Stashbot (dcaro: deploy latest buildservice (T335865))
     12:26  Nova Resource:Toolsbeta/SAL diffhist +158 Stashbot (dcaro: deploy latest buildservice (T335865))
     10:09  Release Engineering/SAL diffhist +230 Stashbot (eoghan: Switching doc.wikimedia.org from doc1002 -> doc1003, T319477)
     09:16  Machine Learning/LiftWing diffhist +206 Elukey

23 May 2023

N    21:49  Incidents/2023-05-23 wdqs CODFW 5xx errors diffhist +4,898 Bking
     21:48  Release Engineering/SAL diffhist +247 Stashbot (brennen: https://phab.wmflabs.org/ now running phorge 2023.17)
     21:27 Upload log Imported>Bking uploaded File:Wdqs outage 2023 05 23.jpg
N    21:27  File:Wdqs outage 2023 05 23.jpg diffhist +18 Bking
N    21:17  User:Priv eng sync diffhist +41 Peachey88 (per https://phabricator.wikimedia.org/T301181#8871123)
     16:46  Homer diffhist +199 Cathal Mooney (→‎In the deployment server)
     16:39  Deployment server diffhist −4 Cathal Mooney (→‎Service)
     14:40  Nova Resource:Tools/SAL diffhist +179 Stashbot (wm-bot2: deployed kubernetes component https://github.com/toolforge/buildpack-admission-controller (0c7b25b) - cookbook ran by fran@wmf3169)
     14:40  Nova Resource:Toolsbeta/SAL diffhist +179 Stashbot (wm-bot2: deployed kubernetes component https://github.com/toolforge/buildpack-admission-controller (0c7b25b) - cookbook ran by fran@wmf3169)
N    13:52  Dologmsg diffhist +59 Samtar (Redirected page to Cloud VPS Server Admin Log#Add from Toolforge)
     08:46  SRE/Infrastructure Foundations/Ownership diffhist +222 Jbond
     08:25  Incidents/2023-05-05 prometheus down in ulsfo and eqsin diffhist −1,685 Filippo Giunchedi (Finalize incident)
     05:48  Talk:Main Page diffhist 0 Ahmad Kanik (Undo edits by User:Naif212)
     05:47  Zookeeper diffhist 0 Ahmad Kanik (Undo edits by User:Naif212)
     05:46  RPKI diffhist 0 Ahmad Kanik (Undo edits by User:Naif212)
     05:44  Network monitoring diffhist 0 Ahmad Kanik (Undo edits by User:Naif212)
     05:43  DNS diffhist 0 Ahmad Kanik (Undo edits by User:Naif212)
     05:42  MediaWiki HTTP cache headers diffhist 0 Ahmad Kanik (undo last 2 edits)
     04:46  News/Cloud VPS 2022 Purge diffhist +75 Awight (Mark project as active)

22 May 2023

     23:29  Server Admin Log diffhist +27,509 Stashbot (eileen: civicrm upgraded from cc9593d0 to 7eae24d5)
     20:15  News/Cloud VPS 2022 Purge diffhist +15 Andrew Bogott (→‎SHUTDOWN wikinewsie)
     20:13  Nova Resource:Wikinewsie/SAL diffhist +148 Stashbot (andrewbogott: deleting project as per https://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2022_Purge#SHUTDOWN_citelearn)
     20:11  Nova Resource:Wikiloop/SAL diffhist +148 Stashbot (andrewbogott: deleting project as per https://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2022_Purge#SHUTDOWN_citelearn)
     20:10  Nova Resource:Wikilearn/SAL diffhist +148 Stashbot (andrewbogott: deleting project as per https://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2022_Purge#SHUTDOWN_citelearn)
     20:07  Nova Resource:Openocr/SAL diffhist +148 Stashbot (andrewbogott: deleting project as per https://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2022_Purge#SHUTDOWN_citelearn)
     20:04  Nova Resource:Mariadb104-test/SAL diffhist +148 Stashbot (andrewbogott: deleting project as per https://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2022_Purge#SHUTDOWN_citelearn)
     20:00  Nova Resource:Ircwebchat/SAL diffhist +148 Stashbot (andrewbogott: deleting project as per https://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2022_Purge#SHUTDOWN_citelearn)
     19:57  Nova Resource:Getstarted/SAL diffhist +148 Stashbot (andrewbogott: deleting project as per https://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2022_Purge#SHUTDOWN_citelearn)
     19:54  Nova Resource:Citelearn/SAL diffhist +159 Stashbot (andrewbogott: deleting project 'citelearn' as per https://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2022_Purge#SHUTDOWN_citelearn)
     19:54  Nova Resource:Admin/SAL diffhist +159 Stashbot (andrewbogott: deleting project 'citelearn' as per https://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2022_Purge#SHUTDOWN_citelearn)
     19:42  Fundraising/Team processes/DRI/Rotation diffhist +154 Dwisehaupt (Update DRI rotation.)
     18:37  Deployments diffhist −3,459 Samtar (→‎{{Deployment_day|date=2023-05-22}}: fix {{ircnick}})
     17:35  Parsoid/Common Tasks diffhist +271 Jgiannelos (→‎Notes)
     17:15  Wikidata Query Service/Streaming Updater diffhist +344 Bking (More details for the RdfStreamingUpdaterHighConsumerUpdateLag alert)
     16:00  Help:Labs labs labs diffhist +3 EpicPupper (→‎Other usage of the term labs: Grammar)
     14:13  Deployments/Archive/2023/05 diffhist +20,000 Samtar (archive Week of May 08)
N    14:03  User:Samtar/Deployments diffhist +40,354 Samtar (Undo revision 2079232 by Samtar (talk))
     10:06  Nova Resource:Tools/SAL diffhist +102 Stashbot (arturo: hard-reboot tools-sgeexec-10-18 (monitoring reporting it as down))
     09:26  Machine Learning/LiftWing diffhist +3,108 Ilias Sarantopoulos (Add question about retraining)
     09:17  Server Lifecycle/Reimage diffhist −1,083 Muehlenhoff (→‎Virtual hosts: Remove redundant docs)
     09:16  Ganeti diffhist −2 Muehlenhoff (→‎Reinstall / Reimage a VM: Change cookbook name)
     08:19  Data Engineering/Systems/AQS diffhist −2,112 Muehlenhoff (→‎Deploy new History snapshot for Wikistats Backend: Update docs to point to sre.aqs.roll-restart-reboot T330889)