You are browsing a read-only backup copy of Wikitech. The live site can be found at wikitech.wikimedia.org

Recent changes

Jump to navigation Jump to search

Track the most recent changes to the wiki on this page. See main namespace without noise.

Recent changes options Show last 50 | 100 | 250 | 500 changes in last 1 | 3 | 7 | 14 | 30 days
Hide registered users | Hide anonymous users | Hide my edits | Hide bots | Show minor edits
Show new changes starting from 04:35, 8 June 2023
   
List of abbreviations:
N
This edit created a new page (also see list of new pages)
m
This is a minor edit
b
This edit was performed by a bot
(±123)
The page size changed by this number of bytes

8 June 2023

     01:08  Server Admin Log diffhist +111,676 Stashbot (ladsgroup@cumin1001: dbctl commit (dc=all): 'Repooling after maintenance db2175 (T336886)', diff saved to https://phabricator.wikimedia.org/P49233 and previous config saved to /var/cache/conftool/dbconfig/20230608-010853-ladsgroup.json)

7 June 2023

     21:43  Deployments diffhist +233 Dreamy Jazz (→‎{{Deployment_day|date=2023-06-08}}: no longer a need as this is being deployed)
     19:20  VRT System/Failover diffhist +774 AOkoth (→‎Prerequisites)
     17:32  Nova Resource:Tools.stewardbots/SAL diffhist +112 Stashbot (wm-bot: <anticomposite> ./stewardbots/StewardBot/manage.sh restart # RC not working)
     16:41  Release Engineering/SAL diffhist +279 Stashbot (hashar: jjb: reverting '*maven-release*' and '*java8*' Jenkins jobs to previous java8 docker images # T338343)
     15:43  Portal:Toolforge/Admin/Build Service diffhist +48 David Caro (→‎Components)
     15:32  Deployments/Yearly calendar/2023 diffhist +207 Thcipriani
     15:05  Kubernetes/Enabling TLS diffhist −595 Effie Mouzeli (→‎Add support to the chart)
     14:26  ORES diffhist +2,697 Kevin Bazira (Linked to IRC docs for ORES users who might not know how to contact the ML team via IRC.)
     13:54  Talk:Event Platform/Schemas/Guidelines diffhist +559 Jforrester (→‎Encouragement to use snake case is directly in conflict with Wikimedia-wide coding conventions: new section)
     12:47  Nova Resource:Toolsbeta/SAL diffhist +184 Stashbot (wm-bot2: deployed kubernetes component https://gerrit.wikimedia.org/r/cloud/toolforge/jobs-framework-api (0ed420b) - cookbook ran by taavi@runko)
     12:45  Nova Resource:Tools/SAL diffhist +256 Stashbot (wm-bot2: build & push docker image docker-registry.tools.wmflabs.org/toolforge-jobs-framework-api:a5eb7dc from https://gerrit.wikimedia.org/r/cloud/toolforge/jobs-framework-api (a5eb7dc) - cookbook ran by taavi@runko)
     11:09  SRE/Infrastructure naming conventions diffhist +69 Jbond (→‎Servers)
N    11:03  Nova Resource:Tools.malnadachbot/SAL diffhist +121 Stashbot (taavi: mark for deletion, only maintainer is blocked)
     10:30  Nova Resource:Paws/SAL diffhist +78 Stashbot (Rook: upgrade jupyterlab T324002)
     10:14  Wikimedia Cloud Services team/EnhancementProposals/Decision record T302863 toolforge byoc diffhist −4 Arturo Borrero Gonzalez (→‎Constraints and risks: reformat numbered list)
     10:06  Nova Resource:Admin/SAL diffhist +168 Stashbot (dcaro: upgraded ruby2.5 to latest fixed version on all buster VMs)
     07:17  Nova Resource:Tools.lexeme-forms/SAL diffhist +105 Stashbot (wm-bot: <lucaswerkmeister> deployed 2035050d28 (l10n updates: sv))
     01:16  Server Admin Log diffhist +73,106 Stashbot (ladsgroup@cumin1001: dbctl commit (dc=all): 'Repooling after maintenance db2111', diff saved to https://phabricator.wikimedia.org/P48979 and previous config saved to /var/cache/conftool/dbconfig/20230607-011602-ladsgroup.json)

6 June 2023

     21:03  Nova Resource:Tools.ifttt/SAL diffhist +74 Stashbot (wm-bot: <bd808> Updated to e55fea9)
     19:55  HTTPS/Browser Recommendations diffhist +228 BryanDavis (→‎For users of Microsoft Windows: give "it is not maintained and will contain security bugs" their own lines to stand out a bit more (because obviously folks just don't know they are running ancient, broken software ;)))
     19:29  Event Platform/Event Utilities diffhist +68 Ottomata (→‎eventutiltlies-python)
     19:14  Deployments diffhist +760 Daniel Kinzler (→‎{{Deployment_day|date=2023-06-07}}: [config] {{gerrit|927758}} Enable cache warming jobs for parsoid per default.)
     19:09  Nova Resource:Admin/SAL diffhist +7,942 Stashbot (andrewbogott: also increased RAM and secgroup-rule quota for Trove T337882)
     19:00  Fundraising/Data and Integrated Processes/Acoustic Integration diffhist +208 Cstone (→‎Running the script)
     18:50  Dumps/Dumpsdata hosts diffhist +282 Hokwelum (Updated Hardware and Disk Information of dumpsdata1004 and dumpsdata1005)
     18:42  Nova Resource:Tools.wikiloves/SAL diffhist +73 Stashbot (wm-bot: <jeanfred> Deploy 19b5d50)
N    17:15  Incidents/2023-06-06 dawiktionary/dawiki/svwiktionary partial outage diffhist +3,846 Cwhite (Created page with "{{irdoc|status=draft}} == Summary == {{Incident scorecard | id = dawiktionary/dawiki/svwiktionary partial outage | task = T338193 | paged-num = 14 | responders-num = 4 | coordinators = cwhite | start = 2023-06-06 00:30:00 | end = 2023-06-06 03:49:00 | impact = All users of dawiktionary, dawiki, and svwiktionary sometimes received fatal exceptions while browsing. }} All users of dawiktionary, dawiki, and svwiktionary sometimes received fatal exceptions while browsing....")
N    16:45  User:Galessandroni diffhist +779 Galessandroni (Hi, it's me)
     16:25  Event* diffhist −130 Ottomata (→‎EventLogging Extension: updated eventlogging  ext description)
     16:13  Event Platform/Schemas/Guidelines diffhist +62 Ottomata (→‎examples: linked to canary events doc)
N    16:08  Portal:Toolforge/Admin/Workgroup/2023-06-06 diffhist +10,373 Arturo Borrero Gonzalez (add content)
     15:51  Postgres diffhist +1 Jbond (→‎Syncing Postgres replica)
     15:10  User:Andrew Bogott/products diffhist +23 Andrew Bogott (→‎Where we'd like to be)
     14:35  Portal:Cloud VPS/Admin/Openstack roles and policy diffhist 0 BryanDavis (→‎testing: sentence case for section headings)
     14:34  Portal:Cloud VPS/Admin/Openstack cli diffhist +25 David Caro (→‎clouds.yaml)
     13:55  Machine Learning/LiftWing/Usage diffhist +124 Klausman (→‎Authentication)
     13:30  API Gateway diffhist +138 Klausman (→‎How to assign a client to rate limit tier: Add new WME tier to rate limits.)
N    13:25  Image-suggestion/Runbook diffhist +2,823 Cparle
     13:22  Image-suggestion diffhist +50 Cparle (Added runbook link)
     09:49  Incidents/2023-05-19 videoscaler/jobrunner diffhist +77 Filippo Giunchedi
     09:33  Portal:Toolforge/Admin/Workgroup diffhist +66 David Caro (→‎Next meeting agenda)
     08:22  SRE/Data Persistence/About diffhist +44 Jcrespo (update to include Cassandra)
     08:20  SRE/Data Persistence/Currently working on diffhist +26 Jcrespo (completing tags for the team)
     08:17  SRE/Data Persistence/Team diffhist +30 Jcrespo (team updates)
     08:10  SRE/Data Persistence/Ownership diffhist +16 Jcrespo (+Cassandra)
     08:08  SRE diffhist +74 Jcrespo (updating data persistence responsabilities)
     01:21  Server Admin Log diffhist +67,142 Stashbot (ladsgroup@cumin1001: dbctl commit (dc=all): 'Repooling after maintenance db1170:3317 (T336886)', diff saved to https://phabricator.wikimedia.org/P48826 and previous config saved to /var/cache/conftool/dbconfig/20230606-012058-ladsgroup.json)
     01:07  MediaWiki Event Enrichment diffhist +24 Ottomata (Linked to other docs)

5 June 2023

     23:09  Release Engineering/SAL diffhist +528 Stashbot (mutante: contint* - PHP upgraded to version 7.4)
     22:28  Fundraising/Team processes/How we use Phabricator diffhist +800 Dwisehaupt (Add a little bit about tools and processes we use for sprints with phab.)
     22:10  Cumin diffhist +162 Dzahn (→‎PuppetDB host selection: add a more simple example for "hosts with resource X and parameter Y has value Z. I had trouble with the existing one below for mysql_group and slave. It might be outdated syntax.)
N    19:54  Portal:Cloud VPS/Admin/Openstack roles and policy diffhist +7,402 Andrew Bogott
     19:38  Fundraising/Team processes/DRI/Rotation diffhist +96 Dwisehaupt (Update DRI rotation.)
N    19:32  Portal:Cloud VPS/Admin/Openstack cli diffhist +10,454 Andrew Bogott
     18:52  Michael Jackson effect diffhist +1 Novem Linguae (ce)
     18:42  Nova Resource:Integration/SAL diffhist +184 Stashbot (mutante: - access to old gerrit service IP (gerrit-old.wikimedia.org) for cloud IPs was removed with gerrit:927246 (homer deploy), T336427)
     18:36  Nova Resource:Clouddb-services/SAL diffhist +62 Stashbot (taavi: add btullis to the project)
     18:29  Deployments diffhist +1,120 Daniel Kinzler (→‎{{Deployment_day|date=2023-06-06}}: [config] {{gerrit|927236}} Enable parser cache warming jobs for parsoid on enwiki)
     18:07  Portal:Toolforge/Admin/Build Service diffhist +498 David Caro
N    17:32  Tool:Toolviews diffhist +968 BryanDavis (Stub out docs for this tool)
     17:26  Template:Tool diffhist +75 BryanDavis (Copy inline styles from Template:Infobox)
     16:40  Incidents/2023-05-30 Unintentional +2 on a config patch without deployment diffhist +116 Krinkle
N    16:23  Page Content Service diffhist +41 BryanDavis (Removed redirect to Mobileapps (service))
N    16:23  PCS diffhist +41 BryanDavis (Removed redirect to Mobileapps (service))
     16:21  Mobileapps (service) diffhist +77 BryanDavis (→‎External links: expand acronyms)
     15:59  LVS diffhist +142 Krinkle
     15:17  User talk:Keo010122 diffhist +673 StrikerBot (Welcome to Toolforge!)
N    15:15  User talk:Neriah diffhist +669 StrikerBot (Welcome to Toolforge!)
N    15:13  User talk:Kitrsjlhf diffhist +672 StrikerBot (Welcome to Toolforge!)
N    15:12  User talk:Neriah bot diffhist +673 StrikerBot (Welcome to Toolforge!)
N    15:12  User talk:Hyphen diffhist +669 StrikerBot (Welcome to Toolforge!)
     14:58  MariaDB/misc diffhist −12 LSobanski
     14:11  SRE/Infrastructure naming conventions diffhist +27 Krinkle
     13:43  Template:Navigation Wikimedia infrastructure diffhist +50 Krinkle
     10:26  IPoid diffhist +95 Kosta Harlan
     09:41  Nova Resource:Admin/SAL diffhist +142 Stashbot (arturo: [codfw1dev] rebooting bastion-codfw1dev-02 (no IP address in the main interface) T336963)
     09:39  Thumbor diffhist −46 Clément Goubert (→‎Kubernetes: Fix roll-restart link)
     09:23  Wikimedia network guidelines diffhist +107 Ayounsi (→‎See also)
     09:08  Miscweb/Kubernetes migration steps diffhist +336 Jelto (add monitoring migration steps (httpbb and prometheus))
     07:53  Nova Resource:Tools/SAL diffhist +123 Stashbot (wm-bot2: cleaned up grid queue errors on tools-sgegrid-master - cookbook ran by dcaro@vulcanus)
     07:19  Portal:Toolforge/Admin/Workgroup diffhist +197 David Caro (→‎Next meeting agenda)

4 June 2023

     22:05  Nova Resource:Tools.lexeme-forms/SAL diffhist +170 Stashbot (wm-bot: <lucaswerkmeister> deployed 08962e4902 (update past transgressive item ID after merge; only affects czech-verb-perfective))
     18:28  Nova Resource:Tools.botwikiawk/SAL diffhist +89 Stashbot (legoktm: sudo deleted job 490152 per IRC request from GreenC)
N    09:40  Tool:Itwiki diffhist +2,795 Valerio Bozzolan (→‎Known Kubernetes jobs: Help:Toolforge/Jobs framework)
     09:17  Nova Resource:Tools.itwiki/SAL diffhist +208 Stashbot (wm-bot: <valeriobozzolan> Update homepage info in https://itwiki.toolforge.org/)
N    08:59  Nova Resource:Tools.itwiki diffhist +25 Valerio Bozzolan (Redirected page to Tool:Itwiki)

3 June 2023

     17:28  Dumps/Dumpsdata hosts diffhist +282 Hokwelum (Updated Hardware and Disk Information of dumpsdata1006 and dumpsdata1007)
     13:41  Server Admin Log diffhist +556 Stashbot (elukey@cumin1001: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 30 days, 0:00:00 on an-test-worker1001.eqiad.wmnet with reason: Host under testing/upgrade)
     10:02  Stuck global renames diffhist −1 Aklapper (Update Phabricator project per phab:T299276)

2 June 2023

     21:44  Release Engineering/SAL diffhist +314 Stashbot (mutante: based on T336427#8890714 pending a response, everything already copied to gerrit1003, and extra paths being added to Bacule... shell access to gerrit1001 will be removed next week)
     21:40  Talk:SRE/business case/Disposable Development Environment diffhist +1,260 JHathaway (→‎The scope of the Dev envs isn't very clear: Reply)
     20:46  Domains diffhist +2 EpicPupper (https://www.merriam-webster.com/dictionary/up-to-date)
     20:35  Analytics/Systems/Cluster/Iceberg diffhist +856 Xcollazo (Fix code bits.)
     20:26  Analytics/Data Lake/Traffic/referrer daily diffhist +1,076 Xcollazo (Document Iceberg version of referrer_daily. Mark it as experimental for now.)
     20:16  Server Admin Log diffhist +4,802 Stashbot (apergos: rsync in ariel screen session, bwlimit 100000, running on dumpsdata1003, pulling from dumpsdata1002, copying over 'other dumps')
     19:34  Event Platform/Instrumentation How To diffhist −170 Ottomata (→‎Instrumentation Event Stream Lifecycle Example: removed WIP message)
     19:00  SRE/SRE Team requests diffhist +22 Aklapper (uhm, keep previous link name)
     18:05  NTP diffhist +487 Sukhbir Singh (add monitoring)
     14:49  Portal:Toolforge/Admin/Build Service diffhist +14,441 David Caro
     14:40  Nova Resource:Admin/SAL diffhist +2,438 Stashbot (wm-bot2: Restarting openstack services on cloudcontrol2001-dev: ['nova-conductor', 'nova-scheduler', 'nova-api', 'nova-api-metadata', 'cinder-scheduler', 'cinder-volume', 'neutron-api', 'neutron-rpc-server', 'trove-api', 'trove-conductor', 'trove-taskmanager', 'keystone', 'keystone-admin', 'glance-api', 'magnum-api', 'magnum-conductor', 'heat-api', 'heat-api-cfn', 'heat-engine'] - cookbook ran by arturo@nostromo)
     14:03 Upload log Imported>David Caro uploaded File:TBS components diagram.png(Diagram of the components of the toolforge build service)
N    14:03  File:TBS components diagram.png diffhist +70 David Caro (Diagram of the components of the toolforge build service)
N    13:42  Portal:Toolforge/Admin/Runbooks/ToolsToolsDBReplicationLagIsTooHigh diffhist +1,873 David Caro (Created page with "=== Overview === This happens when the secondary toolsdb host is not able to catch up with the primary one. {{Remark|The procedures in this runbook require admin permissions to complete.|reminder}} === Error / Incident === This usually comes in the form of an [https://prometheus-alerts.wmcloud.org/?q=alertname%3DToolsDBReplicationLagIsTooHigh alert in alertmanager]. There you will get which instances are involved (secondary, primary). === Debugging === You can ssh...")
     13:32  Portal:Toolforge/Admin/Runbooks/HarborDown diffhist +48 David Caro
     12:51  Portal:Toolforge/Admin/Kubernetes/Certificates diffhist +34 Arturo Borrero Gonzalez (→‎Operations: refresh steps with newer path for the ssl files in the ops/puppet git tree)
     12:49  Portal:Toolforge/Admin/Runbooks/TektonDown diffhist +948 David Caro (→‎Old incidents)
N    12:46  Search Platform/Weekly Updates/2023-06-02 diffhist +2,969 Gehel (Created page with "= Summary = We spent some time this week to deal with the aftermath of our recent WDQS outages. In particular, we are now equipped to diagnose and block problematic queries faster. Our work on SLOs for Search is unlikely to be completed this quarter. We now have a good working definition of what we want to measure, but we will need help to implement metric collection and create the appropriate dashboards. This is unlikely to be done before the end of the quarter. = Wha...")
     11:25  Portal:Toolforge/Admin diffhist +66 David Caro (→‎Kubernetes)
     09:17  SRE/Infrastructure Foundations/Team diffhist −1,137 Jobo
     08:31  IPoid diffhist +117 Kosta Harlan
     07:58  Portal:Data Services/Admin/Runbooks/Enable NFS for a project diffhist +1,248 David Caro (→‎Overview)
     02:11  Fundraising/Data and flow/Recurring‎‎ 2 changes history +1,946 [Cstone‎ (2×)]
     
02:11 (cur | prev) +1,653 Cstone (→‎Monthly Convert)
     
01:09 (cur | prev) +293 Cstone

1 June 2023

     21:06  Server Admin Log‎‎ 2 changes history −870,575 [Stashbot‎; Nhatminh01‎]
     
21:06 (cur | prev) +30,280 Stashbot (samtar@deploy1002: Finished scap: Backport for Remove deleted config wgVectorStickyHeaderEdit (T337955) (duration: 08m 30s))
     
00:18 (cur | prev) −900,855 Nhatminh01 (Moved sections to Server_Admin_Log/Archive 66 using SectionMover)
     20:03  Miscweb diffhist +37 Krinkle
     20:00  Superset diffhist +191 Nskaggs (Add image demonstrating dashboard publication)
N    19:49  Analytics/Systems/Cluster/Iceberg diffhist +5,805 Xcollazo (First dump of Iceberg effort at WMF.)
     19:45 Upload log Imported>Nskaggs uploaded File:Publish Dashboard on Superset.png
N    19:45  File:Publish Dashboard on Superset.png diffhist +74 Nskaggs
     18:50  Analytics/Cluster diffhist +538 Xcollazo
     16:31  MediaWiki Event Enrichment diffhist +151 Ottomata (Added link to page/change schema)
     15:54  Kubernetes/Clusters/Add or remove nodes diffhist +167 JMeybohm (→‎Step 3: Add to calico)
     15:45  Kubernetes/Clusters/New diffhist −1,943 JMeybohm (→‎Components: New hiera layout for kubernetes clusters)
     14:41  MediaWiki and EtcdConfig diffhist +36 Krinkle (+Category:SRE Service Operations)
     14:41  Statsd diffhist +31 Krinkle (+Category:SRE Observability)
     14:40  Nutcracker diffhist +36 Krinkle
     14:40  Memcached for MediaWiki/mcrouter diffhist +36 Krinkle
     14:29  HTTP proxy diffhist +142 Eevans (A word (or two) on getting ant to respect proxy settings)
     13:51  Kubernetes/Add a new service diffhist −1,231 JMeybohm (→‎Create deployment user/tokens: is not required anymore)
     13:48  Release Engineering/SAL diffhist +372 Stashbot (James_F: doc: `sudo -u doc-uploader rm -rf /srv/doc/cover-extensions/GWToolset/` for T337062)
     13:47  Talk:PAWS diffhist +806 Vivian Rook (→‎Any objections to advertise the OpenRefine instance on Wikimedia PAWS more widely?: Reply)
     13:27  Nova Resource:Cloudinfra/SAL diffhist +239 Stashbot (dhinus: cloud-cumin-04 successfully restored from backup (T332734))
     13:15  Portal:Cloud VPS/Admin/Instance backups diffhist +17 FNegri (Run rbd commands from cloudcontrol, as in rbd they fail because of a missing keyring)
     11:42  Kubernetes/Kubectl diffhist +303 Kamila Součková (→‎Using kube_env: add info about admin user)
     11:42  Help:Using Terraform on Cloud VPS diffhist +154 Majavah (→‎Terraform provider)
     11:42  Kubernetes/Kubectl/Cheat Sheet diffhist −209 JMeybohm (→‎Get elected master component leaders)
     10:07  Nova Resource:Tools/SAL diffhist +722 Stashbot (wm-bot2: deployed kubernetes component https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-builds-api (7e57832) (T337218) - cookbook ran by dcaro@vulcanus)
     10:04  Nova Resource:Toolsbeta/SAL diffhist +1,230 Stashbot (wm-bot2: deployed kubernetes component https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-builds-api (7e57832) (T337218) - cookbook ran by dcaro@vulcanus)
N    09:43  Incidents/2023-05-30 Unintentional +2 on a config patch without deployment diffhist +3,683 Filippo Giunchedi (Created page with "{{irdoc|status=draft}} == Summary == {{Incident scorecard | task = | paged-num = 0 | responders-num = Amir | coordinators = | start = 2023-05-26 | end = 2023-05-30 | impact = A patch to mediawiki-config was accidentally +2'd and not immediately deployed }} … <!-- Reminder: No private information on this page! --><nowiki>https://gerrit.wikimedia.org/r/c/operations/mediawiki-config/+/923650</nowiki> was accidentally +2'd and not immediately deployed, leading to conf...")
     09:30  Reporting a connectivity issue diffhist +1,013 Ayounsi (→‎Additional troubleshooting)
     08:47  Event Platform/EventStreams diffhist +65 Chlod Alejandro (wikimedia-streams filtering)
     01:47  Fundraising/Data and Integrated Processes/Acoustic Integration diffhist +1,193 Ejegg
N    00:21  Server Admin Log/Archive 66 diffhist +937,106 Nhatminh01 (→‎2023-05-01: add)
     00:19  Server Admin Log/Archives diffhist +55 Nhatminh01 (→‎2020s: add)
     00:00  Deployments diffhist +1,823 Daimona Eaytoy (→‎{{Deployment_day|date=2023-06-01}}: +1)

31 May 2023

     20:28  Nova Resource:Tools.lexeme-forms/SAL diffhist +143 Stashbot (wm-bot: <lucaswerkmeister> deployed 1ec8c72304 (Russian adjectivse: remove compound lexical categories))
     20:00  Performance/Runbook/Arc Lamp service diffhist −1 Krinkle
     19:59  XHGui diffhist −23 Krinkle
     19:24  Dumps/Dumpsdata hosts diffhist +237 ArielGlenn (→‎XML Dumpsdata hosts: update primary nfs share, add more spares to the list)
     19:04  Fundraising/External-facing/E-mail preference center diffhist +814 Ejegg
     15:53  Performance/Runbook/Webperf-processor services diffhist +180 Krinkle
     14:37  Search Platform/Accountability diffhist +329 Gehel (→‎Other components)
     14:05  Nova Resource:Tools.stewardbots/SAL diffhist +112 Stashbot (wm-bot: <anticomposite> SULWatcher/manage.sh restart # All SULWatchers disconnected)
     13:38  Data Engineering/Ops week diffhist +267 Aqu (Add wikistats weekly check instructions)
     13:21  MediaWiki Event Enrichment diffhist +104 Ottomata (Added link to SLO)
     13:09  Event Platform/Schemas/Guidelines diffhist +420 Ottomata (→‎No union types / No null values)
N    12:27  User:Wmr-bot diffhist +310 Wmr-bot
     11:56  MediaWiki Event Enrichment/SLO/Mediawiki Page Content Change Enrichment diffhist +142 Ottomata (→‎Troubleshooting)
N    09:56  User talk:Nsws diffhist +667 StrikerBot (Welcome to Toolforge!)
     09:35  Nova Resource:Tools.urbanecmbot/SAL diffhist +76 Stashbot (taavi: bump quotas per T337183)
     09:31  Nova Resource:Wikiwho/SAL diffhist +138 Stashbot (wm-bot2: Increased quotas by 24 cores, 124928 ram (T336685) - cookbook ran by dcaro@vulcanus)
     09:26  Help:Toolforge/Developing successful tools diffhist +248 FNegri (→‎Sharing files via NFS: Clarify read and write access to a tool's code)
N    09:06  User talk:NgocAnMaster diffhist +675 StrikerBot (Welcome to Toolforge!)
     08:35  Doc.wikimedia.org diffhist 0 EoghanGaffney
     07:05  Ganeti diffhist +256 Slyngshede
     06:31  Nova Resource:Tools.bridgebot/SAL diffhist +92 Stashbot (wm-bot: <lucaswerkmeister> Double IRC messages to other bridges)
     02:38  Nova Resource:Tools/SAL diffhist +102 Stashbot (andrewbogott: rebooted tools-sgeweblight-10-16, T337806)
     00:28  Fundraising diffhist +61 Cstone (→‎External-facing)
N    00:27  Fundraising/External-facing/CiviProxy diffhist +1,983 Cstone (Moved from mediawiki)

30 May 2023

     23:52  Gerrit/Running in Cloud VPS diffhist +141 Dzahn (The following instructions are outdated. Gerrit does not use MySQL anymore. It keeps all the data in in the local file system in .h2 files.)
     23:38  Server Admin Log diffhist +49,924 Stashbot (zabe@deploy1002: Finished scap: Backport for Start reading from rev_comment_id in group1 wikis (T299954) (duration: 08m 00s))
     23:00  MariaDB/misc diffhist +84 Krinkle
     21:50  Incidents/2023-05-05 wdqs not updating in codfw diffhist −89 Bking
     21:17  SLO/logstash diffhist −14 Cwhite (elastic->open)
     19:09  Template:Navigation Event Platform diffhist +205 Ottomata
     18:57  Nova Resource:Tools.copypatrol/SAL diffhist +103 Stashbot (TheresNoTime: `webservice restart` for T337791, no effect)
     18:35  Portal:Data Services/Admin/Wiki Replicas diffhist +632 Samtar (→‎Step 5: setting indexes: update link to wikireplicas/index-conf.yaml)
N    18:17  Event Platform/Stream Processing/Use cases diffhist +8,485 Ottomata (Moved from https://www.mediawiki.org/wiki/Platform_Engineering_Team/Event_Platform_Value_Stream/Event_Driven_Use_Cases)
N    18:15  Event Platform/Stream Processing/Framework Evaluation diffhist +14,878 Ottomata (Copied in from https://www.mediawiki.org/wiki/Platform_Engineering_Team/Event_Platform_Value_Stream/Stream_Processing_Framework_Evaluation)
N    17:50  MediaWiki Event Enrichment/SLO/Mediawiki Page Content Change Enrichment diffhist +3,742 Ottomata (→‎Operational)
     15:05  Deployments diffhist +1,195 Kimberly Sarabia (→‎Tuesday, May 30)
     14:49  VRT System/Failover diffhist +466 AOkoth
     12:43  SLO/Lift Wing diffhist +814 Klausman (→‎Calculate the ideal targets: Re-word to reflect consensus reached in the team meeting)
     12:43  Envoy diffhist +117 Jbond (→‎Building envoy for WMF)
     12:01  Server Lifecycle diffhist −27 Cathal Mooney (→‎Move existing server between rows/racks, changing IPs)
     11:47  User:Jbond diffhist −19 Jbond (→‎Comments)
N    11:47  User:Sebastian Berlin (WMSE)/common.js diffhist +129 Sebastian Berlin (WMSE) (Created page with "mw.loader.load('//meta.wikimedia.org/w/index.php?title=User:Sebastian_Berlin_(WMSE)/global.js&action=raw&ctype=text/javascript');")
     11:30  User:TiagoLubiana/Uploading a Flask app on Toolforge diffhist +106 TiagoLubiana
     11:11  Nova Resource:Tools.network-tests/SAL diffhist +69 Stashbot (arturo: delete pod by hand, it was stuck)
     11:06  Superset diffhist +116 Vivian Rook (→‎Run a SQL query?)
     01:36  Tool:Event Metrics diffhist +9 Samwilson (→‎Production: update hostname)
     00:23  Nova Resource:Tools/SAL diffhist +153 Stashbot (andrewbogott: rebooted tools-sgeweblight-10-30, oom)

29 May 2023

     22:37  User:TiagoLubiana/Uploading a Flask app on Toolforge diffhist −902 TiagoLubiana
     22:18  Deployments diffhist +645 Gergő Tisza (→‎Tuesday, May 30)
     17:29  VRT System/Failover diffhist −74 AOkoth
     15:19  Server Admin Log diffhist +7,988 Stashbot (eoghan@cumin1001: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 14 days, 0:00:00 on vrts2001.codfw.wmnet with reason: This is being worked on)
     15:13  Nova Resource:Tools.lexeme-forms/SAL diffhist +108 Stashbot (wm-bot: <lucaswerkmeister> deployed a5e90a0e02 (update dependencies))
     13:07  Nova Resource:Tools.guc/SAL diffhist +172 Stashbot (wm-bot: <lucaswerkmeister> deployed 83837bdcab (update db hostnames from .eqiad.wmflabs to .wikimedia.cloud; also many l10n updates))
     12:55  User:Jbond diffhist +1,607 Jbond (→‎Gerrit Review Expectations)
     12:01  Tool:XTools diffhist −2 Samwilson (→‎Production: fix hostname)
     11:49  Nova Resource:Quarry/SAL diffhist +110 Stashbot (framawiki: deployed https://github.com/toolforge/quarry/pull/22 on 3 prod servers)
     09:47  ORES diffhist +1,822 Elukey
N    09:42  Clinic duty diffhist +95 Jcrespo (clinic duty link for easier search)
N    09:08  User:Chlod Alejandro/Tips for EventStreams consumers diffhist +4,907 Chlod Alejandro (→‎Zombie connections: fix typo)
     06:57  Nova Resource:Tools.masto-collab/SAL diffhist +180 Stashbot (wm-bot: <legoktm> Updated from 7fbf277 to 0631e5f)

28 May 2023

     23:15  Help:Cloud Services introduction diffhist −23 JJMC89 (Help page, not a service)
     22:21  Performance diffhist +388 Krinkle
     13:19  Server Admin Log diffhist +471 Stashbot (oblivian@deploy1002: helmfile [eqiad] DONE helmfile.d/services/thumbor: sync)
     07:10  Deployments diffhist 0 RhinosF1 (→‎Week of May 29: fix date)

27 May 2023

     23:39  Nova Resource:Tools.prosesize/SAL diffhist +100 Stashbot (wm-bot: <legoktm> Updated from 19b91bd to c684be8)
     21:50  Nova Resource:Quarry/SAL diffhist +190 Stashbot (framawiki: shutdown potentially unused servers: quarry-nfs-1, quarry-puppet-master-02, quarry-dev-03 (this last one is started when there is need to test patchs))
     21:40  Server Admin Log‎‎ 2 changes history +18,025 [Stashbot‎ (2×)]
     
21:40 (cur | prev) +225 Stashbot (Amir1: insert into templatelinks (tl_from, tl_from_namespace, tl_target_id) values (686, 0, 199); on db1154:3113 (T337446))
     
00:03 (cur | prev) +17,800 Stashbot (tzatziki: removing 1 file for legal compliance)
     19:04  Nova Resource:Tools.lexeme-forms/SAL diffhist +419 Stashbot (wm-bot: <lucaswerkmeister> deployed 07deb7a083 (Punjabi additive double causative verbs))
     02:36  Nova Resource:Tools.poty-stuff/SAL diffhist +100 Stashbot (wm-bot: <legoktm> Updated from 6e90969 to 238b4b3)
     00:08  User:EpicPupper diffhist +52 EpicPupper (+)
N    00:07  User:EpicPupper/styles.css diffhist +92 EpicPupper (test)

26 May 2023

     19:38  Nova Resource:Policy-test-creation diffhist 0 Labslogbot (Auto update of instance info.)
     17:09  PyBal diffhist −8 Meno25 (update link)
     16:03  Nova Resource:Admin/SAL diffhist +133 Stashbot (andrewbogott: "maintain-views --all-databases --replace-all" on clouddb1021 for T337446)
N    15:35  Incidents/2023-05-25 eqiad/LVS diffhist +4,862 JMeybohm (Created page with "{{irdoc|status=draft}} == Summary == {{Incident scorecard | id = eqiad/LVS | task = T337497 | paged-num = 2 | responders-num = 7 | coordinators = Janis | start = 2023-05-25 14:04 | end = 2023-05-25 14:25 | metrics = edits per second, rps in general, 5xx responses from CDN, appserver latency | impact = For approximately 15-20 minutes logged in users connecting to to Wikimedia wikis through our Ashburn datacenter and editors in general may have received 503 errors }} …...")
N    15:29  User:BryanDavis/ diffhist +77 BryanDavis (directory listing)
     15:12  Release Engineering/SAL diffhist +113 Stashbot (hashar: Reloaded Zuul for https://gerrit.wikimedia.org/r/c/integration/config/+/923647)
     14:08  Template:TOU example/styles.css diffhist 0 Ladsgroup (Wikimedia colors https://design.wikimedia.org/style-guide/visual-style_colors.html)
     14:06  Module:Documentation/styles.css diffhist +11 Ladsgroup (Wikimedia colors https://design.wikimedia.org/style-guide/visual-style_colors.html)
     14:03  Wikitech-static:Cloud Services Terms of use diffhist +18 Ladsgroup (Wikimedia colors (https://design.wikimedia.org/style-guide/visual-style_colors.html))
     13:45  Machine Learning/LiftWing/Streams diffhist +254 Elukey (→‎Staging configuration and testing)
     13:31  Wikimedia Cloud Services team/EnhancementProposals/Iteration on network isolation diffhist +29 Cathal Mooney (→‎Potential Design)
     13:31 Upload log Imported>Cathal Mooney uploaded File:Cloud VRF Cloud Realm Networking 05.2023.png
N    13:31  File:Cloud VRF Cloud Realm Networking 05.2023.png diffhist 0 Cathal Mooney
     13:13  Nova Resource:Tools/SAL diffhist +340 Stashbot (wm-bot2: deployed kubernetes component https://gitlab.wikimedia.org/repos/cloud/toolforge/buildpack-admission-controller (ef7f103) (T337218) - cookbook ran by dcaro@vulcanus)
     12:48  Nova Resource:Cloudvirt-canary/SAL diffhist +107 Stashbot (wm-bot2: performing 43 changes to canary VMs - cookbook ran by andrew@bullseye)
     12:44  Nova Resource:Toolsbeta/SAL diffhist +440 Stashbot (wm-bot2: deployed kubernetes component https://gitlab.wikimedia.org/repos/cloud/toolforge/buildpack-admission-controller (ef7f103) (T337218) - cookbook ran by dcaro@vulcanus)
     10:39  Deployments diffhist +130 WMDE-leszek (→‎{{Deployment_day|date=2023-05-30}})
N    10:30  Nova Resource:Tools.lydia/SAL diffhist +88 Stashbot (wm-bot: <xtex> test)
     09:52  Search Platform/Intake Standards diffhist +3 Gehel
     09:39  Search Platform/Contact diffhist +191 Gehel
     09:34  Search Platform/Accountability diffhist +11 Gehel (→‎High level)
     09:33  Search Platform/Team diffhist +126 Gehel
N    09:12  Search Platform/Weekly Updates/2023-05-23 diffhist +1,760 Gehel (Created page with "= Summary = Another WDQS incident this week disrupted our flow of work. Dealing with page redirect in the context of the Search Update Pipeline is more complex than expected, and involves multiple teams (data engineering, mediawiki core, ML). Hopefully that additional work will benefit more teams, in particular ML. = What we've accomplished = == Improve multilingual zero-results rate == * documentation and some implementation of the framework to evaluate impact https:/...")
     08:07  Portal:Toolforge/Ongoing Efforts/Toolforge Build Service/Reports diffhist +355 David Caro (→‎Decision records)
N    07:48  Wikimedia Cloud Services team/EnhancementProposals/Decision record T335979 Decision request - Toolforge envvars/secrets service diffhist +3,019 David Caro (Created page with "'''<big>Origin task</big>''': phab:T335979 '''<big>Date of the decision</big>''': 2023-05-26 '''<big>No meeting, decision made in the task</big>''' == Decision taken == Option 2 was chosen. === Rationale === We opted for a simpler cli that tackles secret and potentially non-secret data by the name of <code>envvars</code>, making sure that there's enough documentation to clear any confusion on the user side on the secrecy of the data. == Problem == Currently use...")
N    07:37  Wikimedia Cloud Services team/EnhancementProposals/Decision request - How to provide a way to install system dependencies for buildpack-based images diffhist +2,599 David Caro
     02:36  Nova Resource:Tools.masto-collab/SAL diffhist +100 Stashbot (wm-bot: <legoktm> Updated from 5c77013 to e044fa2)