You are browsing a read-only backup copy of Wikitech. The primary site can be found at wikitech.wikimedia.org

Recent changes

Jump to navigation Jump to search

Track the most recent changes to the wiki on this page. See main namespace without noise.

Recent changes options Show last 50 | 100 | 250 | 500 changes in last 1 | 3 | 7 | 14 | 30 days
Hide registered users | Hide anonymous users | Hide my edits | Show bots | Show minor edits
Show new changes starting from 07:57, 28 October 2021
   
List of abbreviations:
N
This edit created a new page (also see list of new pages)
m
This is a minor edit
b
This edit was performed by a bot
(±123)
The page size changed by this number of bytes

28 October 2021

N    00:24  User:Dzahn/LVS diffhist +3,861 Dzahn
     00:09  Logstash diffhist +130 Krinkle →‎Beta Cluster Logstash
     00:08  OCG diffhist −100 Krinkle →‎Finding crashers / Debugging "Error: 1"
     00:08  Nova Resource:Deployment-prep/Log Files diffhist −260 Krinkle
     00:05  ORES/Deployment diffhist −4 Krinkle Update beta logs dash url per phab:T233134

27 October 2021

     23:55  Server Admin Log diffhist +10,201 Stashbot mwdebug-deploy@deploy1002: helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' .
     23:46  Tool:Bridgebot diffhist +5,776 BryanDavis Update lots of things in the docs, but most importantly describe the ZNC bouncer added for phab:T292640
     23:33  Event Platform diffhist +62 ODimitrijevic
     23:15  Deployments diffhist +812 Juan90264 →‎{{Deployment_day|date=2021-10-27}}: +1 config Gerrit [735020]
     22:32  Analytics/Systems/Superset diffhist +112 ODimitrijevic
     22:24  Nova Resource:Tools.bridgebot/SAL diffhist +536 Stashbot wm-bot: <bd808> Add #italian-wikipedia mattemost<>telegram bridge (T272359)
     22:05  Analytics/Systems/Jupyter diffhist +28 Neil P. Quinn-WMF Add Phabricator project
     21:48  Analytics/Systems/Anaconda diffhist +520 Neil P. Quinn-WMF →‎stacked conda environments: Add link to upstream's perspective on stacking
     20:49  Incident documentation/2021-10-25 s3 db recentchanges replica diffhist +26 Legoktm link to phab task
     20:45  Incident documentation/2021-10-22 eqiad return path timeouts diffhist −20 Legoktm mark as in review
     20:33  Miscweb diffhist +117 Dzahn →‎Service names
     18:32  Nova Resource:Tools.wikibugs/SAL diffhist +139 Stashbot wikibugs: Updated channels.yaml to: a353a2cdc026cfc9ca31654366d1dff6d91ea9e6 Add #wikimedia-quibble
     18:29  Anycast syslog diffhist +254 Herron add netdev kafka relay info
     17:25  User:AKhatun/Wikidata Subgraph Analysis diffhist +28,512 AKhatun Add subgraph info table
     17:06  Analytics/Systems/Matomo diffhist +297 Razzi →‎Upgrade Matomo: Add note about matomo debs not being published
     16:51  Release Engineering/SAL diffhist +580 Stashbot hashar: Tag Quibble 1.2.0 @ bdabd84 # T259456 T292772 T256402
N    14:59  User talk:Mickabarber diffhist +678 StrikerBot Welcome to Toolforge!
N    14:44  File:Top 50 subgraph distribution triples.png diffhist +135 AKhatun Subgraph size (in triples) of top 50 Wikidata subgraphs.
N    14:44  File:Top 50 subgraph distribution percents.png diffhist +136 AKhatun Subgraph size (in percentage) of top 50 Wikidata subgraphs.
N    14:34  File:Subgraph distribution percents.png diffhist +137 AKhatun Subgraph size (in percentage) of top 340 Wikidata subgraphs.
N    14:34  File:Subgraph distribution triples.png diffhist +147 AKhatun Subgraph size (in triples) of top 340 Wikidata subgraphs in log scale.
N    13:12  File:Number of groups vs number of items.png diffhist +205 AKhatun AKhatun uploaded a new version of File:Number of groups vs number of items.png
N    13:11  File:Number of groups vs number of items log.png diffhist +231 AKhatun AKhatun uploaded a new version of File:Number of groups vs number of items log.png
N    11:56  Performance/Runbook/WebPageReplay/Alert diffhist +5,277 Phedenskog Update names to include performance
N    11:53  Performance/Runbook/WebPageTest/Alert diffhist +633 Phedenskog Created page with "This is the runbook for '''WebPageTest alerts'''.{{TOCright}} ==Meta== *Issue tracker (Phabricator): WebPageTest *Documentation: WebPageTest == WebPageTestalert fired == Our WebPageTests tests measures the front end performance of Wikipedia, going to our Wikipedia servers If an alert fires it can be caused by: * A performance regression of Wikipedia * A regression in the browser that is used for the test * Instabi..."
     10:19  Graphite diffhist 0 Filippo Giunchedi →‎Merge and sync metrics
     09:29  Nova Resource:Tools.integraality/SAL diffhist +100 Stashbot wm-bot: <jeanfred> Deploy 6194d84 (T273226)
     04:20  Nova Resource:Wikisp/SAL diffhist +80 Stashbot Spookyville: limesurvey instance on Mars VM enabled

26 October 2021

     23:49  Kubernetes/Clusters diffhist +15 Legoktm tweaks suggested by Alex
N    23:22  Miscweb diffhist +376 Dzahn Created page with "This page will be about the new service miscweb on kubernetes. It will replace the legacy service miscweb running on Ganeti VMs in production. Also see: miscweb1002, miscweb2002 The first of the sites hosted on it that is moving over is bugzilla-static. ---- == Where does the code live? == == How to deploy changes == === Staging === === Production ==="
     22:59  Server Admin Log diffhist +12,871 Stashbot legoktm: uploaded python-logstash to buster-wikimedia for T294393
N    22:16  Kubernetes/Benefits diffhist +660 Legoktm bit more
     20:55  Incident documentation/2021-10-22 eqiad return path timeouts diffhist +87 Legoktm →‎Actionables: +suggestion to replay from cdanis
N    20:53  Mahfujar Rahman Noyon diffhist +759 SirazumMonira add page and description
     20:26  Release Engineering/SAL diffhist +607 Stashbot Reedy: Reloading Zuul to deploy https://gerrit.wikimedia.org/r/734728
N    20:19  Incident documentation/2021-10-25 s3 db recentchanges replica diffhist +1,556 Dzahn →‎Actionables: (we get paged for replication lag but not for host down, Marostegui said for DB hosts we should start paging on HOST down which we normally don't do. This would require a puppet change.)
     18:21  Analytics/Systems/Matomo diffhist +23 Ottomata →‎Upgrade Matomo
     18:15  User:Magnus Manske/hay directory diffhist +1,041 BryanDavis wikimedia-quarry: change feedback URL to match link in Quarry UI
     18:00  Nova Resource:Tools/SAL diffhist +238 Stashbot majavah: deleting legacy ingresses for tools.wmflabs.org urls
     16:58  Analytics/Systems/Anaconda diffhist +189 Neil P. Quinn-WMF Add link to anaconda-wmf source code
N    16:57  Nova Resource:Mwcli/SAL diffhist +162 Stashbot arturo: create project with addshore and jhuneidi as projectadmins (T294283)
N    16:38  Nova Resource:Mwcli diffhist +110 Labslogbot Auto update of instance info.
     16:00  Deployments diffhist +113 Lucas Werkmeister (WMDE) →‎{{Deployment_day|date=2021-10-26}}: remove first of our two Puppet changes this window, wasn’t Puppet and was already deployed
     15:45  Nova Resource:Toolhub/SAL diffhist +125 Stashbot bd808: Update demo server to 5212ce1 (ui: Show dismissible demo notice in debug mode)
     15:09  User:4nn1l2/gerrit diffhist +23 4nn1l2 Removed redirect to User:4nn1l2/git
     15:06  Nova Resource:Paws/SAL diffhist +75 Stashbot chicocvenancio: delete orphan pods for 2 users
     14:40  Gerrit diffhist +71 Wolfgang Kandek →‎End users documentations
     12:15  GitLab/Gitlab Runner diffhist +563 Jelto
     12:03  Portal:Toolforge/Admin/Kubernetes/Networking and ingress diffhist +906 Majavah →‎nginx-ingress: expand upgrade process
     12:01  File:Future Gitlab Runner Setup.png diffhist 0 Jelto Jelto uploaded a new version of File:Future Gitlab Runner Setup.png
N    10:55  User:Mykhal diffhist +23 Mykhal TODO
     05:35  Nova Resource:Wikisp/SAL diffhist +103 Stashbot Spookyville: moodle instance on Mars VM enabled (T289309)

25 October 2021

     23:45  Fundraising/Data and Integrated Processes/Acoustic Integration diffhist +15,389 Eileen →‎Matching Gifts: match to export
     23:30  Obsolete:Fundraising.wikimedia.org diffhist −3,418 Eileen Remove outdated docs
     23:27  Release Engineering/SAL diffhist +968 Stashbot dduvall: fully provisioned runner-{1008,1011,1012,1013,1014,1015,1016,1017,1018,1019} instances for use as new gitlab runners and removed old instances (T293835)
     23:12  Server Admin Log diffhist +11,982 Stashbot catrope@deploy1002: Synchronized wmf-config/InitialiseSettings.php: Create alias for Appendix and Appendix_talk namespaces on mywiktionary (T291146) (duration: 00m 55s)
     23:01  Fundraising diffhist −157 Eileen →‎Email integration - Acoustic
N    21:54  User talk:WikiLinuz diffhist +676 StrikerBot Welcome to Toolforge!
N    21:54  User talk:RShigapov diffhist +676 StrikerBot Welcome to Toolforge!
     21:41  Nova Resource:Tools.integraality/SAL diffhist +413 Stashbot wm-bot: <jeanfred> Deploy 7e3343a (T278156)
     19:38  Nova Resource:Tools.lexeme-forms/SAL diffhist +415 Stashbot wm-bot: <lucaswerkmeister> deployed 0f5b5de66a (bump startupProbe failureThreshold 3→10)
     19:03  Deployments diffhist +1,556 Jforrester →‎{{Deployment_day|date=2021-10-25}}: One not done.
     17:40  Incident documentation/2021-10-22 eqiad return path timeouts diffhist +263 Legoktm link to ayounsi's phab explanation
     17:07  Nova Resource:Toolhub/SAL diffhist +77 Stashbot bd808: Updated demo server to 5a4d3e2
     17:00  Nova Resource:Library-upgrader/SAL diffhist +110 Stashbot legoktm: temporarily stopped libup-celery service to test new monitoring/alerting
     16:52  Analytics/Ops week diffhist +988 Ottomata →‎Have any users left the Foundation?: added instructions for how to remove user's files.
     16:36  SLO diffhist +28 Herron →‎Published SLOs: add logstash link
     14:41  Nova Resource:Toolsbeta/SAL diffhist +141 Stashbot majavah: deploy ingress-nginx v1.0.4 to toolsbeta via helm, diff only changes the image T292771
     14:33  Nova Resource:Tools/SAL diffhist +262 Stashbot majavah: copy nginx-ingress controller v1.0.4 to internal registry T292771
N    14:26  User:MMandere diffhist +25 MMandere
     14:17  Drmrs cluster diffhist +17 MMandere Add vendor name in full
     14:14  SRE/Infrastructure naming conventions diffhist +112 MMandere →‎Servers: Add link to drmrs wikitech page
     12:09  Performance/Graphite/Synthetic Instance diffhist +1,170 Phedenskog Updated storage schemas to new setup
     08:24  Graphite diffhist +31 Filippo Giunchedi →‎Merge and sync metrics
N    07:40  Nova Resource:Cloudinfra-nfs/SAL diffhist +163 Stashbot majavah: remove "arturo" from project members and instead add "aborrero" which is the real one
     04:26  Nova Resource:Wikisp/SAL diffhist +72 Stashbot Spookyville: Mars instance launched (again)

24 October 2021

     22:39  Nova Resource:Codesearch/SAL diffhist +243 Stashbot legoktm: one more restart of everything, switched hound container over to bullseye for newer git
N    15:18  Help talk:Toolforge/Pywikibot diffhist +1,644 Xover Shared PWB with venv?
     08:52  Release Engineering/SAL diffhist +248 Stashbot hashar: CI Jenkins: update Clover PHP plugin from 0.5 to 0.6 to solve `java.lang.NoClassDefFoundError: org/apache/commons/digester/Digester` # T292910
     06:01  Deployments diffhist +139 Juan90264 →‎{{Deployment_day|date=2021-10-25}}: +1 config Gerrit [733120]
     00:47  Nova Resource:Admin/SAL diffhist +166 Stashbot andrewbogott: deploying a change so that openstack clients use tls endpoints: https://gerrit.wikimedia.org/r/c/operations/puppet/+/732738

23 October 2021

     19:22  Incident documentation/2021-09-01 partial parsoid outage diffhist +5 Quiddity fix rfc magic link
     16:40  Server Admin Log diffhist +253 Stashbot dcausse: restarting blazegraph on wdqs1004 and wdqs1006 (free allocators alert)
     16:07  Nova Resource:Codesearch/SAL diffhist +77 Stashbot majavah: hard reboot codesearch8 after OOM crash
N    15:18  Nova Resource:Tools.phabbot/SAL diffhist +269 Stashbot urbanecm: tools.phabbot@tools-sgebastion-07:~$ rm ~/*.err && rm ~/*.out
     15:08  Deployments diffhist −4,871 Urbanecm →‎Week of October 25: +new wiki time
     00:43  Template:ClusterMap diffhist +34 Krinkle
N    00:33  Incident documentation/2021-10-22 eqiad return path timeouts diffhist +6,626 Legoktm →‎Actionables: add phab links, clarify klaxon item
     00:31  Template:BastionMap diffhist −72 Krinkle remove unused parameter
     00:28  Drmrs cluster diffhist +36 Krinkle
     00:14  Eqiad cluster diffhist 0 Krinkle →‎Media gallery
     00:14  Codfw cluster diffhist +74 Krinkle →‎Media gallery

22 October 2021

     23:17  Server Admin Log diffhist +3,761 Stashbot mwdebug-deploy@deploy1002: helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' .
N    23:10  Data Engineering diffhist +5,408 ODimitrijevic
     22:49  Nova Resource:Tools.video2commons/SAL diffhist +106 Stashbot chicocvenancio: restart to run fix from PR#141 fixes T294150
     22:36  Nova Resource:Wikistats/SAL diffhist +173 Stashbot mutante: - deleted simplelamp temp test instance
     22:20  Reporting a connectivity issue diffhist +10 Lucas Werkmeister →‎Wikimedia's websites: suggestion: add --show-ips to mtr (available since mtr v0.83, commit 8bddb5b8c3, released February 2013), since it’s useful information; feel free to revert if you disagree
     21:19  Release Engineering/SAL‎‎ 2 changes history +638 [Stashbot‎ (2×)]
     
21:19 (cur | prev) +255 Stashbot James_F: Docker: Publishing quibble-buster-php73-coverage:1.1.1-s3 with quibble 1.1.1 and composer 2.1.8 for a change T292910
     
00:31 (cur | prev) +383 Stashbot James_F: Zuul: [DiscussionTools] Add EventLogging as dependency for Phan jobs
N    20:51  File:WMF Analytics Data Platform 2021 v1.png diffhist +55 ODimitrijevic ODimitrijevic uploaded a new version of File:WMF Analytics Data Platform 2021 v1.png
     20:24  Analytics Engineering diffhist −5,180 ODimitrijevic ODimitrijevic moved page Analytics Engineering to Data Engineering
     20:24  Talk:Analytics Engineering diffhist −134 ODimitrijevic ODimitrijevic moved page Talk:Analytics Engineering to Talk:Data Engineering
     19:32  Deployments diffhist +468 Urbanecm →‎{{Deployment_day|date=2021-10-28}}: +foundation.wikimedia.org SUL migration
N    19:31  SLO/logstash diffhist +3,252 Herron →‎Service Level Objectives
     19:01  Kubernetes/Clusters diffhist +6,476 Legoktm →‎wikikube (aka eqiad/codfw): describe categories that are *in* scope
     18:10  Analytics/Data access diffhist +164 Dzahn Additionally the user needs to be added to the "wmf" LDAP group. Make sure to add them (if you are an SRE) or mention it on the ticket (if you are the requestor).
     16:38  Nova Resource:Paws/SAL diffhist +86 Stashbot majavah: deploy https://github.com/toolforge/paws/pull/91
     15:35  Nova Resource:Tools/SAL diffhist +240 Stashbot majavah: remove "^tools-k8s-master-[0-9]+\.tools\.eqiad\.wmflabs$" from authorized_regexes for the main certificate
N    14:38  User:Milimetric/Data pipeline options for tracking reuse diffhist +2,181 Milimetric Created page with "Wikimedia content is spreading to more and more interfaces. From interfaces we control on our sites and apps, to Digital assistant answers, to internal research at other organizations and governments. This essay will try and give some quick representative examples and lay out options for how we might capture metadata about this in a way that works for us and our partners in open knowledge. It's basically analytics for Knowledge as a Service. == Examples by Type == *..."
     14:21  User:Samtar diffhist −5 Samtar
     13:07  Monitoring/VarnishTrafficDrop diffhist −2,313 Ema Ema moved page Monitoring/VarnishTrafficDrop to Monitoring/EdgeTrafficDrop: varnish is an implementation detail
N    11:53  Talk:Wikimedia Cloud Services team/EnhancementProposals/cloudswift diffhist +809 Giuseppe Lavagetto ask clarification about public-facing use-cases.
     11:20  Nova Resource:Gitlab-runners/SAL diffhist +119 Stashbot arturo: enable flavor g3.cores8.ram24.disk20.ephemeral40.4xiops (T293832)

21 October 2021

     23:43  Thumbor diffhist +30 Greg Grossmeier →‎Updating the custom Thumbor plugins: s/diffusion/gerrit/
     23:40  Server Admin Log‎‎ 2 changes history +32,126 [Stashbot‎ (2×)]
     
23:40 (cur | prev) +17,384 Stashbot mwdebug-deploy@deploy1002: helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' .
     
00:06 (cur | prev) +14,742 Stashbot mwdebug-deploy@deploy1002: helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' .
     23:38  Deployments‎‎ 2 changes history +13,039 [Thcipriani‎; Jforrester‎]
     
23:38 (cur | prev) +635 Jforrester →‎{{Deployment_day|date=2021-10-21}}: Last one done.
     
00:39 (cur | prev) +12,404 Thcipriani
     23:07  Nova Resource:Toolhub/SAL diffhist +76 Stashbot bd808: Update demo server to 8c9d57c
     21:20  User:Samtar diffhist +3,932 Samtar
     20:55  User:Hay/directory diffhist +319 BryanDavis Add note about Toolhub registration being separate
     20:41  Incident documentation/2021-09-13 cirrussearch restart diffhist +203 Krinkle
N    20:31  Incident documentation/2021-09-12 Esams upload diffhist +6,633 Krinkle
     20:24  Incident documentation/2021-09-12-Esams-upload diffhist −6,331 Krinkle Krinkle moved page Incident documentation/2021-09-12-Esams-upload to Incident documentation/2021-09-12 Esams upload
     20:21  Incident documentation/2021-09-01 partial parsoid outage diffhist −25 Krinkle
     17:08  Analytics/Systems/Anaconda diffhist +450 Milimetric →‎Installing packages into your user conda environment
     16:57  Portal:Cloud VPS/Admin/notes/Service predictions for cross realm situation diffhist +94 Arturo Borrero Gonzalez more NFS services
     16:29  Cross-Realm traffic guidelines diffhist +8 Arturo Borrero Gonzalez →‎requirements: typos
     15:27  Wikimedia Cloud Services team/EnhancementProposals/cloudswift diffhist −11 Arturo Borrero Gonzalez no longer a draft
     13:55  Event Platform/EventGate/Administration diffhist +12 Ottomata →‎Recreate all k8s pods (AKA full service restart)
     13:18  WMDE/Wikidata/Dispatching diffhist −7,243 Michael Große →‎How it actually works?
     12:58  Nova Resource:Paws/SAL diffhist +202 Stashbot mdipietro: upgraded to 923250f7cd0b522259abdad450fbd2dfb16357bf which was really not an upgrade as the diff gave nothing. Though now it is clear what is deployed.
N    11:35  Nova Resource:Data-engineering/SAL diffhist +197 Stashbot arturo: create project with btullis & elukey as projectadmins, quota 6 instances 12 cores and 18G ram (T292563)
N    11:29  Nova Resource:Data-engineering diffhist +121 Labslogbot Auto update of instance info.
     10:19  Nova Resource:Admin/SAL diffhist +227 Stashbot arturo: drop firewall exception on core routers for wiki replicas legacy setup (T293897)
     09:48  Nova Resource:Tools/SAL diffhist +73 Stashbot majavah: deploying toolforge-webservice 0.79
     09:23  Nova Resource:Gitlab-runners/SAL diffhist +136 Stashbot arturo: bump quotas to instances 12 cores 82 ram 249856 gigabytes 600 volumes 10 (T293832)
     08:42  File:Wikimedia network overview.png diffhist 0 Ayounsi Ayounsi uploaded a new version of File:Wikimedia network overview.png
N    05:06  Fundraising/Internal Endpoints/CiviCRM extensions diffhist +6,112 Eileen Created page with "CiviCRM extensions (checked in to [https://phabricator.wikimedia.org/diffusion/WFCG/browse/master/drupal/sites/default/civicrm/extensions/ drupal/sites/default/civicrm/extensions/] in the CRM repo): * [https://phabricator.wikimedia.org/diffusion/WFCG/browse/master/drupal/sites/default/civicrm/extensions/civi-data-translate/README.mdcivi-data-translate civi-data-translate] Allows more extensive localization of CiviCRM messages than is possible in Civi core - this is being..."
     05:03  Fundraising diffhist −6,230 Eileen →‎Drupal
     03:19  Fundraising/tech/crm/Running tests diffhist −218 Eileen
     03:17  Fundraising/tech/Installing Drupal and CiviCRM diffhist −2,339 Eileen
N    03:12  Fundraising/Internal Endpoints/Drupal modules diffhist +6,661 Eileen Put data from here & from https://www.mediawiki.org/w/index.php?title=Fundraising_tech/Components&action=edit&section=1 into a table
N    01:50  Fundraising/Data and Integrated Processes/Acoustic Integration diffhist +386 Eileen Created page with "We export data to acoustic once a day from our CiviCRM database. We also import data back in on a more regular schedule. (You may hear Acoustic referred to one of it's many previous brandings - such as Silverpop, WCA, Watson Campaign Automation, IBM ). Our supplier in our relationship is Trilogy and our contact there is Brian Sisolak. Brian is a Phab user and can be added to tasks)."

20 October 2021

     22:14  Nova Resource:Tools.magnustools/SAL diffhist +101 Stashbot wm-bot: <root> Removed 2 empty records from public_html/js_toolinfo.json
     21:55  Nova Resource:Tools.gerrit-patch-uploader/SAL diffhist +173 Stashbot wm-bot: <legoktm> updated toolinfo.json with https://github.com/valhallasw/gerrit-patch-uploader/commit/0aa5bbe17271bc79c77e6b0b453a9573a41adf80
     21:48  Nova Resource:Tools.dicompte/SAL diffhist +121 Stashbot wm-bot: <root> Fixed syntax errors in toolinfo.json so that Toolhub will index this project.
     21:06  Nova Resource:Admin/SAL diffhist +99 Stashbot andrewbogott: creating cloudinfra-nfs project T293936
N    21:06  Nova Resource:Cloudinfra-nfs diffhist +119 Labslogbot Auto update of instance info.
     21:03  Nova Resource:Tools.sal/SAL diffhist +101 Stashbot wm-bot: <bd808> Updated to 7c753d1 (T289739)
     20:17  Nova Resource:Tools.stashbot/SAL diffhist +83 Stashbot wm-bot: <bd808> Updated stashbot to e54e6da
N    19:23  Incident documentation/2021-09-26 appserver latency diffhist +947 Krinkle Created page with "{{irdoc|status=review}} ==Summary== Increased db load for enwiki (s1) resulted in slower responses, which in turn resulted in overall php-fpm worker limits being reached and thus affecting requests for all wikis. For requests above the limit, the error was "''upstream connect error or disconnect/reset before headers. reset reason: overflow''". '''Impact''': For about 15 minutes, backend appservers were slower or unable to respond for all wikis. This mainly affected logg..."
     19:14  Incident documentation/20190716-docker-registry diffhist −4,955 Krinkle Krinkle moved page Incident documentation/20190716-docker-registry to Incident documentation/2019-07-16 docker registry
     19:14  Incident documentation/20190723-logstash diffhist −3,210 Krinkle Krinkle moved page Incident documentation/20190723-logstash to Incident documentation/2019-07-23 logstash
     19:14  Template:Irdoc diffhist +4 Krinkle
N    19:13  Incident documentation/2021-09-18 appserver latency diffhist +617 Krinkle
     19:04  Incident documentation/2021-09-06 Wikifeeds diffhist +114 Krinkle
     18:41  Incident documentation/2021-09-13 cirrussearch restart diffhist −73 Krinkle
     18:39  Wikifeeds diffhist +22 Krinkle →‎Service level indicators/objectives (SLIs/SLOs)[1]
N    18:31  Incident documentation/2021-09-04 appserver latency diffhist +1,333 Krinkle
N    18:17  File:4-Sep-2021-latency-quantile.png diffhist +58 Krinkle
N    18:16  File:4-Sep-2021-latency.png diffhist +48 Krinkle
N    18:09  File:4-Sep-2021-http-status.png diffhist +52 Krinkle
     16:07  User:Elukey/MachineLearning/Deploy diffhist +4,340 Elukey →‎How to add a new helmfile config
     15:41  Nova Resource:Tools/SAL diffhist +276 Stashbot majavah: removing toollabs-webservice from grid exec and master nodes where it's not needed and not managed by puppet
     15:36  Nova Resource:Tools.quarry/SAL diffhist +97 Stashbot mdipietro: please don't use this logging queue, use "quarry" instead
     15:36  Nova Resource:Tools.paws/SAL diffhist +95 Stashbot mdipietro: please don't use this logging queue, use "paws" instead
     15:14  User:Nhatminh01 diffhist −1 Nhatminh01 Changed redirect target from m:User:Nhatminh01 to m:User:Thingofme
     13:45  Wikimedia Cloud Services team/EnhancementProposals/ceph client refactor diffhist +3,657 David Caro →‎abstraction
     12:15  Nova Resource:Toolsbeta/SAL diffhist +119 Stashbot majavah: upload toolforge-webservice 0.78 to stretch,buster,bullsye-toolsbeta repositories
     11:45  SRE/Clinic Duty diffhist +22 Faidon Liambotis →‎Schedule: Change clinic duty for 2021-11-01
     01:31  Server Admin Log diffhist +27,590 Stashbot mwdebug-deploy@deploy1002: helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' .

19 October 2021

     23:54  Deployments diffhist −10,731 Tks4Fish →‎{{Deployment_day|date=2021-10-19}}: +1
     22:24  Release Engineering/SAL diffhist +542 Stashbot brennen: gitlab-test: deleted unused gitlab-runner-test
     20:56  Nova Resource:Tools.notwikilambda/SAL diffhist +480 Stashbot wm-bot: <lucaswerkmeister> previous log messages all related to T293828
     20:19  Analytics/Data Lake diffhist +168 Neil P. Quinn-WMF Add info on floating-point number types in Spark and Presto
     18:02  Memcached for MediaWiki diffhist +7 Effie Mouzeli →‎Service
     17:39  Nova Resource:Tools.bridgebot/SAL diffhist +111 Stashbot wm-bot: <bd808> Enabled keepnick module for ZNC and flushed configuration to disk.
     16:18  Heterogeneous deployment diffhist +24 Jforrester →‎Change on deployment.eqiad.wmnet then commit: This shouldn't be done frequently, as it bypasses CI.
     15:54  Nova Resource:Toolhub/SAL diffhist +76 Stashbot bd808: Update demo server to 617dea7
     15:43  Event Platform/Instrumentation How To diffhist +3,384 Ottomata →‎Overriding event stream config settings
     15:36  User:Elukey/MachineLearning/Deploy diffhist +14,991 Elukey →‎Test your model after deployment
N    15:35  User:Razzi/superset 1.3.1 errors diffhist +1,943 Razzi Created page with "<pre> Creating a new presto database view, pasting in presto://an-coord1001.eqiad.wmnet:8281/analytics_hive?protocol=https Testing connection yields ERROR: (builtins.NoneType) None (Background on this error at: http://sqlalche.me/e/13/dbapi) This makes sense because we haven't configured security. Here's the config from production: { "metadata_params": {}, "engine_params": { "connect_args": { "KerberosConfigPath": "/etc/krb5.conf", "KerberosKeyt..."
     13:52  Event Platform/Stream Configuration diffhist +35 Ottomata →‎stream
     13:51  Event Platform/EventStreams/Administration diffhist −436 Ottomata →‎Configuration
     13:48  Event Platform/EventGate/Administration diffhist +116 Ottomata →‎EventStreamConfig change
     12:43  Graphite diffhist +762 Filippo Giunchedi →‎Operations manual
N    11:55  User:Khr2003 diffhist +621 Khr2003 Created page with "{{User info | full name = Abdul Al-Hasany | about me = Full Stack PHP programmer. I enjoy working with open source and explore new projects. | about my work = * Major contributions to: ** [https://videocuttool.wmflabs.org/ VideoCutTools] * WordPress plugins: ** [https://wordpress.org/plugins/editor-block-outline/ Editor Block Outline] ** [https://wordpress.org/plugins/nashaat-activity-log/ Nashaat Activity Log] | contact me = * Twitter: [https://twitter.com/KalimahApps]..."
     10:37  Wikimedia Cloud Services team/EnhancementProposals/ceph client refactor diffhist +534 David Caro
N    09:13  User talk:GiFontenelle diffhist +679 StrikerBot Welcome to Toolforge!
     08:06  Nova Resource:Puppet-diffs/Documentation diffhist +825 Hashar add commands for integration and deployment-prep syncing
     00:38  Server Admin Log diffhist +11,211 Stashbot ryankemper@cumin1001: START - Cookbook sre.wdqs.data-transfer

18 October 2021

     22:59  Analytics/Systems/Superset diffhist +32 Razzi →‎Upgrading: Add back necessary `export PYTHONPATH=/etc/superset `
     21:43  SRE/Clinic Duty/Access requests diffhist +523 Dzahn (click "members"->"add members",
     21:41  SRE/LDAP diffhist +262 Dzahn (click 'members'->'add members')
     20:46  Nova Resource:Tools.morfeusz/SAL diffhist +86 Stashbot wm-bot: <peterbowman> Implement concraft-pl disambiguator
     19:46  Event Platform/Stream Configuration diffhist +80 Ottomata →‎Common Settings Documentation
     19:46  Event Platform/Instrumentation How To diffhist +132 Ottomata →‎Stream Configuration
     19:41  Deployments diffhist +809 Bartosz Dziewoński →‎Tuesday, October 19: +
     19:21  Nova Resource:Admin/SAL diffhist +252 Stashbot andrewbogott: also ticked the 'admin' box on wikitech for majavah T292827
N    18:42  User talk:Lawandlasun diffhist +678 StrikerBot Welcome to Toolforge!
N    17:40  User:AKhatun/Wikidata Subgraph Analysis diffhist +460 AKhatun Form article structure
N    17:10  Wikimedia Cloud Services team/EnhancementProposals/ceph client refactor diffhist +2,664 Arturo Borrero Gonzalez →‎Problem statement: typos
     16:48  Help:Cloud Services Introduction diffhist −1 Aklapper remove "from Wikimedia Hackathon" details that I don't care about; add year to know how recent those external docs are
     16:26  Release Engineering/SAL diffhist +407 Stashbot Lucas_WMDE: killed one beta-scap-sync-world job that seemed stuck for a long time
     14:35  PAWS/PAWS and Pywikibot diffhist −154 Aklapper Use internal link
     14:13  Graphite diffhist +397 Filippo Giunchedi →‎Deleting metrics
     12:37  Nova Resource:Tools.lexeme-forms/SAL diffhist +101 Stashbot wm-bot: <lucaswerkmeister> deployed eae6c8d594 (l10n updates)

17 October 2021

N    22:14  User talk:Kaniivel diffhist +675 StrikerBot Welcome to Toolforge!
N    22:13  User talk:Debugger Byte diffhist +680 StrikerBot Welcome to Toolforge!
N    22:12  User talk:WQuarshie diffhist +676 StrikerBot Welcome to Toolforge!
     16:40  Main Page diffhist +6 Majavah fix
     12:51  Nova Resource:Tools.pbbot/SAL diffhist +116 Stashbot wm-bot: <peterbowman> Display redlinks in SandboxRedirects servlet (e542bc5)
     00:48  Deployments diffhist +103 Juan90264 →‎{{Deployment_day|date=2021-10-18}}: +1 config Gerrit [731231]
N    00:15  User talk:Mgblabs diffhist +96 Mgblabs User-Talk-Page ~~~~ {} *
N    00:14  User:Mgblabs diffhist +95 Mgblabs MyUserPage ~~~~ {} *

16 October 2021

     16:47  Release Engineering/SAL diffhist +346 Stashbot Lucas_WMDE: root@deployment-cache-upload06:~# touch /srv/trafficserver/tls/etc/ssl_multicert.config && systemctl reload trafficserver-tls.service # T293070, based on T271808#6739578
     16:14  Main Page diffhist −43 Majavah we use "Cloud VPS" everywhere else, no need to put the full "Virtual Private Server" in here
     14:53  Nova Resource:Tools.lexeme-forms/SAL diffhist +600 Stashbot wm-bot: <lucaswerkmeister> deployed 1903c3d0eb (don’t show duplicate warning errors)
     11:52  Help:Labs labs labs diffhist +152 Majavah →‎Toolforge: expand a bit
     08:59  MariaDB/troubleshooting diffhist +310 Jcrespo →‎Overload due to long running queries
     08:56  MariaDB diffhist +25 Jcrespo →‎Long running queries
     07:47  Nova Resource:Toolsbeta/SAL diffhist +118 Stashbot majavah: deployed cert-manager and wave as a test for automating T292238
     05:39  Memcached for MediaWiki diffhist −280 Effie Mouzeli →‎Service
     05:27  Memcached for MediaWiki/mcrouter diffhist +79 Effie Mouzeli
     03:56  Server Admin Log diffhist +266 Stashbot ryankemper@cumin1001: END (PASS) - Cookbook sre.wdqs.data-transfer (exit_code=0)

15 October 2021

     23:48  Server Admin Log‎‎ 2 changes history +24,161 [Stashbot‎ (2×)]
     
23:48 (cur | prev) +5,052 Stashbot ryankemper@cumin1001: START - Cookbook sre.wdqs.data-transfer
     
00:09 (cur | prev) +19,109 Stashbot ryankemper@cumin1001: END (PASS) - Cookbook sre.wdqs.data-transfer (exit_code=0)
     22:44  User:Magnus Manske/hay directory diffhist −674 BryanDavis BryanDavis changed the content model of the page User:Magnus Manske/hay directory from "JSON" to "wikitext": Using JSON content type restricts editing to interface admins?
     22:18  User talk:Bstorm diffhist +310 BryanDavis →‎I'm goating to miss you on the team: new WikiLove message
     21:29  Logstash/Common Logging Schema diffhist +5 BryanDavis →‎Required Fields: BOLD the version number match requirement, prettier link
     21:00  User:Bstorm diffhist −659 Bstorm Removing a few things...Will remove the meta links when they stop existing
     20:14  Db-kill diffhist +115 Legoktm fix display title
     20:13  MariaDB diffhist −549 Legoktm →‎Long running queries: actually just link to db-kill, which already exists!
     20:11  Query killer diffhist +2,430 Legoktm may not work properly under high load, link to db-kill for emergency manual intervention
     17:51  User:SDineshKumar/Learning&Dev diffhist +437 SDineshKumar added a priority task.
     17:50  Deployments/Train/Ideas diffhist +204 20after4 link mw:Wikimedia_Release_Engineering_Team/Project/Train2.0
     16:14  Release Engineering/SAL diffhist +149 Stashbot brennen: gitlab.wikimedia.org: apply max artifact size of 350M and artifact expiry of 2 weeks for T292372
     15:01  Nova Resource:Tools/SAL diffhist +129 Stashbot arturo: add updated ingress-nginx docker image in the registry (v1.0.1) for T293472
     14:33  Portal:Toolforge/Admin diffhist +30 BryanDavis →‎Deleting a tool (obsolete by-hand method): remove section title
     14:33  Portal:Toolforge/Admin/New grid engine exec host diffhist +34 David Caro →‎Debian Stretch/Son of Grid Engine grid
     10:44  Puppet/Pontoon diffhist −12 Filippo Giunchedi →‎Server bootstrap
     10:24  LibreNMS diffhist +360 Filippo Giunchedi →‎Upgrade LibreNMS
     09:43  WMDE/Wikidata/Alerts diffhist +399 Michael Große →‎Number of Rows in wb_changes table
     08:14  Deployments diffhist +183 Juan90264 →‎{{Deployment_day|date=2021-10-18}}: +1 config Gerrit [730744]

14 October 2021

N    23:32  Deployments/Train/Ideas diffhist +1,805 20after4 some train process ideas
     23:31  Deployments diffhist +1,330 Juan90264 →‎{{Deployment_day|date=2021-10-14}}: +2 config Gerrit [730736] and [730737]
     18:25  Analytics/Data access diffhist +431 Ottomata →‎Team specific (they do not grant access to PII data on Hadoop, for that see analytics-privatedata-users)
N    17:45  User:Elukey/MachineLearning/Deploy diffhist +3,047 Elukey →‎Helm at the WMF
     17:29  Changeprop diffhist −1,717 Hnowlan →‎To Kubernetes: No need for duplicate/outdated k8s docs!
     17:24  Portal:Toolforge/Admin/Kubernetes diffhist +308 Majavah →‎Custom admission controllers
     16:13  Release Engineering/SAL diffhist +215 Stashbot addshore: reloaded zuul for zuul: mw-ext-MailGun will need PHP 7.3+ T236396
     15:07  GitLab/Gitlab Runner diffhist +1,681 Jelto
     15:02  Nova Resource:Toolsbeta/SAL diffhist +470 Stashbot wm-bot: Joining grid node toolsbeta-sgewebgen-09-1.toolsbeta.eqiad1.wikimedia.cloud to the toolsbeta cluster - cookbook ran by dcaro@vulcanus
     14:28  Orchestrator diffhist +2,019 Kormat →‎Upgrading orchestrator: trimm trailing garbage
     14:24  SRE/Data Persistence/Backups/Runbooks diffhist +332 LSobanski
     13:24  User:Jbond/debuging diffhist +77 Jbond
     12:31  Puppet/Pontoon diffhist +99 Filippo Giunchedi →‎Quickstart (five minutes)
     12:28  Nova Resource:Admin/SAL diffhist +149 Stashbot arturo: [codfw1dev] add DB grants for cloudbackup2002.codfw.wmnet IP address to the cinder DB (T292546)
     11:36  Backport windows/Deployers diffhist +14 Lucas Werkmeister (WMDE) →‎General advice: update window names (UTC morning/evening/late)
     06:41  SRE/LDAP/Groups diffhist +93 Aklapper Link to puppet code
     01:41  Server Admin Log diffhist +17,092 Stashbot ejegg: updated payments-wiki from b329d2dea2 to 19d18c1852
     00:02  CAS-SSO/Administration diffhist 0 Krinkle →‎Rebooting

13 October 2021

     23:31  Nova Resource:Tools.lexeme-forms/SAL diffhist +261 Stashbot wm-bot: <lucaswerkmeister> fully restarted webservice (stop/start) to avoid label issues
     23:29  Nova Resource:Tools.pagepile-visual-filter/SAL diffhist +223 Stashbot wm-bot: <lucaswerkmeister> deployed 66e06c58c5 (remove type ignore comments), updated dependencies including Flask 2.0.2, fully restarted webservice (stop/start) to avoid label issues
     23:28  Nova Resource:Tools.ranker/SAL diffhist +223 Stashbot wm-bot: <lucaswerkmeister> deployed 3fd9ab9f20 (remove type ignore comments), updated dependencies including Flask 2.0.2, fully restarted webservice (stop/start) to avoid label issues
     23:23  Nova Resource:Toolhub/SAL diffhist +134 Stashbot bd808: Updated Demo server to 563f977
     23:12  Release Engineering/SAL diffhist +359 Stashbot bd808: Killed a couple of deployment-prep update jobs in Jerkins that were hung on "waiting for executor" with 4 open executors.
     23:09  Deployments‎‎ 2 changes history +1,384 [Juan90264‎; Dylsss‎]
     
23:09 (cur | prev) +936 Juan90264 →‎{{Deployment_day|date=2021-10-13}}: +1 config Gerrit [730575]
     
00:25 (cur | prev) +448 Dylsss →‎{{Deployment_day|date=2021-10-14}}: {{gerrit|730243}}
     23:05  Portal:Toolforge/Admin diffhist +1,888 BryanDavis →‎Deleting a tool: Link to phab:T170355
N    21:26  File:Tool restore process.png diffhist +138 Andrew Bogott Diagram showing flow process when a disabled tool is restored
N    21:25  File:Tool disable process.png diffhist +129 Andrew Bogott Flow diagram of what happens when a tool is disabled
     20:10  PAWS/Admin diffhist −179 Bstorm →‎Database: update for trove
N    19:29  User:Triciaburmeister diffhist +287 Triciaburmeister Add page content
     18:22  Nova Resource:Tools.quickcategories/SAL diffhist +160 Stashbot wm-bot: <lucaswerkmeister> deployed 7a5d6823e2 (remove type ignore comments), updated dependencies including Flask 2.0.2
     15:50  User:Jbond/debuging diffhist +216 Jbond →‎Check the pooled state
     14:35  Orchestrator diffhist +3,107 Kormat →‎Operations: split out packaging from operations
N    14:22  User:Kormat/Orchestrator diffhist +637 Kormat →‎Operations: does it work with only one section?
     13:52  MediaWiki talk:Titleblacklist diffhist +216 Nhatminh01 →‎Adding: new section
     13:13  SRE/Data Persistence/Databases/Runbooks diffhist +191 LSobanski
     12:42  GitLab/Gitlab Runner diffhist +1,123 Jelto
     12:37  Portal:Toolforge/Admin/New grid engine exec host diffhist +102 David Caro →‎Host setup
     12:13  Analytics/Systems/Jupyter diffhist +622 Btullis →‎Viewing JupyterHub logs: Added details of the Kibana dashboard.
     12:09  Memcached for MediaWiki diffhist +27 Effie Mouzeli →‎Service
N    11:38  User:Notsniwiast diffhist +2 Notsniwiast creation
     11:18  Nova Resource:Toolsbeta/SAL diffhist +434 Stashbot wm-bot: Added a new grid webgrid generic node toolsbeta-sgewebgen-09-1.toolsbeta.eqiad1.wikimedia.cloud to the pool (T292465) - cookbook ran by dcaro@vulcanus
     10:46  Nova Resource:Admin/SAL diffhist +105 Stashbot arturo: updating python3-neutron across the fleet (T292936)
N    10:44  Maps/v2/Troubleshooting diffhist +124 Effie Mouzeli
     10:42  Maps diffhist +95 Effie Mouzeli
N    10:37  Db-kill diffhist +3,673 Jcrespo →‎Usage: where it is installed
N    10:12  User talk:Notsniwiast diffhist +678 StrikerBot Welcome to Toolforge!
N    10:11  User talk:Yi7cuGhe diffhist +675 StrikerBot Welcome to Toolforge!
N    10:08  User talk:Yuanga diffhist +673 StrikerBot Welcome to Toolforge!
     09:57  Nova Resource:Twl/SAL diffhist +96 Stashbot arturo: bump RAM quota from 16GB to 32GB (T292100)
     08:42  Kubernetes/Service ports diffhist −22 Elukey Delete inference entry (since we'll use the istio ingress gw ports)
     01:16  Selling to Wikimedia Foundation/Pointer diffhist −3 Quiddity s/entertain/accept/
     00:38  Server Admin Log diffhist +15,911 Stashbot ejegg: updated payments-wiki from 030b11da1a to b329d2dea2

12 October 2021

     23:13  Wikimedia Cloud Services team/EnhancementProposals/Toolforge Buildpack Implementation diffhist +3,760 Bstorm →‎To make this useful with current Toolforge and webservice: add a link to the tekton dashboard setup
     19:11  Release Engineering/SAL diffhist +197 Stashbot hashar: Building Docker images for https://gerrit.wikimedia.org/r/730279
     18:02  MediaWiki:Sitenotice diffhist +418 BryanDavis Announce meta:Coolest Tool Award 2021 nominations
     16:10  Nova Resource:Toolsbeta/SAL diffhist +442 Stashbot wm-bot: Adding a new grid webgrid generic node (T292465) - cookbook ran by dcaro@vulcanus
     14:59  Analytics/Data Lake/Traffic/Webrequest diffhist +22 Neil P. Quinn-WMF Fix referrer value used for a blank referrer ("-", not "none"). Add link.
     14:39  Kafka/Administration diffhist +3,511 Elukey →‎Alter topic partition number
N    13:27  Monitoring/VarnishTrafficDrop diffhist +2,353 Ema →‎Things to do: link the DDoS playbook
     12:44  VRT System diffhist +101 Alexandros Kosiaris
N    11:58  File:Ulsfo-traffic-spike.png diffhist +27 Ema
N    11:54  File:Esams-traffic-drop.png diffhist +26 Ema
N    10:52  File:Typical Email workflow in VRT System.jpg diffhist +36 Alexandros Kosiaris
     09:06  Nova Resource:Admin/SAL diffhist +200 Stashbot dcaro: upgrading eqiad cloudnet hosts neutron packages (T292936)
     04:12  Volunteer NDA diffhist 0 Krinkle
     00:11  Server Admin Log diffhist +3,728 Stashbot eileen: civicrm revision changed from 598b59b0ee to 96090e4bd2, config revision is 85277466ed

11 October 2021

     23:29  Analytics/Systems/Cluster diffhist +122 Neil P. Quinn-WMF Add command for calculating size of HDFS directory
     19:26  Deployments diffhist +131 Cparle →‎{{Deployment_day|date=2021-10-12}}
     18:18  Incident documentation/2021-10-08 network provider diffhist +169 CDanis →‎Actionables
     15:35  Release Engineering/SAL diffhist +314 Stashbot hashar: gerrit: marked integration/composer read-only. We are no more using it and the few use cases left are tracked at https://phabricator.wikimedia.org/T249949
     15:24  Nova Resource:Toolsbeta/SAL diffhist +365 Stashbot wm-bot: Adding a new grid webgrid generic node (T292465) - cookbook ran by dcaro@vulcanus
     14:32  Nova Resource:Tools.video2commons/SAL diffhist +64 Stashbot chicocvenancio: trying python3 port
     13:58  Nova Resource:Tools.video2commons-test/SAL diffhist +121 Stashbot chicocvenancio: checking out PR#138 and running with python3.9 type T292355
     12:20  User:Minato826 diffhist +199 Minato826 Removing redirect to deletion requested page
     12:16  User:Anoop Rao diffhist −997 Minato826 delete|author request-i think this was accidentally created by me
     12:14  Nova Resource:Tools.lexeme-forms/SAL diffhist +101 Stashbot wm-bot: <lucaswerkmeister> deployed fb32d04132 (l10n updates)
     11:45  Wikimedia Cloud Services team/EnhancementProposals/cinder backups diffhist −1 Arturo Borrero Gonzalez →‎Storage size: typo in bolding syntax
     11:42  Wikimedia Cloud Services team/EnhancementProposals/cloudswift diffhist +276 Arturo Borrero Gonzalez →‎Additional notes: mention codfw PoC
     11:07  UID diffhist +1,089 Jbond
     10:59  MariaDB/Provisioning a host diffhist −152 LSobanski →‎Replacing a failed host: Updating the reimage instructions
     10:19  Portal:Toolforge/Admin/Kubernetes/Networking and ingress diffhist +50 Majavah →‎nginx-ingress
     09:20  MariaDB/Upgrading a section diffhist +141 Jcrespo →‎Upgrade procedure: adding automatic downtime cookbook
     09:15  Management Interfaces diffhist +10 Jcrespo →‎Is there any overriding for next boot?: update deprecated reimage script
     08:19  Server Lifecycle diffhist −3,723 Volans Updated documentation for reimage for the new process
     07:32  Kafka/Administration diffhist +477 Elukey →‎Rebalance topic partitions to new brokers
     02:54  User talk:Krinkle diffhist +199 Krinkle →‎Low priority Navpop JS update request: Reply
     02:54  MediaWiki:Gadget-popups.js diffhist +5,150 Krinkle Update from en.wikipedia.org, per @Quiddity, diff 1928512.

10 October 2021

     23:47  Category:Toolforge tools diffhist +107 Quiddity update box-summary a bit, merging Toolhub into the top list
     22:25  Server Lifecycle/Reimage diffhist +12 Quiddity →‎Example snippet: lang=text
     22:19  User talk:Krinkle diffhist +316 Quiddity →‎Low priority Navpop JS update request: new section
     21:45  MediaWiki:Loginprompt diffhist +7 Krinkle more signal to noise
     21:00  Deployments diffhist +23 Huji →‎{{Deployment_day|date=2021-10-12}}
     11:20  Nova Resource:Tools.lexeme-forms/SAL diffhist +111 Stashbot wm-bot: <lucaswerkmeister> deployed bf2834c472 (improve error handling)

9 October 2021

     16:28  SRE/LDAP/Groups diffhist 0 Majavah →‎NDA group: fix link
     05:01  Server Admin Log‎‎ 2 changes history +9,032 [Stashbot‎ (2×)]
     
05:01 (cur | prev) +224 Stashbot jiji@deploy1002: helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' .
     
01:32 (cur | prev) +8,808 Stashbot ryankemper@cumin1001: END (FAIL) - Cookbook sre.elasticsearch.rolling-operation (exit_code=99) restart without plugin upgrade (1 nodes at a time) for ElasticSearch cluster cloudelastic: cloudelastic restart - ryankemper@cumin1001 - T292814
N    02:00  Deployments/Archive/2021/10 diffhist +12,477 DeploymentCalendarTool Add last week
     00:18  Nova Resource:Wikisp/SAL diffhist +88 Stashbot DeusExMachina: Deleted mars-01 per T292884

8 October 2021

     23:00  Nova Resource:Tools.gerrit-reviewer-bot/SAL diffhist +153 Stashbot wm-bot: <root> root forced the deletion of job 913897
     21:17  Release Engineering/SAL diffhist +494 Stashbot hashar: Purging Docker images on all CI agents
     20:54  Template:Gitweb/doc diffhist −10 BryanDavis fix example example
     20:53  Toolhub.wikimedia.org diffhist +12 BryanDavis →‎Testing deployment: fix gerrit link
     20:52  Template:Gitweb diffhist +16 BryanDavis Use /r/plugins/gitiles/ rather than /g/
     17:58  Network monitoring diffhist +1,208 CDanis →‎NEL alerts
     17:30  Network Error Logging diffhist +1,179 CDanis →‎intro
     16:57  HTTPS diffhist +1,225 BBlack Add section about Certificate issuance practices
     16:05  Analytics/Data Lake/Traffic/BotDetection diffhist +14 Nettrom →‎Code: update to reference the shaded JARs
     15:10  Bacula diffhist +585 Jcrespo →‎Restore from a non-existent host (missing private key)
N    14:09  VRT System diffhist +18,781 Alexandros Kosiaris Bring up to date various places in the doc
     14:05  Performance/Metrics diffhist +136 Krinkle