Difference between revisions of "Url-downloader"

From Wikitech-static
Jump to navigation Jump to search
imported>Gergő Tisza
imported>Giuseppe Lavagetto
Line 4: Line 4:
: ''See also [https://github.com/wikimedia/puppet/blob/production/modules/profile/manifests/url_downloader.pp url_downloader] in Puppet.''
: ''See also [https://github.com/wikimedia/puppet/blob/production/modules/profile/manifests/url_downloader.pp url_downloader] in Puppet.''


* For [[eqiad]]: Hosted on [[chromium]] as <code>url-downloader.eqiad.wikimedia.org:8080</code>
* For [[eqiad]]: Hosted on <code>urldownloader100[12].wikimedia.org</code>
* For [[codfw]]: Hosted on [[alsafi]] ([[ganeti01]]) as <code>url-downloader.codfw.wikimedia.org:8080</code>
* For [[codfw]]: Hosted on <code>urldownloader200[12].wikimedia.org</code>
In both datacenters only one url-downloader is active at any time, and is pointed at via the DNS record for <code>url-downloader.$DC.wikimedia.org</code>, and exposed at <code>url-downloader.$DC.wikimedia.org:8080</code>.


<code>url-downloader.wikimedia.org:8080</code> points to eqiad for backward-compatibility.
<code>url-downloader.wikimedia.org:8080</code> points to eqiad for backward-compatibility.

Revision as of 17:37, 31 March 2020

url-downloader is a Squid caching proxy for HTTP requests. It was originally created for MediaWiki's upload-by-URL functionality.

Service

See also url_downloader in Puppet.
  • For eqiad: Hosted on urldownloader100[12].wikimedia.org
  • For codfw: Hosted on urldownloader200[12].wikimedia.org

In both datacenters only one url-downloader is active at any time, and is pointed at via the DNS record for url-downloader.$DC.wikimedia.org, and exposed at url-downloader.$DC.wikimedia.org:8080.

url-downloader.wikimedia.org:8080 points to eqiad for backward-compatibility.

See also