You are browsing a read-only backup copy of Wikitech. The live site can be found at wikitech.wikimedia.org
Mirrors: Difference between revisions
imported>Dzahn No edit summary |
imported>Dzahn (→Technical info: The server is located at the Equinix data center in Ashburn, Virginia, United States (eqiad).) |
||
| Line 1: | Line 1: | ||
:''See also: [[Dumps/Mirror status]]'' | :''See also: [[Dumps/Mirror status]]'' | ||
The Wikimedia Foundation hosts public mirrors of the [[Debian]], [[Ubuntu]] and [[Tails]] archives. | == mirrors.wikimedia.org == | ||
The Wikimedia Foundation hosts public mirrors of the [[Debian]], [[Ubuntu]] and [[Tails]] archives to give back to [[w:Free_and_open-source_software|FOSS]] projects it uses itself. | |||
They are currently only offered via http, although ftp and rsync may be offered in the future. | They are currently only offered via http, although ftp and rsync may be offered in the future. | ||
| Line 7: | Line 9: | ||
* https://mirrors.wikimedia.org/ | * https://mirrors.wikimedia.org/ | ||
== Upstream links == | |||
These are the Debian and Ubuntu mirror pages listing mirrors.wikimedia.org to confirm it as official: | |||
* https://www.debian.org/mirror/sponsors | |||
* https://launchpad.net/ubuntu/+mirror/wikimedia-archive | |||
== Technical info == | |||
As of May 2019 they are hosted on '''sodium.wikimedia.org'''. | As of May 2019 they are hosted on '''sodium.wikimedia.org'''. | ||
The server is located at the [[w:Equinix|Equinix]] data center in [[w:Ashburn, Virginia|Ashburn, Virginia, United States]] ([[eqiad]]). | |||
The relevant [[Puppet]] class is '''modules/role/manifests/mirrors.pp'''. | The relevant [[Puppet]] class is '''modules/role/manifests/mirrors.pp'''. | ||
The repo for the puppet code can be git cloned with "git clone https://gerrit.wikimedia.org/r/operations/puppet" from Wikimedia's [[Gerrit]] installation. | |||
== Monitoring and debugging == | |||
There are 2 [[Icinga]] checks called "Ubuntu mirror in sync with upstream" and "Debian mirror in sync with upstream" respectively. | There are 2 [[Icinga]] checks called "Ubuntu mirror in sync with upstream" and "Debian mirror in sync with upstream" respectively. | ||
| Line 19: | Line 36: | ||
Furthermore, you can check '''/etc/ftpsync/ftpsync.conf''' to see which upstream hosts we are rsyncing from and look at '''/var/log/ftpsync/''' to check logfiles for errors. | Furthermore, you can check '''/etc/ftpsync/ftpsync.conf''' to see which upstream hosts we are rsyncing from and look at '''/var/log/ftpsync/''' to check logfiles for errors. | ||
If the error appears to be on the upstream side you should try contacting '''mirrors@debian.org''' or '''mirrors@ubuntu.com'''. | == Contacting wikimedia maintainers == | ||
The mirror server is maintained by the Wikimedia [[SRE]] team. To report issues with mirrors.wikimedia.org please create a ticket in Wikimedia's [[Phabricator]] and tag it with 'operations'. You can also join the [[Freenode]] IRC channels #wikimedia-operations and #wikimedia-tech. | |||
== Contacting upstream maintainers == | |||
If the error appears to be on the upstream side you should try contacting '''mirrors@debian.org''' or '''mirrors@ubuntu.com'''. | |||
There is also channel #ubuntu-mirrors on [[Freenode]]. | |||
[[Category:Runbooks]] | [[Category:Runbooks]] | ||
Revision as of 00:02, 25 August 2020
- See also: Dumps/Mirror status
mirrors.wikimedia.org
The Wikimedia Foundation hosts public mirrors of the Debian, Ubuntu and Tails archives to give back to FOSS projects it uses itself.
They are currently only offered via http, although ftp and rsync may be offered in the future.
Upstream links
These are the Debian and Ubuntu mirror pages listing mirrors.wikimedia.org to confirm it as official:
Technical info
As of May 2019 they are hosted on sodium.wikimedia.org.
The server is located at the Equinix data center in Ashburn, Virginia, United States (eqiad).
The relevant Puppet class is modules/role/manifests/mirrors.pp.
The repo for the puppet code can be git cloned with "git clone https://gerrit.wikimedia.org/r/operations/puppet" from Wikimedia's Gerrit installation.
Monitoring and debugging
There are 2 Icinga checks called "Ubuntu mirror in sync with upstream" and "Debian mirror in sync with upstream" respectively.
If one of these alerts you should check on sodium what happens if you manually run the check commands, "/usr/local/lib/nagios/plugins/check_apt_mirror /srv/mirrors/ubuntu" / "/usr/local/lib/nagios/plugins/check_apt_mirror /srv/mirrors/debian".
Also you can run the actual sync command manually but make sure to run it was the user "mirror", so "[sodium:~] $ sudo -u mirror ftpsync".
Furthermore, you can check /etc/ftpsync/ftpsync.conf to see which upstream hosts we are rsyncing from and look at /var/log/ftpsync/ to check logfiles for errors.
Contacting wikimedia maintainers
The mirror server is maintained by the Wikimedia SRE team. To report issues with mirrors.wikimedia.org please create a ticket in Wikimedia's Phabricator and tag it with 'operations'. You can also join the Freenode IRC channels #wikimedia-operations and #wikimedia-tech.
Contacting upstream maintainers
If the error appears to be on the upstream side you should try contacting mirrors@debian.org or mirrors@ubuntu.com.
There is also channel #ubuntu-mirrors on Freenode.