You are browsing a read-only backup copy of Wikitech. The live site can be found at wikitech.wikimedia.org

Main Page: Difference between revisions

From Wikitech-static
Jump to navigation Jump to search
imported>Dzahn
(replace RT with Phabricator link)
imported>Quiddity
(remove primary link from right-col for consistency)
 
(58 intermediate revisions by 25 users not shown)
Line 1: Line 1:
{| id="mp-upper" style="width: 100%; margin:4px 0 0 0; background:none; border-spacing: 0px;"
'''Wikitech''' is the home of technical documentation for [[foundationsite:|Wikimedia Foundation]] infrastructure and services.  This includes [[Wikimedia infrastructure|production clusters]], [[Help:Cloud Services introduction|Wikimedia Cloud Services]], [[Portal:Toolforge|Toolforge]] hosting, and the [[Nova Resource:Deployment-prep|Beta Cluster]]. To edit this wiki, you need a '''[[Help:Create a Wikimedia developer account|Wikimedia developer account]]'''. Wikitech does not use the [[m:Special:MyLanguage/Help:Unified login|Wikimedia Unified Login]] (like on Wikipedia) and does not permit editing without an account.
| class="MainPageBG" style="width: 50%; border: 1px solid #cef2e0; background: #f5fffa; vertical-align: top; color: #000;" |
{| id="mp-left" style="width: 100%; vertical-align: top; background: #f5fffa;"
! style="padding: 2px;" | <h2 id="mf-preserve-h2" style="margin: 3px; background: #cef2e0; font-size: 120%; font-weight: bold; border: 1px solid #a3bfb1; text-align: left; color: #000; padding: 0.2em 0.4em;">Production</h2>
|-
| style="color: #000;" | <div id="mf-preserve" style="padding: 2px 5px">
The production part of this wiki, also known as '''Wikitech''', is for internal technical documentation for the Wikimedia Foundation. For technical documentation of MediaWiki software, see [[mw:|MediaWiki.org]].


{| style="width: 100%" class="leftalign-table messagebox"
<templatestyles src="Template:Portal_list_item/styles.css" />
!style="width:100px" | Guides
<div class="mw-tpl-portal-list">
| [[Operations_requests|Getting Help from Operations]] '''&middot;''' [[Get involved]] '''&middot;''' [[Ops Clinic Duty]] '''&middot;''' [[Infrastructure naming conventions]] '''&middot;''' [[How-To|How-Tos]] '''&middot;''' [[Profiling]] ([http://noc.wikimedia.org/cgi-bin/report.py web interface]) '''&middot;''' [[Puppet coding]] '''&middot;''' [[Puppet and iptables]]
{{Portal list item
|-
|name=Introduction
! Servers
|image=File:Wikimedia Cloud Services logo with text.svg
| [[Server Lifecycle]] '''&middot;''' [[Server Spares]] '''&middot;''' [[Apaches]]  '''&middot;''' [[Media storage]] '''&middot;''' [[NFS]] '''&middot;''' [[DNS]]  '''&middot;''' [[Memcached]] '''&middot;''' [[MariaDB]] '''&middot;''' [[LDAP]] '''&middot;''' [[Multicast HTCP purging]] '''&middot;''' [[Virtualization]] '''&middot;''' [[Https|HTTPS]] '''&middot;''' [[PartMan]]
|alt=Introduction
|-
|link=Help:Cloud Services introduction
! Backups
|description=An overview of the '''Wikimedia Cloud Services''' (WMCS) products and ecosystem.
| [[Backup procedures|Current status]] '''&middot;''' [[Disaster Recovery]] '''&middot;''' [[Dumps|XML database dumps]] '''&middot;''' [[Offsite Backups|Offsite]]<br />
}}
|-
{{Portal list item
! OSs
|name=Cloud VPS
| [http://www.ubuntu.com/ Ubuntu] ([[:Category:Ubuntu|Ubuntu]]) '''&middot;''' [[Automated installation]] '''&middot;''' [[Distribution upgrades]] '''&middot;''' [[Puppet]] '''&middot;''' [[Reprepro|APT repository]] '''&middot;''' [[Package management|Debian packaging]]
|image=File:Wikimedia Cloud Services logo.svg
|-
|alt=Wikimedia Cloud VPS logo
! Datacenter
|link=Portal:Cloud VPS
| [[Datacenter operations]] '''&middot;''' [[Common Datacenter Specifications]] '''&middot;''' [[Platform-specific_documentation/Opengear_Serial_Consoles|Opengear Serial Consoles]] '''&middot;''' [[Platform-specific documentation]]
|description='''Wikimedia Cloud VPS''' provides a cloud computing infrastructure powered by [[w:OpenStack|OpenStack]] for projects related to the [[m:Special:MyLanguage/Wikimedia movement|Wikimedia movement]].
|-
}}
! War
{{Portal list item
| [[Security]]
|name=Toolforge
|-
|image=File:Toolforge logo.svg
! Maps
|alt=Wikimedia Toolforge logo
| [[Batch jobs]] '''&middot;''' [[Locations]] <small>of backups, mirrors, etc.</small> '''&middot;''' [[Scripts]]
|link=Portal:Toolforge
|-
|description='''Toolforge''' is a hosting environment for developers working on tools (bots, webservices, scheduled jobs) that help maintain and support Wikimedia wikis.
! Email
}}
| [[Mail]] '''&middot;''' [[Mailing lists]] '''&middot;''' [[OTRS]] '''&middot;''' [[PGP Keys]]
{{Portal list item
|-
|name=Data Services
! Network
|image=File:WMCS data services.svg
| [[Network design|Design]] '''&middot;''' [[BGP]] '''&middot;''' [[IP addresses|IPs]] '''&middot;''' [[Network utils|Utils]] '''&middot;''' [[802.1Q]] '''&middot;''' [[RANCID]] '''&middot;''' [http://puck.nether.net/netops/ NOC Phones] '''&middot;''' [[LVS]] '''&middot;''' [[Link aggregation]] ''&middot;'' [[Network cheat sheet]] ''&middot;'' [[Proxy access to cluster]]
|alt=Data Services logo
|-
|link=Portal:Data Services
! Other
|description= '''Wiki replicas''' and offerings for analysis, Tool building, and exploration. Both Cloud VPS and Toolforge can be used to access Data Services.
| [[Status monitors]] '''&middot;''' [[Phabricator]]  '''&middot;''' [[Renaming users]] '''&middot;''' [[Admin Logs]] '''&middot;''' [[Password reset]] '''&middot;''' [[Fundraising]]
}}
|-
{{Portal list item
! Wiki
| name = Production infrastructure
| [[:Category:Main|Browse root category]] '''&middot;''' [[:Category:Wiki]] '''&middot;''' [[:Category:Templates]]
| image = File:Wikitech-2021-blue-large-icon.svg
|}
| alt = Wikitech logo
* [[:Category:Bot and monitoring]]
| link = Wikimedia infrastructure
* [[:Category:Clusters]]
| description = '''Wikimedia's production infrastructure''' is the servers, software, and data that power the real, live Wikimedia websites. It is maintained by the Wikimedia Foundation's [[SRE|Site Reliability Engineering team]] as well as other teams.
* [[Presentations]]
* [[Software deployments]]


* Please add general MediaWiki documentation to [[mw:|the MediaWiki.org wiki]]
The core of the production infrastructure is a highly-configured deployment MediaWiki, our open-source wiki application, but it also contains a vast array of other applications, from [[Apache Traffic Server]] to [[Zookeeper]].


== See also ==
The documentation here covers the specific details of Wikimedia's infrastructure. If you're trying to run your own MediaWiki site, see the general MediaWiki documentation at [[mw:Special:MyLanguage/Main Page|mediawiki.org]].
<div class="plainlinks">
}}
* Torrus Stats: [http://torrus.wikimedia.org/torrus/CDN?path=%2FTotals%2F Totals]
* Ganglia [http://ganglia.wikimedia.org graphs]
* [[m:Wikimedia servers|Wikimedia servers]]
* [[m:System administrators|System administrators]]
</div>
</div>
|}
| style="border: 1px solid transparent;" |
<!--        USAGE      -->
| class="MainPageBG" style="width: 50%; border: 1px solid #cedff2; background: #f5faff; vertical-align: top;"|
{| id="mp-right" style="width: 100%; vertical-align: top; background: #f5faff;"
! style="padding: 2px;" | <h2 id="mp-itn-h2" style="margin: 3px; background: #cedff2; font-size: 120%; font-weight: bold; border: 1px solid #a3b0bf; text-align: left; color: #000; padding: 0.2em 0.4em;">Labs</h2>
|-
| style="color: #000;" | <div id="mf-preserve" style="padding: 2px 5px">
[[Help:FAQ|Wikimedia Labs]] is meant to make it easier for developers and system administrators to try out improvements to Wikimedia infrastructure, including MediaWiki, and to do analytics and bot work.


[[Help:Terminology|Labs Account Holders]] are governed by the [[Project:Labs Terms of use|Labs terms of use]]. The [[mw:Wikimedia Labs/Agreement to disclosure of personally identifiable information|agreement to disclosure of personally identifiable information]] covers [[Help:Terminology|Labs End-Users]].
For more information, start at [[Help:Contents]].
</div>
|-
! style="padding: 2px;" | <h2 id="mp-itn-h2" style="margin: 3px; background: #cedff2; font-size: 120%; font-weight: bold; border: 1px solid #a3b0bf; text-align: left; color: #000; padding: 0.2em 0.4em;">Tool Labs</h2>
|-
| style="color: #000;" | <div id="mf-preserve" style="padding: 2px 5px">
Tool Labs, a reliable, scalable hosting environment for community developers working on tools and bots, is part of Wikimedia Labs and consists of two projects [[Nova Resource:Tools]] and [[Nova Resource:Toolsbeta]]. For more information pertaining to the Tool Labs environment, please see [[Help:Tool Labs]].
</div>
|-
! style="padding: 2px;" | <h2 id="mp-itn-h2" style="margin: 3px; background: #cedff2; font-size: 120%; font-weight: bold; border: 1px solid #a3b0bf; text-align: left; color: #000; padding: 0.2em 0.4em;">Usage</h2>
|-
| style="color: #000; padding: 2px 5px;" |
<div id="mf-preserve">{{Infobox2
| label1='''Number of {{#ask:[[Resource Type::project]]
|?
|?Description
|format=broadtable
|limit=0
|link=all
|headers=show
|mainlabel=-
|searchlabel=projects
}}:'''
| data1={{#ask: [[Resource Type::project]]|format=count}}
| label2='''Number of {{#ask:[[Resource Type::instance]]|?Instance Name|?Instance Type|?Project|?Image Id|?FQDN|?Launch Time|?Puppet Class|?Modification date|?Instance Host|?Number of CPUs|?RAM Size|?Amount of Storage|limit=0|searchlabel=instances}}:'''
| data2={{#ask: [[Resource Type::instance]]|limit=5000|format=count}}
| label3='''Amount of RAM in use (in MBs):'''
| data3={{#ask: [[Resource Type::instance]]|limit=5000|?RAM Size|format=sum}}
| label4='''Amount of allocated storage (in GBs):'''
| data4={{#ask: [[Resource Type::instance]]|limit=5000|?Amount of Storage|format=sum}}
| label5='''Number of virtual CPUs in use:'''
| data5={{#ask: [[Resource Type::instance]]|limit=5000|?Number of CPUs|format=sum}}
| label6='''Number of users:'''
| data6={{NUMBEROFUSERS}}
}}
</div>
</div>
|}
|}
<noinclude>__NOTOC__</noinclude>
<noinclude>__NOTOC__</noinclude>

Latest revision as of 21:05, 15 April 2023

Wikitech is the home of technical documentation for Wikimedia Foundation infrastructure and services. This includes production clusters, Wikimedia Cloud Services, Toolforge hosting, and the Beta Cluster. To edit this wiki, you need a Wikimedia developer account. Wikitech does not use the Wikimedia Unified Login (like on Wikipedia) and does not permit editing without an account.

Introduction
Introduction
An overview of the Wikimedia Cloud Services (WMCS) products and ecosystem.
Wikimedia Cloud VPS logo
Cloud VPS
Wikimedia Cloud VPS provides a cloud computing infrastructure powered by OpenStack for projects related to the Wikimedia movement.
Wikimedia Toolforge logo
Toolforge
Toolforge is a hosting environment for developers working on tools (bots, webservices, scheduled jobs) that help maintain and support Wikimedia wikis.
Data Services logo
Data Services
Wiki replicas and offerings for analysis, Tool building, and exploration. Both Cloud VPS and Toolforge can be used to access Data Services.
Wikitech logo
Production infrastructure
Wikimedia's production infrastructure is the servers, software, and data that power the real, live Wikimedia websites. It is maintained by the Wikimedia Foundation's Site Reliability Engineering team as well as other teams.

The core of the production infrastructure is a highly-configured deployment MediaWiki, our open-source wiki application, but it also contains a vast array of other applications, from Apache Traffic Server to Zookeeper.

The documentation here covers the specific details of Wikimedia's infrastructure. If you're trying to run your own MediaWiki site, see the general MediaWiki documentation at mediawiki.org.
Retrieved from "https://wikitech-static.wikimedia.org/w/index.php?title=Main_Page&oldid=600113"