Renaming of Cloud Services products is in progress.
You may see mixed references to Tool Labs -> Toolforge, Labs -> Cloud VPS. Edits are welcome.

Difference between revisions of "Main Page"

From Wikitech
Jump to: navigation, search
(remove reference to obsolete article)
(toolserver is safely considered historical at this point)
Line 1: Line 1:
{| id="mp-upper" style="width: 100%; margin:4px 0 0 0; background:none; border-spacing: 0px;"
+
Welcome to '''Wikitech'''. This wiki hosts documentation related to the [[Portal:Wikitech|technical infrastructure]] maintained by the [[:foundation:Home|Wikimedia Foundation]] as well as the [[Portal:Wikimedia Labs|Wikimedia Labs]] cloud computing infrastructure, the [[Portal:Tool Labs|Tool Labs]] hosting environment, and many other technical projects such as the [[Nova Resource:Deployment-prep|Beta cluster]] project used to validate new software before [[Deployments|deployment to the production cluster]].
| class="MainPageBG" style="width: 50%; border: 1px solid #cef2e0; background: #f5fffa; vertical-align: top; color: #000;" |
 
{| id="mp-left" style="width: 100%; vertical-align: top; background: #f5fffa;"
 
! style="padding: 2px;" | <h2 id="mf-preserve-h2" style="margin: 3px; background: #cef2e0; font-size: 120%; font-weight: bold; border: 1px solid #a3bfb1; text-align: left; color: #000; padding: 0.2em 0.4em;">Production</h2>
 
|-
 
| style="color: #000;" | <div id="mf-preserve" style="padding: 2px 5px">
 
The production part of this wiki, also known as '''Wikitech''', is for internal technical documentation for the Wikimedia Foundation. For technical documentation of MediaWiki software, see [[mw:|MediaWiki.org]].
 
 
 
{| style="width: 100%" class="leftalign-table messagebox"
 
!style="width:100px" | Guides
 
| [[Operations_requests|Getting help from Operations]] '''&middot;''' [[Get involved]] '''&middot;''' [[Infrastructure naming conventions]] '''&middot;''' [[How-To|How-Tos]] '''&middot;''' [[Profiling]] '''&middot;''' [[Puppet coding]]
 
|-
 
! Servers
 
| [[Clusters]] '''&middot;''' [[Server Lifecycle]] '''&middot;''' [[Server Spares]] '''&middot;''' [[Apaches]]  '''&middot;''' [[Media storage]] '''&middot;''' [[DNS]]  '''&middot;''' [[Memcached]] '''&middot;''' [[MariaDB]] '''&middot;''' [[LDAP]] '''&middot;''' [[Multicast HTCP purging]] '''&middot;''' [[Virtualization]] '''&middot;''' [[HTTPS]] '''&middot;''' [[PartMan]]
 
|-
 
! Backups
 
| [[Bacula|Current status]] '''&middot;''' [[Disaster Recovery]] '''&middot;''' [[Dumps|XML database dumps]]  '''&middot;''' [[Offsite Backups|Offsite]]<br />
 
|-
 
! OSs
 
| [http://www.ubuntu.com/ Ubuntu] ([[:Category:Ubuntu|Ubuntu]]) '''&middot;''' [[Distribution upgrades]] '''&middot;''' [[Puppet]] '''&middot;''' [[Reprepro|APT repository]] '''&middot;''' [[Package management|Debian packaging]]
 
|-
 
! Datacenter
 
| [[Datacenter operations]] '''&middot;''' [[Common Datacenter Specifications]] '''&middot;''' [[Platform-specific_documentation/Opengear_Serial_Consoles|Opengear Serial Consoles]] '''&middot;''' [[Platform-specific documentation]]
 
|-
 
! War
 
| [[Security]]
 
|-
 
! Maps
 
| [[Batch jobs]] '''&middot;''' [[Locations]] <small>of backups, mirrors, etc.</small> '''&middot;''' [[Scripts]]
 
|-
 
! Email
 
| [[Mail]] '''&middot;''' [[Mailing lists]] '''&middot;''' [[OTRS]] '''&middot;''' [[PGP Keys]]
 
|-
 
! Network
 
| [[Network design|Design]] '''&middot;''' [[IP addresses|IPs]] '''&middot;''' [[Network utils|Utils]] '''&middot;''' [[802.1Q]] '''&middot;''' [[RANCID]] '''&middot;''' [http://puck.nether.net/netops/ NOC Phones] '''&middot;''' [[LVS]] '''&middot;''' [[Link aggregation]] ''&middot;'' [[Network cheat sheet]] ''&middot;'' [[Proxy access to cluster]]
 
|-
 
! Other
 
| [[Status monitors]] '''&middot;''' [[Phabricator]]  '''&middot;''' [[Renaming users]] '''&middot;''' [[Admin Logs]] '''&middot;''' [[Password reset]] '''&middot;''' [[Fundraising]]
 
|-
 
! Wiki
 
| [[:Category:Main|Browse root category]] '''&middot;''' [[:Category:Wiki]] '''&middot;''' [[:Category:Templates]]
 
|}
 
* [[:Category:Bot and monitoring]]
 
* [[:Category:Clusters]]
 
* [[Presentations]]
 
* [[Software deployments]]
 
 
 
* Please add general MediaWiki documentation to [[mw:|the MediaWiki.org wiki]]
 
  
== See also ==
+
<!-- TODO: links to Portal namespace rather than subpages -->
<div class="plainlinks">
+
{| style="border-top:1px solid #a7d7f9;border-collapse:collapse"
* Torrus Stats: [http://torrus.wikimedia.org/torrus/CDN?path=%2FTotals%2F Totals]
+
|+ style="font-weight:bold;" | Portals
* Ganglia [https://ganglia.wikimedia.org graphs]
 
* [[m:Wikimedia servers|Wikimedia servers]]
 
* [[m:System administrators|System administrators]]
 
</div>
 
</div>
 
|}
 
| style="border: 1px solid transparent;" |
 
<!--       USAGE      -->
 
| class="MainPageBG" style="width: 50%; border: 1px solid #cedff2; background: #f5faff; vertical-align: top;"|
 
{| id="mp-right" style="width: 100%; vertical-align: top; background: #f5faff;"
 
! style="padding: 2px;" | <h2 id="mp-itn-h2" style="margin: 3px; background: #cedff2; font-size: 120%; font-weight: bold; border: 1px solid #a3b0bf; text-align: left; color: #000; padding: 0.2em 0.4em;">Labs</h2>
 
 
|-
 
|-
| style="color: #000;" | <div id="mf-preserve" style="padding: 2px 5px">
+
! scope="row" style="border-bottom:1px solid #a7d7f9;padding:1em;vertical-align:top;width:25%;font-size:160%;" | [[File:Tool labs logo.svg|center|80px|alt=Wikimedia Tool Labs logo|link=Portal:Tool Labs]]  [[Portal:Tool Labs|Tool Labs]]
[[Help:FAQ|Wikimedia Labs]] is meant to make it easier for developers and system administrators to try out improvements to Wikimedia infrastructure, including MediaWiki, and to do analytics and bot work.
+
| style="border-bottom:1px solid #a7d7f9;padding:1em;vertical-align:top;" | '''Tool Labs''' (or '''Tools''') is a hosting environment for community developers working on tools and bots that help users maintain and use Wikimedia wikis. Tool Labs provides access to [[Help:Tool Labs/Database|replicas of Wikimedia databases]] and other services that allow developers to easily compute analytics, do bot work, and create tools to help editors and other volunteers in their work. The infrastructure is supported by a dedicated [[Nova Resource:Tools|group of Wikimedia Foundation staff and volunteers]].
  
[[Help:Terminology|Labs Account Holders]] are governed by the [[Project:Labs Terms of use|Labs terms of use]]. The [[mw:Wikimedia Labs/Agreement to disclosure of personally identifiable information|agreement to disclosure of personally identifiable information]] covers [[Help:Terminology|Labs End-Users]].
+
All Tool Labs web applications are served through [https://tools.wmflabs.org/ tools.wmflabs.org]. A [{{Tool Labs tools list}} list of all tools] is available.
  
For more information, start at [[Help:Contents]].
+
The Tool Labs platform is hosted by [[Portal:Wikimedia Labs|Wikimedia Labs]], but this aspect is not relevant to its users.
</div>
 
 
|-
 
|-
! style="padding: 2px;" | <h2 id="mp-itn-h2" style="margin: 3px; background: #cedff2; font-size: 120%; font-weight: bold; border: 1px solid #a3b0bf; text-align: left; color: #000; padding: 0.2em 0.4em;">Tool Labs</h2>
+
! scope="row" style="border-bottom:1px solid #a7d7f9;padding:1em;vertical-align:top;width:25%;font-size:160%;" | [[File:Wikimedia labs logo.svg|center|80px|alt=Wikimedia Labs logo|link=Portal:Wikimedia Labs]] [[Portal:Wikimedia Labs|Wikimedia Labs]]
 +
| style="border-bottom:1px solid #a7d7f9;padding:1em;vertical-align:top;" | '''Wikimedia Labs''' (or '''Labs''') provides a cloud computing infrastructure powered by [[:en:OpenStack|OpenStack]] for projects related to the [[:meta:Wikimedia movement|Wikimedia movement]]. Much of the configuration for Labs projects is managed using [[:mw:Extension:OpenStackManager|OpenStackManager]] provided special pages on this wiki. The environment also provides auxiliary services, such as shared NFS storage, and access to live replica databases of Wikimedia Foundation wikis.
 
|-
 
|-
| style="color: #000;" | <div id="mf-preserve" style="padding: 2px 5px">
+
! scope="row" style="border-bottom:1px solid #a7d7f9;padding:1em;vertical-align:top;width:25%;font-size:160%;" | [[File:Wikitech logo.svg|center|80px|alt=Wikitech logo|link=Portal:Wikitech]] [[Portal:Wikitech|Wikitech]]
Tool Labs, a reliable, scalable hosting environment for community developers working on tools and bots, is part of Wikimedia Labs and consists of two projects [[Nova Resource:Tools]] and [[Nova Resource:Toolsbeta]]. For more information pertaining to the Tool Labs environment, please see [[Help:Tool Labs]].
+
| style="border-bottom:1px solid #a7d7f9;padding:1em;vertical-align:top;" | The production part of this wiki, also known as '''Wikitech''', contains internal technical documentation for the Wikimedia Foundation. Documentation is available on most aspects of the technical operations of the [[Clusters|production server clusters]] as well as information on how to become involved in improving the underlying infrastructure of Wikimedia projects as volunteer.
</div>
+
 
|-
+
For technical documentation of MediaWiki software, see [[:mw:Main Page|MediaWiki.org]].
! style="padding: 2px;" | <h2 id="mp-itn-h2" style="margin: 3px; background: #cedff2; font-size: 120%; font-weight: bold; border: 1px solid #a3b0bf; text-align: left; color: #000; padding: 0.2em 0.4em;">Usage</h2>
 
|-
 
| style="color: #000; padding: 2px 5px;" |
 
<div id="mf-preserve">{{Infobox2
 
| label1='''Number of {{#ask:[[Resource Type::project]]
 
|?
 
|?Description
 
|format=broadtable
 
|limit=0
 
|link=all
 
|headers=show
 
|mainlabel=-
 
|searchlabel=projects
 
}}:'''
 
| data1={{#ask: [[Resource Type::project]]|format=count}}
 
| label2='''Number of {{#ask:[[Resource Type::instance]]|?Instance Name|?Instance Type|?Project|?Image Id|?FQDN|?Launch Time|?Puppet Class|?Modification date|?Instance Host|?Number of CPUs|?RAM Size|?Amount of Storage|limit=0|searchlabel=instances}}:'''
 
| data2={{#ask: [[Resource Type::instance]]|limit=5000|format=count}}
 
| label3='''Amount of RAM in use (in MBs):'''
 
| data3={{#ask: [[Resource Type::instance]]|limit=5000|?RAM Size|format=sum}}
 
| label4='''Amount of allocated storage (in GBs):'''
 
| data4={{#ask: [[Resource Type::instance]]|limit=5000|?Amount of Storage|format=sum}}
 
| label5='''Number of virtual CPUs in use:'''
 
| data5={{#ask: [[Resource Type::instance]]|limit=5000|?Number of CPUs|format=sum}}
 
| label6='''Number of users:'''
 
| data6={{NUMBEROFUSERS}}
 
}}
 
</div>
 
|}
 
 
|}
 
|}
 
<noinclude>__NOTOC__</noinclude>
 
<noinclude>__NOTOC__</noinclude>

Revision as of 22:08, 29 January 2016

Welcome to Wikitech. This wiki hosts documentation related to the technical infrastructure maintained by the Wikimedia Foundation as well as the Wikimedia Labs cloud computing infrastructure, the Tool Labs hosting environment, and many other technical projects such as the Beta cluster project used to validate new software before deployment to the production cluster.

Portals
Wikimedia Tool Labs logo
Tool Labs
Tool Labs (or Tools) is a hosting environment for community developers working on tools and bots that help users maintain and use Wikimedia wikis. Tool Labs provides access to replicas of Wikimedia databases and other services that allow developers to easily compute analytics, do bot work, and create tools to help editors and other volunteers in their work. The infrastructure is supported by a dedicated group of Wikimedia Foundation staff and volunteers.

All Tool Labs web applications are served through tools.wmflabs.org. A list of all tools is available.

The Tool Labs platform is hosted by Wikimedia Labs, but this aspect is not relevant to its users.

Wikimedia Labs logo
Wikimedia Labs
Wikimedia Labs (or Labs) provides a cloud computing infrastructure powered by OpenStack for projects related to the Wikimedia movement. Much of the configuration for Labs projects is managed using OpenStackManager provided special pages on this wiki. The environment also provides auxiliary services, such as shared NFS storage, and access to live replica databases of Wikimedia Foundation wikis.
Wikitech logo
Wikitech
The production part of this wiki, also known as Wikitech, contains internal technical documentation for the Wikimedia Foundation. Documentation is available on most aspects of the technical operations of the production server clusters as well as information on how to become involved in improving the underlying infrastructure of Wikimedia projects as volunteer.

For technical documentation of MediaWiki software, see MediaWiki.org.