You are browsing a read-only backup copy of Wikitech. The primary site can be found at wikitech.wikimedia.org

Difference between revisions of "Help:Cloud Services Introduction"

From Wikitech-static
Jump to navigation Jump to search
imported>BryanDavis
(→‎Discovery: wording)
imported>BryanDavis
(labs-l -> cloud)
Line 1: Line 1:
[[File:What is Cloud Services? poster.pdf|thumb|upright=1.3|Poster-format overview]]
'''Wikimedia Cloud Services''' ('''WMCS''') is a flexible computing ecosystem built on [[W:OpenStack|OpenStack]], [[W:Oracle Grid Engine|GridEngine]], and [[W:Kubernetes|Kubernetes]]. The project empowers technical contribution to the Wikimedia software world. The products and resources of the WMCS project are available for use by anyone connected with the [[meta:Wikimedia movement|Wikimedia movement]]. Support and administration of the WMCS resources is provided by a [[Mw:Wikimedia Cloud Services team|Wikimedia Foundation team]] and Wikimedia movement volunteers.
'''Wikimedia Cloud Services''' ('''WMCS''') is a flexible computing ecosystem built on [[W:OpenStack|OpenStack]], [[W:Oracle Grid Engine|GridEngine]], and [[W:Kubernetes|Kubernetes]]. The project empowers technical contribution to the Wikimedia software world. The products and resources of the WMCS project are available for use by anyone connected with the [[meta:Wikimedia movement|Wikimedia movement]]. Support and administration of the WMCS resources is provided by a [[Mw:Wikimedia Cloud Services team|Wikimedia Foundation team]] and Wikimedia movement volunteers.


== History ==
{{anchor|WMCS Products}}
''Eventual final branding and renaming is open for [[User:BryanDavis/Rebranding Cloud Services products|discussion]].''
== Our products ==
 
* [[Portal:Cloud VPS|Cloud VPS]] provides collaborative owned collections of virtual private servers where users develop and maintain software projects that help the Wikimedia movement.
* [[Portal:Toolforge|Toolforge]] provides a shared hosting/platform as a service environment for running bots, webservices, scheduled jobs, and data analysis.
* [[Portal:Data Services|Data Services]] is a collection of products including private-information-redacted copies of Wikimedia's production wiki databases and access to [[Dumps.wikimedia.org|Wikimedia Dumps]]
 
{{anchor|What Product Should I Use}}
== Which product should I use? ==
 
=== VPS → [[Portal:Cloud VPS|Cloud VPS]] ===
If you need to run full virtual instances and are willing to administer them on your own we can provide quota to do so. 
 
=== PaaS → [[Portal:Toolforge|Toolforge]] ===
If you need to run a specific webservice, scheduled job, or perform analysis but do not want to or are not able to manage a full virtual environment, this is the best place.
 
=== DaaS → [[Portal:Data Services|Data Services]] ===
We provide replicas of the production databases and other data for analysis and experimentation.  DaaS resources are available from both the VPS and the PaaS environments, though some of them may need to be requested for a specific VPS Project. In addition, the [https://quarry.wmflabs.org/ Quarry service] provides database access via a web interface without project setup.


Working titles are now in use across some documentation. The generic compute/'Labs' environment for running your own virtual instances is being referred to now as "VPS" and Tool Labs/Tools which is the PaaS environment is now being referred to as "ToolForge".
== Terms of Use ==
* All WMCS resources are subject to the [[Wikitech:Labs_Terms_of_use|Wikimedia Labs Terms of Use]] and the [[mw:Code of Conduct|Code of Conduct for technical spaces]].
* Toolforge tools must be [[w:Open-source software|open source software]] licensed under an [http://opensource.org/licenses OSI approved license].
* Toolforge and Cloud VPS projects must not collect, store, or share private data or personally identifiable information, such as user names, passwords, or IP addresses, except when complying with the conditions listed in the [[Wikitech:Labs_Terms_of_use|Wikimedia Labs Terms of Use]].


----------
== Joining and Participating ==


From 2011 until early 2017, WMCS was known as "Wikimedia Labs".
[[Help:Terminology|Wikitech Account Holders]] are governed by the [[Project:Labs Terms of use|Labs terms of use]], the [[Help:Rules|Rules]], and the [[mw:Code of Conduct|Code of Conduct for technical spaces]]. The [[mw:Wikimedia Labs/Agreement to disclosure of personally identifiable information|agreement to disclosure of personally identifiable information]] covers [[Help:Terminology|End-Users]].


The term 'Labs' became [[Labs labs labs|overloaded]] and often required clarification about what component of the ecosystem was being referred to. The former Wikimedia Foundation Labs team and the Tool Labs Support team have joined forces as the Wikimedia Cloud Services team and are launching a campaign to improve the language and branding surrounding products and services offered.
Read our [[Help:Getting_Started|Getting Started]] guide for detailed information on creating accounts and becoming active in our projects.


== WMCS Products ==
== Support and Administration ==
* [[Portal:Wikimedia Labs|Virtual Private Servers ('''VPS''')]] for users to develop and maintain projects that help Wikimedia. 
* [[Portal:Tool Labs|ToolForge Platform as a Service]] ('''PaaS''') environment for running bots, webservices, scheduled jobs, and doing analysis
* [[Portal:Data_Services|Data Services]] ('''DaaS''') offerings that include a real-time and sanitized production database replica, and NFS access to [[Dumps.wikimedia.org|Wikimedia Dumps]]


== What Product Should I Use ==
We use Phabricator ([[phab:project/profile/832/|workboard]]), an [[Help:IRC|IRC]] channel ({{Irc|wikimedia-cloud}}), and email list ([https://lists.wikimedia.org/mailman/listinfo/cloud cloud]) as primary support channels.


=== [[Portal:Wikimedia_Labs|VPS]] => [[Portal:Wikimedia_Labs|Wikimedia VPS]] ===
Wikimedia Cloud Services are a joint effort between Wikimedia Foundation staff and many dedicated volunteers:
If you need to run full virtual instances and are willing to administer them on your own we can provide quota to do so. 
* [[mw:Wikimedia Cloud Services team|Wikimedia Cloud Services team]]
* [[mw:Wikimedia Technical Operations|Wikimedia Technical Operations]]
* [[meta:Community Liaisons|Community Liaisons]]
* [[Help:Toolforge/Toolforge standards committee|Toolforge standards committee]]
* [[phab:project/members/832/|Phabricator participants]]
* [[toollabs:openstack-browser/project/|Cloud VPS project]] maintainers
* [https://tools.wmflabs.org/?list Toolforge tool] maintainers
* and many more people who help by creating and maintaining documentation on this wiki and others in the Wikimedia movement


=== [[Portal:Tool_Labs| PaaS]] => [[Portal:Tool_Labs|ToolForge]] ===
{{anchor|Discovery}}
If you need to run a specific webservice, scheduled job, or perform analysis but do not want to or are not able to manage a full virtual environment this is the best place.


=== [[Portal:Data_Services|DaaS]] => [[Portal:Data_Services| Data Services]] ===
== Learn more ==
We provide replicas of the production databases and other data for analysis and experimentation.  DaaS resources are available from both the VPS and the PaaS environments, though some of them may need to be requested for a specific VPS Project.  In addition, the [https://quarry.wmflabs.org/ Quarry service] provides database access via a web interface without project setup.


== Discovery ==
[[File:WMCS components.svg|thumb|upright=1.3|WMCS components]]


* Read our glossary of [[Help:Terminology|terminology]]
* Read our glossary of [[Help:Terminology|terminology]]
* Browse existing VPS projects using [[toollabs:openstack-browser/|OpenStack Browser]].
* Browse existing VPS projects using [[toollabs:openstack-browser/|OpenStack Browser]].
* Project administration is done through the OpenStack dashboard known as [https://horizon.wikimedia.org/ Horizon].
* Project administration is done through the OpenStack dashboard known as [https://horizon.wikimedia.org/ Horizon].
* ToolForge (Tools) has a [[toollabs:|homepage]] and a [[toollabs:?list|directory of Tools]]
* Toolforge (Tools) has a [[toollabs:|homepage]] and a [[toollabs:?list|directory of Tools]]


== Joining and Participating ==
;Other explanations
* [[wmfblog:/2017/09/11/introducing-wikimedia-cloud-services/|Introducing the Cloud Services Team: What we do, and how we can help you]] blog entry (September 2017)
* [[:Media:WMCS_Presentation.pdf|What is Wikimedia Cloud Services?]] presentation slides (12 pages)
* [[c:File:Introduction to Wikimedia Cloud Services.webm|Video presentation: Introduction to Wikimedia Cloud Services, at Wikimania 2017]] (56 minutes)


[[Help:Terminology|Labs Account Holders]] are governed by the [[Project:Labs Terms of use|Labs terms of use]] and the [[Help:Rules|Rules]]. The [[Mw:Wikimedia Labs/Agreement to disclosure of personally identifiable information|agreement to disclosure of personally identifiable information]] covers [[Help:Terminology|End-Users]].
== History ==
:''A community consultation on branding has now been closed after an open call for participation and [[User:BryanDavis/Rebranding Cloud Services products|discussion]].''


[[Help:Getting_Started|Getting Started]]
We are [[phab:phame/post/view/59/labs_and_tool_labs_being_renamed/|actively working to rebrand the WMCS products]]. Working titles are now in use across some documentation. The generic compute/'Labs' environment for running your own virtual instances is being referred to now as "Cloud VPS" and the Tool Labs PaaS environment is now being referred to as "Toolforge".


We are on [[Help:IRC|IRC]]
----------


== Terms of Use ==
From 2011 until early 2017, WMCS was known as "Wikimedia Labs". The term 'Labs' became [[Labs labs labs|overloaded]] and often required clarification about what component of the ecosystem was being referred to. The former Wikimedia Foundation Labs team and the Tool Labs Support team have joined forces as the Wikimedia Cloud Services team and are launching a campaign to improve the language and branding surrounding products and services offered.
* WMCS resources are subject to the [[Wikitech:Labs_Terms_of_use|Wikimedia Labs Terms of Use]].
* Tools must be [[W:Open-source software|open source software]] licensed under an [http://opensource.org/licenses OSI approved license].
* Tools must not collect, store, or share private data or personally identifiable information, such as user names, passwords, or IP addresses, except when complying with the conditions listed in the [[Wikitech:Labs_Terms_of_use|Wikimedia Labs Terms of Use]].


== Media ==


* [[File:WMCS_Presentation.pdf|What is Wikimedia Cloud Service?]]
[[Category:Documentation]]

Revision as of 00:01, 29 September 2017

Poster-format overview

Wikimedia Cloud Services (WMCS) is a flexible computing ecosystem built on OpenStack, GridEngine, and Kubernetes. The project empowers technical contribution to the Wikimedia software world. The products and resources of the WMCS project are available for use by anyone connected with the Wikimedia movement. Support and administration of the WMCS resources is provided by a Wikimedia Foundation team and Wikimedia movement volunteers.

Our products

  • Cloud VPS provides collaborative owned collections of virtual private servers where users develop and maintain software projects that help the Wikimedia movement.
  • Toolforge provides a shared hosting/platform as a service environment for running bots, webservices, scheduled jobs, and data analysis.
  • Data Services is a collection of products including private-information-redacted copies of Wikimedia's production wiki databases and access to Wikimedia Dumps

Which product should I use?

VPS → Cloud VPS

If you need to run full virtual instances and are willing to administer them on your own we can provide quota to do so.

PaaS → Toolforge

If you need to run a specific webservice, scheduled job, or perform analysis but do not want to or are not able to manage a full virtual environment, this is the best place.

DaaS → Data Services

We provide replicas of the production databases and other data for analysis and experimentation. DaaS resources are available from both the VPS and the PaaS environments, though some of them may need to be requested for a specific VPS Project. In addition, the Quarry service provides database access via a web interface without project setup.

Terms of Use

Joining and Participating

Wikitech Account Holders are governed by the Labs terms of use, the Rules, and the Code of Conduct for technical spaces. The agreement to disclosure of personally identifiable information covers End-Users.

Read our Getting Started guide for detailed information on creating accounts and becoming active in our projects.

Support and Administration

We use Phabricator (workboard), an IRC channel (#wikimedia-cloud connect), and email list (cloud) as primary support channels.

Wikimedia Cloud Services are a joint effort between Wikimedia Foundation staff and many dedicated volunteers:

Learn more

WMCS components
Other explanations

History

A community consultation on branding has now been closed after an open call for participation and discussion.

We are actively working to rebrand the WMCS products. Working titles are now in use across some documentation. The generic compute/'Labs' environment for running your own virtual instances is being referred to now as "Cloud VPS" and the Tool Labs PaaS environment is now being referred to as "Toolforge".


From 2011 until early 2017, WMCS was known as "Wikimedia Labs". The term 'Labs' became overloaded and often required clarification about what component of the ecosystem was being referred to. The former Wikimedia Foundation Labs team and the Tool Labs Support team have joined forces as the Wikimedia Cloud Services team and are launching a campaign to improve the language and branding surrounding products and services offered.