You are browsing a read-only backup copy of Wikitech. The live site can be found at wikitech.wikimedia.org

Help:Toolforge/My first Pywikibot tool: Difference between revisions

From Wikitech-static
Jump to navigation Jump to search
imported>BryanDavis
(tool-labs -> toolforge)
 
imported>Xephyr826
Line 1: Line 1:
{{draft}}
{{draft}}
[[mw:Manual:Pywikibot|Pywikibot]] is a [[w:Python_(programming_language)|Python]] library which automates work on MediaWiki sites. Use this guide to create your own tool based on Pywikibot and host it on [[Help:Toolforge|Toolforge]].
[[mw:Manual:Pywikibot|Pywikibot]] is a [[w:Python_(programming_language)|Python]] library which automates work on MediaWiki sites. Use this guide to create your own tool based on Pywikibot and host it on the [[Help:Toolforge|Toolforge]] hosting enviornment.


__TOC__
__TOC__


'''Toolforge account required:'''
== Request access to Toolforge ==
Before creating your tool, you need to [[Help:Tool_Labs/Getting_started#Creating_your_account|create an account to access Toolforge]]. Set up your user name and shell name and submit a [https://toolsadmin.wikimedia.org/tools/membership/apply Toolforge project membership request].
 
Before creating your tool, you need to create a Wikimedia developer account and request access Toolforge:
 
# [https://toolsadmin.wikimedia.org/register/ Create a Wikimedia developer account from the Toolforge admin console]. This account is used for most developer activities including editing this wiki, accessing code repositories, and accessing the bug tracking system. Take note of your ''LDAP username'' and your ''UNIX shell username'':
#* '''LDAP username''': used to log into this wiki, [[:mw:Gerrit|Gerrit]], and the [https://toolsadmin.wikimedia.org/ Toolforge admin console].
#* '''UNIX shell username''': used when you interact with servers using [[Help:Access|ssh]] and when using [[:mw:Gerrit/Getting_started|git with Gerrit]].
# [https://toolsadmin.wikimedia.org/tools/membership/apply Fill out an access request to join the Toolforge project]. You will receive a reply on your [[Special:MyTalk | Wikitech talk page]].
 
=== Accessing Toolforge for the first time ===
 
Once your request to access Toolforge is approved, you can set up [[Help:Access|ssh]] access to Toolforge severs:
 
==== Generate a new SSH key for your account ====
<ol>
<li>From a Linux terminal, you can generate a new ssh key using the <code>ssh-keygen</code> command:
<pre>ssh-keygen -t rsa -C "your_email@youremail.com"</pre>
Select a passphrase for your ssh key and press '''Enter'''. The command will create two files in your <code>~/.ssh</code> directory:
<pre>
~/.ssh/id_rsa : identification (private) key
~/.ssh/id_rsa.pub : public key
</pre>
</li>
<li>Add your public key to your Wikimedia developer account in the [https://toolsadmin.wikimedia.org/profile/settings/ssh-keys SSH Keys page of the Toolforge admin console]. Copy the contents of <code>~/.ssh/id_rsa.pub</code> into the '''New SSH Key''' field and click '''Add SSH key'''.
</li>
</ol>
 
==== Log into Toolforge with ssh ====
After you add your public key to your Wikimedia developer account, you can use your private key to log into the Toolforge servers. From a Linux command line, use <code>ssh</code> to log in with your '''UNIX shell username''':
 
<pre>
ssh -i ~/.ssh/id_rsa <unix shell username>@login.tools.wmflabs.org
</pre>


==Create your Pywikibot Tool account==
==Create your Pywikibot Tool account==
In addition to your own Toolforge account, you also need to create a [[Help:Tool_Labs#Joining_and_creating_a_Tool_account|Tool acoount]] for your Pywikibot tool.
In addition to your own Toolforge account, you also need to create a [[Help:Toolforge#Tool_Accounts|Tool acoount]] for your Pywikibot tool.


# Navigate to the [[toollabs:|Tools home page]].
# Navigate to the [https://toolsadmin.wikimedia.org/tools/create/ Create Tool Account] page in the Toolforge admin console.
# Click '''Create a New Tool''' under '''Develop your own tool'''.
# Enter a '''Unique Tool Name''' for your tool account.<br/> Do not prefix your tool name with <code>tools.</code> as this prefix will cause errors.
# Enter a Service group name. The Service group name will become the name of your tool account.<br/> Do not prefix your service group name with <code>tools.</code>. This prefix will cause an improperly created account. The management interface automatically adds this prefix where appropriate.


'''Note:''' If you only recently received access to the tools project, you may get an error about appropriate credentials. Log out of Wikitech and back in to fix the issue.
'''Note:''' If you only recently received access to the tools project, you may get an error about appropriate credentials. Log out and back in to fix the issue.


Within a minute or two, Toolforge creates the Tool account and grants you access. If you were logged in through SSH when you created the Tool account, you must log off and log in again
Within a minute or two, Toolforge creates the Tool account and grants you access. If you were logged in through ssh when you created the Tool account, you must log off and log in again


==Access your Pywikibot tool==
==Access your Pywikibot tool==
Line 22: Line 52:


<source lang="bash">
<source lang="bash">
$ ssh <shell name>@login.tools.wmflabs.org
$ ssh <unix shell username>@login.tools.wmflabs.org
</source>
</source>


Switch to your tool account:
From the command line, switch to your tool account:
 
<source lang="bash">
become <toolname>
</source>


You should see the command prompt change to:
<source lang="bash">
<source lang="bash">
maintainer@tools-bastion:~$ become <toolname>
tools.<toolname>@tools-bastion:~$
tools.<toolname>@tools-bastion:~$
</source>
</source>

Revision as of 20:26, 31 March 2018

Pywikibot is a Python library which automates work on MediaWiki sites. Use this guide to create your own tool based on Pywikibot and host it on the Toolforge hosting enviornment.

Request access to Toolforge

Before creating your tool, you need to create a Wikimedia developer account and request access Toolforge:

  1. Create a Wikimedia developer account from the Toolforge admin console. This account is used for most developer activities including editing this wiki, accessing code repositories, and accessing the bug tracking system. Take note of your LDAP username and your UNIX shell username:
  2. Fill out an access request to join the Toolforge project. You will receive a reply on your Wikitech talk page.

Accessing Toolforge for the first time

Once your request to access Toolforge is approved, you can set up ssh access to Toolforge severs:

Generate a new SSH key for your account

  1. From a Linux terminal, you can generate a new ssh key using the ssh-keygen command:
    ssh-keygen -t rsa -C "your_email@youremail.com"

    Select a passphrase for your ssh key and press Enter. The command will create two files in your ~/.ssh directory:

    ~/.ssh/id_rsa : identification (private) key
    ~/.ssh/id_rsa.pub : public key
    
  2. Add your public key to your Wikimedia developer account in the SSH Keys page of the Toolforge admin console. Copy the contents of ~/.ssh/id_rsa.pub into the New SSH Key field and click Add SSH key.

Log into Toolforge with ssh

After you add your public key to your Wikimedia developer account, you can use your private key to log into the Toolforge servers. From a Linux command line, use ssh to log in with your UNIX shell username:

ssh -i ~/.ssh/id_rsa <unix shell username>@login.tools.wmflabs.org

Create your Pywikibot Tool account

In addition to your own Toolforge account, you also need to create a Tool acoount for your Pywikibot tool.

  1. Navigate to the Create Tool Account page in the Toolforge admin console.
  2. Enter a Unique Tool Name for your tool account.
    Do not prefix your tool name with tools. as this prefix will cause errors.

Note: If you only recently received access to the tools project, you may get an error about appropriate credentials. Log out and back in to fix the issue.

Within a minute or two, Toolforge creates the Tool account and grants you access. If you were logged in through ssh when you created the Tool account, you must log off and log in again

Access your Pywikibot tool

After you create your Pywikibot's tool account, you can log into your tool project with SSH.

$ ssh <unix shell username>@login.tools.wmflabs.org

From the command line, switch to your tool account:

become <toolname>

You should see the command prompt change to:

tools.<toolname>@tools-bastion:~$

Now, you can install Pywikibot.

Install Pywikibot

Using your tool account, do the following:

  1. Use git to download Pywikibot:
    git clone --recursive https://gerrit.wikimedia.org/r/pywikibot/core.git pywikibot-core
    cd pywikibot-core
    
  2. Set up your bot for selected wikis by running:
    python generate_user_files.py
    

Choose a license

Pywikibot comes with an MIT LICENSE file. Make sure to choose a license for your tool early on. Also see, Help:Tool_Labs/Developing#Licensing_your_source_code

Publish your source code

Documentation

Add documentation page for your tool

Set up a webpage for your tool

You can add webpage for your tool under http://tools.wmflabs.org/TOOLNAME. For example, http://tools.wmflabs.org/my-first-pywikibot-tool. Once you set up a webpage for your tool, the Tool list will link to it.

To set up webpage for you tool:

  1. Log in with your Tool account.
  2. Create a ~/public_html directory.
  3. Create ~/public_html/index.html.
  4. Start the web service:
$ webservice start