You are browsing a read-only backup copy of Wikitech. The live site can be found at wikitech.wikimedia.org

shortcut: mwgrep

Wikimedia binaries: Difference between revisions

From Wikitech-static
Jump to navigation Jump to search
imported>Chad
(→‎scap: stop mentioning sync-dir)
imported>Chad
(→‎scap: This is all a lie. It's not installed via puppet like that, and it's not in /usr/local/bin)
Line 9: Line 9:
=== <code>fatalmonitor</code> ===
=== <code>fatalmonitor</code> ===
* Runs a [[wikipedia:watch (Unix)|<code>watch</code>]] command on the [[Logs#mwlog1001:/a/mw-log/|hhvm logs]] with various exclusion and aggregation filters to monitor current php notices, warnings and errors on the cluster. This script lives on [[mwlog1001]].
* Runs a [[wikipedia:watch (Unix)|<code>watch</code>]] command on the [[Logs#mwlog1001:/a/mw-log/|hhvm logs]] with various exclusion and aggregation filters to monitor current php notices, warnings and errors on the cluster. This script lives on [[mwlog1001]].
=== scap ===
[[Scap|<code>scap</code>]] is the Wikimedia deployment tool.
'''subtasks''': {{anchor|sync-common}}[[Scap#scap_pull|<code>scap pull</code>]], {{anchor|sync-file}}[[Scap#scap_sync-file|<code>scap sync-file</code>]], {{anchor|sync-wikiversions}}[[Scap#scap_sync-wikiversions|<code>scap sync-wikiversions</code>]], {{anchor|scap}}[[Scap#scap_sync|<code>scap sync</code>]]


=== <code>mwgrep</code> ===
=== <code>mwgrep</code> ===

Revision as of 01:07, 19 September 2017

The following executable binaries are maintained in version control (operations/puppet:/files/misc/scripts) and copied/synced to servers (such as tin) by puppet into /usr/local/bin.

bin

apache-fast-test

This script comes from puppet.

fatalmonitor

  • Runs a watch command on the hhvm logs with various exclusion and aggregation filters to monitor current php notices, warnings and errors on the cluster. This script lives on mwlog1001.

mwgrep

Search for CSS and JavaScript code fragments in MediaWiki, User and Module namespaces pages on all Wikimedia projects (powered by Elasticsearch).

It's located in operations/puppet/modules/scap/files/mwgrep

expanddblist

For convenience, this utility is also available as bin/expanddblist in any checkout of operations/mediawiki-config.git.

Usage: expanddblist [<dblist>, <dblistname> or <expression>]

Example:

./bin/expanddblist flow_computed > dblists/flow.dblist

All-script

An all-script is a script that operates on mediawiki-installation boxes via ssh. These scripts performs the action on all servers.

The specific servers include:

Purge

Sometimes you may need to purge a URL from Varnish cache.

In most cases this is enough. However if the change involves more than a simple change to redirects, depooling/ repooling may be necessary. Make sure you find out whether this is needed ahead of time.

See also