You are browsing a read-only backup copy of Wikitech. The live site can be found at wikitech.wikimedia.org

Difference between revisions of "Redis"

From Wikitech-static
Jump to navigation Jump to search
imported>Harej
(tool labs --> toolforge)
imported>Krinkle
(fix link)
Line 1: Line 1:
{{Navigation Wikimedia infrastructure|expand=mw}}
{{Navigation Wikimedia infrastructure|expand=mw}}
:See also [[Nova Resource:Tools/Redis]] for the Toolforge service.
{{See|For the Redis service at Toolforge, see  [[Nova Resource:Tools/Redis]].}}
 
'''Redis''' is used in Wikimedia production for:
Redis cache is used in production for caching of
* the MediaWiki [[job queue]]
* the MediaWiki [[job queue]]
* [[user sessions]]
* stashing user sessions ([[mw:Manual:$wgSessionCacheType|$wgSessionCacheType]])
* lists of log messages that are processed by [[logstash]]
* log messages processed by [[Logstash]]


Check puppet and {{config file|ProductionServices.php}} for <code>jobqueue_aggregator</code> to see where it runs (as of August 2016 the servers are rdb1001, rdb1003, rdb1005 and rdb1007).
Check puppet and {{config file|ProductionServices.php}} for <code>jobqueue_aggregator</code> to see where it runs (as of August 2016 the servers are rdb1001, rdb1003, rdb1005 and rdb1007).


[[mw:MediaWiki-Vagrant|MediaWiki-Vagrant]] and [[Help:MediaWiki-Vagrant in Labs|MediaWiki-Vagrant in Labs]] are configured by default to use redis for [[mw:Manual:$wgMainCacheType|$wgMainCacheType]], [[mw:Manual:$wgMainCacheType$wgSessionCacheType|$wgSessionCacheType]], etc.
[[mw:MediaWiki-Vagrant|MediaWiki-Vagrant]] and [[Help:MediaWiki-Vagrant in Labs|MediaWiki-Vagrant in Labs]] are configured by default to use redis for [[mw:Manual:$wgMainCacheType|$wgMainCacheType]], [[mw:Manual:$wgSessionCacheType|$wgSessionCacheType]], etc.


== Usage ==
== Usage ==

Revision as of 02:14, 29 November 2017

Wikimedia infrastructure

[edit]

Redis is used in Wikimedia production for:

Check puppet and ProductionServices.php for jobqueue_aggregator to see where it runs (as of August 2016 the servers are rdb1001, rdb1003, rdb1005 and rdb1007).

MediaWiki-Vagrant and MediaWiki-Vagrant in Labs are configured by default to use redis for $wgMainCacheType, $wgSessionCacheType, etc.

Usage

Connecting

You can use the redis-cli utility to make queries against redis. In order to make queries against redis, you need to be on a production server such as tin that can access the servers, and give the command

redis-cli -a password-here -h rdb1001

(Grab the password out of /srv/mediawiki/wmf-config/PrivateSettings.php on tin, the server where it runs, look for $wmgRedisPassword in it.)

This will leave you at a redis prompt where you can enter commands interactively.

Some useful commands

info will give you a pile of status information about the server, including the number of keys near the end of the output.

keys pattern-here will give you a list of all keys matching the given pattern. Use this sparingly, there's a lot of keys in there and the query will take (at least) several seconds to complete.

quit closes the connection.

Other references

Commands are easy, they all depend on the data type (hash, set, list, etc). Here's a quick reference.

Configuration is likewise pretty straightforward with perhaps the exception of the snapshotting, aof and memory settings; here's the sample config file.

See also

  • memcached
  • nutcracker (AKA twemproxy), the proxy used by all application servers to contact memcached (but not redis as of 2015, except it does again as of 2016)