You are browsing a read-only backup copy of Wikitech. The primary site can be found at wikitech.wikimedia.org

Canary: Difference between revisions

From Wikitech-static
Jump to navigation Jump to search
imported>Lucas Werkmeister (WMDE)
(add another meaning of “canary”)
 
imported>Lucas Werkmeister (WMDE)
(clarify what happens if scap canary check fails: the code is *not* automatically rolled back to the last good version)
Line 2: Line 2:


* The [[debug servers]], e. g. mwdebug1002, are sometimes called canaries. Changes are often deployed to them via <code>scap pull</code> before deploying them everywhere with <code>scap sync</code>.
* The [[debug servers]], e. g. mwdebug1002, are sometimes called canaries. Changes are often deployed to them via <code>scap pull</code> before deploying them everywhere with <code>scap sync</code>.
* [[Scap]] has the notion of [[Scap3/Migration Guide#Canary hosts and checks|canary hosts]]: when deploying a change, it will first deploy it to a subset of servers, then pause for a bit and check their error rate. If enough canary servers experience a significantly higher error rate, the deployment is automatically rolled back.
* [[Scap]] has the notion of [[Scap3/Migration Guide#Canary hosts and checks|canary hosts]]: when deploying a change, it will first deploy it to a subset of servers, then pause for a bit and check their error rate. If enough canary servers experience a significantly higher error rate, the deployment is automatically aborted (though the canary servers continue to serve traffic with the deployed code).
* [[Deployments/One week#Group 0|group0]] wikis are sometimes called canary wikis. Problems with a new MediaWiki version may be discovered there before they start affecting the bigger wikis.
* [[Deployments/One week#Group 0|group0]] wikis are sometimes called canary wikis. Problems with a new MediaWiki version may be discovered there before they start affecting the bigger wikis.

Revision as of 13:37, 16 August 2021

The term “canary” can describe different things:

  • The debug servers, e. g. mwdebug1002, are sometimes called canaries. Changes are often deployed to them via scap pull before deploying them everywhere with scap sync.
  • Scap has the notion of canary hosts: when deploying a change, it will first deploy it to a subset of servers, then pause for a bit and check their error rate. If enough canary servers experience a significantly higher error rate, the deployment is automatically aborted (though the canary servers continue to serve traffic with the deployed code).
  • group0 wikis are sometimes called canary wikis. Problems with a new MediaWiki version may be discovered there before they start affecting the bigger wikis.