You are browsing a read-only backup copy of Wikitech. The live site can be found at wikitech.wikimedia.org

Switch Datacenter/DeploymentServer

From Wikitech-static
< Switch Datacenter
Revision as of 23:28, 30 August 2020 by imported>RLazarus (typo)
(diff) ← Older revision | Latest revision (diff) | Newer revision → (diff)
Jump to navigation Jump to search

This page describes the procedure to switch over the master deployment server from one host to another.

Procedure

  • Disable puppet on deployment servers:

sudo cumin 'R:class = role::deployment_server' 'disable-puppet "Switchover of the deployment server"'

  • Merge a DNS change that points all the deployment CNAME to the new master hosts, see this change.
  • Change deployment_server and scap::deployment_server variables in hiera, see this change.
  • Run puppet on the new master
  • Run puppet on all the other servers
  • Verify the new master doesn't have the cronjob for rsyncing /srv/deployment (shown by sudo crontab -l | grep -A1 sync_deployment_dir)
  • Remove scap lock from the new master:

rm -v /var/lock/scap-global-lock