You are browsing a read-only backup copy of Wikitech. The live site can be found at wikitech.wikimedia.org

Difference between revisions of "SRE tooling"

From Wikitech-static
Jump to navigation Jump to search
imported>Volans
m (Add wmflib)
imported>Ayounsi
(adding turnilo)
 
Line 25: Line 25:
* [https://tendril.wikimedia.org/ tendril.w.o]: database cluster analytics and performance Web UI. See also [[Tendril]].
* [https://tendril.wikimedia.org/ tendril.w.o]: database cluster analytics and performance Web UI. See also [[Tendril]].
*[https://librenms.wikimedia.org/ librenms.w.o]: Network-specific monitoring platform. See also [[LibreNMS]].
*[https://librenms.wikimedia.org/ librenms.w.o]: Network-specific monitoring platform. See also [[LibreNMS]].
*[https://turnilo.wikimedia.org/ turnilo.w.o]: Managed by Analytics but also used by SRE, especially the wmf_netflow and webrequest_sampled_128 datasets.


=== Authoritative Web UI ===
=== Authoritative Web UI ===


* [https://netbox.wikimedia.org/ netbox.w.o]: data center infrastructure management (DCIM) and IP address management (IPAM) Web UI, a.k.a. "''the source of truth''". See also [[Netbox]].
* [https://netbox.wikimedia.org/ netbox.w.o]: data center infrastructure management (DCIM) and IP address management (IPAM) Web UI, a.k.a. "''the source of truth''". See also [[Netbox]].

Latest revision as of 15:08, 14 June 2021

List of automation tools and libraries, reporting and authoritative Web UIs used by the SRE team.

Tools

  • Python/Wmflib: a Python package that contains custom modules to interact with the WMF production infrastructure, installable in any host.
  • Cumin: parallel remote execution CLI tool and Python library with fine-grained target selection and output deduplication.
  • Conftool: high level CLI tool and Python library to manage the live state stored in etcd. Load Balanced Services And Conftool has further information on scripts used to operate on clustered services.
  • Dbctl: conftool extension to specifically manage MediaWiki's database configuration in etcd.
  • Spicerack: centralized Python library to automate task, has modules to interact with most components of the infrastructure.
  • Cookbooks: Python scripts that adhere to Spicerack's API and allow to automate tasks using Spicerack functionalities.
  • Debdeploy: CLI tool to check and upgrade Debian packages.
  • Homer: network devices configuration management CLI tool.
  • wmf-auto-reimage: legacy set of Python CLI tools to perform physical hardware full OS reimage (wmf-auto-reimage and wmf-auto-reimage-host). [WIP convert them into cookbooks]
  • WMFMariadbpy, work in progress library to automate administration of Wikimedia MySQL/MariaDB instances

Reporting Web UI

Authoritative Web UI

  • netbox.w.o: data center infrastructure management (DCIM) and IP address management (IPAM) Web UI, a.k.a. "the source of truth". See also Netbox.