You are browsing a read-only backup copy of Wikitech. The live site can be found at wikitech.wikimedia.org

Performance/Runbook/Arc Lamp service

From Wikitech-static
Jump to navigation Jump to search

This is the runbook for deploying and monitoring Arc Lamp (formerly known as "xenon-log").

Hosts

The puppet role for these services is role::webperf:profiling_tools. We currently run one arclamp host in each core data center (Eqiad and Codfw). You can monitor these via the Grafana host overview dashboard. There's also an equivalent deployment-webperfXX host in the Beta Cluster.

Service

Arc Lamp data originates from application servers (using php-excimer), which sent to a Redis instance on the mwlog host, from which the Arc Lamp servicec then reads it. The flame graphs are generated using brendangregg/FlameGraph.

Architecture of Arc Lamp (as of December 2019).

Meta

External links