You are browsing a read-only backup copy of Wikitech. The live site can be found at wikitech.wikimedia.org

Infographics: Difference between revisions

From Wikitech-static
Jump to navigation Jump to search
imported>Quiddity
(add Wikipedia_webrequest_flow_2020.png)
imported>Krinkle
(15 intermediate revisions by 3 users not shown)
Line 1: Line 1:
A compilation of images from scattered locations. Update/overhaul freely!
:'''''See also: [[Wikimedia infrastructure#Current infographics]]'''''
:''See also: [[Special:ListFiles]]''
:''See also: [[c:Category:Wikimedia technology|commons:Category:Wikimedia technology]] -> [[c:Category:Wikimedia technical operations|commons:Category:Wikimedia technical operations]] -> [[c:Category:Wikimedia Cloud Services|commons:Category:Wikimedia Cloud Services]] (etc)''
:''See also: [[Performance/Runbook/diagrams.net conventions]]''
 
== Data center overview ==
{{Main|Data centers}}
<gallery>
File:WMF infrastructure 2022.png|2022-08
File:Infrastructure overview.png|2019-10
File:Infrastructure overview 18 January 2016 (draft).png|alt=|2016-01
File:Wikimedia-servers-2010-12-28.svg|2010-12-28
File:Wikimedia-servers-2009-04-05.svg|2009-04-05
File:Wikimedia-servers-2008-11-10.svg|2008-11-10
File:Wikimedia Servers.svg|2006-03-12
File:Wikimedia-servers-2006-05-09.svg|2006-05-09
File:Wikimedia cluster.jpg|alt=|2005-11
File:Wikimedia-servers-2005-04-12.png|2005-04-12
File:Wikimedia-servers-2005-01-30.png|2005-01-30
File:Wikimedia-servers-2004-12-10.png|2004-12-10
File:Wikimedia-servers-2004-11-11.png|2004-11-11
File:Wikimedia-servers-2004-08-26.png|2004-08-26
File:Wikimedia-servers-2004-08-24.png|2004-08-24
File:Wikimedia-servers-2004-02-19-800wide.png|2004-02-19
</gallery>
 
== MediaWiki architecture ==
{{Main|MediaWiki at WMF}}
<gallery>
File:Wikipedia webrequest 2022.png|August 2022
File:Wikipedia webrequest flow 2020.png|April 2020
File:Wikipedia webrequest flow 2015-10.png|October 2015
File:Wikimedia Server Architecture (simplified).svg|October 2013: core architecture of a single datacenter.
</gallery>
 
== Databases ==
<gallery>
File:Wikimedia-relational-databases-2022.png|Diagram of sections and how they get reads/writes – 2022-09
</gallery>
* [https://www.mediawiki.org/w/index.php?title=Manual:Database_layout/diagram&action=render MediaWiki's database layout]
 
== Traffic ==
{{Main|Global traffic routing}}
<gallery>
File:WMF Varnish and Swift.svg|alt=|2015-12-04 Varnish and Swift
File:WMF Inbound Text Traffic Diagram.svg|2015-02-02
</gallery>
 
== Networking ==
{{Main|Network design}}<gallery>
File:Wikimedia network overview.png|alt=|2022-02 (includes back to 2018 in previous file revisions).
File:Wikimedia Ashburn DC, physical layer.png|alt=|2018-05: Ashburn DC physical layer.
File:AS43821 2010.png|alt=|2010-02: Amsterdam network
File:SFO office network Jan 2009.png|alt=|2009-01: SF office network.
</gallery>
 
== Individual software, services, and clusters ==
<gallery>
<gallery>
File:Wikipedia_webrequest_flow_2020.png|Wikipedia webrequest flow - 2020-04
File:Wikipedia Memcached flow 2022.png|Memcached configuration, 2022-08
File:ResourceLoader_Client_lifecycle_2020.png|ResourceLoader Client lifecycle - 2020-04
File:New service IP flow chart.png|New service IP flow chart - 2021-04
File:Wikifunctions - Top-level architectural model.svg|Wikifunctions - Top-level architectural model - 2021-01
File:Wikipedia Memcached flow 2020.png|Memcached configuration, 2020-11
File:WMCS network-L2 L3.png|WMCS network-L2 L3 - 2020-10
File:MediaWiki fallback chains.svg|MediaWiki language fallback chains - 2020-07
File:PAWS Design.png|basic setup and flows of the newer PAWS cluster - 2020-07
File:ResourceLoader Client lifecycle 2020.png|ResourceLoader Client lifecycle - 2020-04
File:Modern Event Platform Architecture Diagram.jpeg|Event Platform Architecture - 2020-04
File:Analytics Kerberos infra scheme.svg|Analytics Kerberos infrastructure - 2019-11
File:Analytics Kerberos infra scheme.svg|Analytics Kerberos infrastructure - 2019-11
File:Modern Event Platform Architecture Diagram.jpeg|Event Platform Architecture - 2019-11
File:Infrastructure overview.png|Infrastructure overview - 2019-10
File:Toolforge k8s network topology.png|Toolforge k8s network topology - 2019-10
File:Toolforge k8s network topology.png|Toolforge k8s network topology - 2019-10
File:Database_backups_overview.svg|Architecture of Wikimedia Foundation infrastructure Database backups - 2019-03
File:RBACandPSPforToolforge.png|Pod Security Policies (proposal) - 2019-09
File:Wikidata Query Service components.svg|2019, [[Wikidata Query Service]] components
File:Database backups overview.svg|Architecture of Wikimedia Foundation infrastructure Database backups - 2019-03
File:CirrusSearch components.svg|CirrusSearch components diagram - 2019-02
File:CirrusSearch components.svg|CirrusSearch components diagram - 2019-02
File:Wikidata Query Service components.svg|Component diagram for Wikidata Query Service - 2019-02
File:Wikidata Query Service components.svg|Component diagram for Wikidata Query Service - 2019-02
Line 18: Line 81:
File:Eqiad1 network topology.png|network diagram for the CloudVPS eqiad1 openstack deployment - 2018-08
File:Eqiad1 network topology.png|network diagram for the CloudVPS eqiad1 openstack deployment - 2018-08
File:OpenStack at WMCS.pdf|OpenStack at WMCS - 2018-05
File:OpenStack at WMCS.pdf|OpenStack at WMCS - 2018-05
File:Wikimedia network overview.png|Wikimedia network overview - 2018-05 (more at [[Network design]])
File:WDCM System Operation Workflow.png|WDCM System Operation Workflow: an overview of the WDCM monthly update - 2018-01
File:Wikimedia Ashburn DC, physical layer.png|Wikimedia Ashburn DC, physical layer - 2018-05 (more at [[Network design]])
File:Wm technical areas.svg|Wikimedia Technical Areas - 2018-05
File:WDCM_System_Operation_Workflow.png|WDCM System Operation Workflow: an overview of the WDCM monthly update - 2018-01
File:Logic model for onboarding new developers annual program.svg|Logic model for onboarding new developers annual program - 2017-6
File:Containerized continuous delivery 2017 concept.png|Containerized continuous delivery 2017 concept - 2017
File:Containerized continuous delivery 2017 concept.png|Containerized continuous delivery 2017 concept - 2017
File:Wikireplicas.png|Architecture of wikireplicas - 2017-11
File:Wikireplicas.png|Architecture of wikireplicas - 2017-11
File:Frontend resource loading in MediaWiki.png|Simple overview image about how MW loads resources in clients - 2017-11
File:Frontend resource loading in MediaWiki.png|Simple overview of how MW loads cliient-side resources, 2017-11.
File:New_article_routing.with_ORES.svg|maps the flow of new articles in Wikipedia with the 'draftquality' and 'articletopic' ORES models used for routing - 2017-08
File:New article routing.with ORES.svg|maps the flow of new articles in Wikipedia with the 'draftquality' and 'articletopic' ORES models used for routing - 2017-08
File:Labs Tools topology.png|labs tools topology - 2016-10
File:Labs Tools topology.png|labs tools topology - 2016-10
File:Maps-components.png|Maps-components - 2016-08
File:Maps-components.png|Maps-components - 2016-08
Line 31: Line 94:
File:Irc-rcstream-sequence.svg|Irc-rcstream-sequence (draft) - 2016-02
File:Irc-rcstream-sequence.svg|Irc-rcstream-sequence (draft) - 2016-02
File:WMF Varnish and Swift.svg|Diagram of traffic flow for image traffic through Varnish to Swift - 2015-12
File:WMF Varnish and Swift.svg|Diagram of traffic flow for image traffic through Varnish to Swift - 2015-12
File:Wikipedia webrequest flow 2015-10.png|Wikipedia webrequest flow 2015-10
File:Scap-diagram.png|Scap-diagram - 2015-04
File:Scap-diagram.png|Scap-diagram - 2015-04
File:MediaWiki fallback chains.svg|MediaWiki language fallback chains - 2015-04
File:MediaWiki 1.24.1 database schema.svg|2015-03: MediaWiki database schema. Latest version at [[mw:Manual:Database layout/diagram|mw:Manual:Database layout]].
File:MediaWiki 1.24.1 database schema.svg|database schema - 2015-03 - See also [[dbtree.wikimedia.org]]
File:WMF Inbound Text Traffic Diagram.svg|WMF Inbound Text Traffic Diagram - 2015-02
File:Analytics Cluster Diagram.png|Analytics Cluster Webrequest ingestion diagram - 2014-07
File:Analytics Cluster Diagram.png|Analytics Cluster Webrequest ingestion diagram - 2014-07
File:Wikimedia Server Architecture (simplified).svg|simplified version of the Wikimedia server infrastructure, showing the core architecture of a single datacenter - 2013-10
File:Logging current.png|Logging current - 2013-08
File:Logging current.png|Logging current - 2013-08
File:Logging future.png|Logging future - 2013-08
File:Logging future.png|Logging future - 2013-08
Line 46: Line 105:
File:External storage cluster-2.png|External storage cluster - 2011-11
File:External storage cluster-2.png|External storage cluster - 2011-11
File:Thumbnail request path all swift v3.jpg|Thumbnail request path all swift v3 - 2011-08
File:Thumbnail request path all swift v3.jpg|Thumbnail request path all swift v3 - 2011-08
File:Virtual architecture diagram.svg|Test/Dev Architecture - 2011-04 (See also [[:File:The Site Architecture You Can Edit.pdf]])
File:Virtual architecture diagram.svg|Test/Dev Architecture - 2011-04 (See also [[:File:The Site Architecture You Can Edit.pdf]])  
File:Wikimedia-servers-2010-12-28.svg|Wikimedia servers - 2010-12
File:AS43821 2010.png|Wikimedia Amsterdam Network - 2010-02
File:SFO office network Jan 2009.png|SFO office network - 2009-01
File:Wikimedia cluster.jpg|Wikimedia cluster - 2005-11
</gallery>
</gallery>
And more in:  
 
== See also ==
 
* [[File:Commons-logo.svg|border|20x20px]][[c:Category:Wikimedia_servers_by_location|Wikimedia data center photos]] and [[c:Category:Wikimedia servers diagrams|Wikimedia server diagrams]] on Wikimedia Commons.
 
* [[:Category:Wikimedia infrastructure]]
* [[:Category:Wikimedia infrastructure]]
* [[c:Category:Wikimedia servers diagrams]]
* Call graphs [[mailarchive:wikitech-l/2016-November/086971.html|by Seb35]] in 2016
* [[m:Server layout diagrams]]
 
Also:
* call graphs [https://lists.wikimedia.org/pipermail/wikitech-l/2016-November/086971.html by Seb35] in 2016
** [[mw:File:Call graph of extension Math.svg]]
** [[mw:File:Call graph of extension Math.svg]]
** [[mw:File:Call graph of extension CentralAuth.svg]]
** [[mw:File:Call graph of extension CentralAuth.svg]]
** [[mw:File:Call graph of extension MediaWikiFarm.svg]]
** [[mw:File:Call graph of extension MediaWikiFarm.svg]]
Related:
<gallery>
File:Wm_technical_areas.svg|Wikimedia Technical Areas - 2018-05
File:Logic model for onboarding new developers annual program.svg|Logic model for onboarding new developers annual program - 2017-6
</gallery>

Revision as of 00:12, 27 September 2022

See also: Wikimedia infrastructure#Current infographics
See also: Special:ListFiles
See also: commons:Category:Wikimedia technology -> commons:Category:Wikimedia technical operations -> commons:Category:Wikimedia Cloud Services (etc)
See also: Performance/Runbook/diagrams.net conventions

Data center overview

Main article: Data centers

MediaWiki architecture

Main article: MediaWiki at WMF

Databases

Traffic

Main article: Global traffic routing

Networking

Main article: Network design
  • 2022-02 (includes back to 2018 in previous file revisions).

  • 2018-05: Ashburn DC physical layer.

  • 2010-02: Amsterdam network

  • 2009-01: SF office network.

  • Individual software, services, and clusters

    See also