You are browsing a read-only backup copy of Wikitech. The primary site can be found at wikitech.wikimedia.org

Traffic cache hardware: Difference between revisions

From Wikitech-static
Jump to navigation Jump to search
imported>BBlack
imported>BBlack
 
Line 13: Line 13:
| L || Dell R430 || 2x Xeon E5-2650 v4 @ 2.20GHz || 24 || 384 GB || 2x Intel S3710 800GB SSD || 10G, BCM57810, bnx2x || Legacy
| L || Dell R430 || 2x Xeon E5-2650 v4 @ 2.20GHz || 24 || 384 GB || 2x Intel S3710 800GB SSD || 10G, BCM57810, bnx2x || Legacy
|-
|-
| F || Dell R440 || 2x Xeon Gold 5118 @ 2.3Ghz || 24 || 384 GB || 1x Samsung PM1725b 1.6TB NVMe (HHHL Card) || 10G, BCM57412, bnxt || F-10G, add custom Cache Storage card
| F1 || Dell R440 || 2x Xeon Gold 5118 @ 2.3Ghz || 24 || 384 GB || 1x Samsung PM1725a 1.6TB NVMe (U.2 SFF) || 10G, BCM57412, bnxt || F-10G, +storage card
|-
| F2 || Dell R440 || 2x Xeon Gold 5118 @ 2.3Ghz || 24 || 384 GB || 1x Samsung PM1725b 1.6TB NVMe (HHHL Card) || 10G, BCM57412, bnxt || F-10G, +storage card
|-
| F3 || Dell R440 || 2x Xeon Gold 5118 @ 2.3Ghz || 24 || 384 GB || 1x Samsung PM1725b 1.6TB NVMe (HHHL Card) || 10/25G, BCM57412, bnxt || F-10G, +storage card, +10/25G NIC variant
|}
|}
''Note: The first batch of F-config hosts (all 16 in eqiad) had a slightly different Cache Storage config: "1x Samsung PM1725a 1.6TB NVMe (U.2 SFF)"''
''Note: the latest batches of F-config hosts (the 4x expansion F-nodes in ulsfo, and all 16 in drmrs) have a slightly different NIC, which is still a bnxt but with a 10G/25G port.  ulsfo still uses them as 10G, while drmrs is using 25G to the switch)


= Deployed Server Hardware by Datacenter and Cluster =
= Deployed Server Hardware by Datacenter and Cluster =
Line 26: Line 26:
! Datacenter !! text !! upload !! total
! Datacenter !! text !! upload !! total
|-
|-
| eqiad || 8xF || 8xF || 16xF
| eqiad || 8x F1 || 8x F1 || 16x F1
|-
|-
| codfw || 8xF || 8xF || 16xF
| codfw || 8x F2 || 8x F2 || 16x F2
|-
|-
| esams || 8xF || 8xF || 16xF
| esams || 8x F2 || 8x F2 || 16x F2
|-
|-
| ulsfo || 6xL + 2xF || 6xL + 2xF || 12xL + 4xF = 16
| ulsfo || 6x L + 2x F3 || 6x L + 2x F3 || 12x L + 4x F3 = 16
|-
|-
| eqsin || 6xL + 2xF || 6xL + 2xF || 12xL + 4xF = 16
| eqsin || 6x L + 2x F2 || 6x L + 2x F2 || 12x L + 4x F2 = 16
|-
|-
| drmrs || 8xF || 8xF || 16xF
| drmrs || 8x F3 || 8x F3 || 16x F3
|-
|-
| total || 12xL + 36xF = 48 || 12xL + 36xF = 48 || 24xL + 72xF = 96
| total || 12x L + 36x Fn = 48 || 12x L + 36x Fn = 48 || 24x L + 72x Fn = 96
|}
|}


[[Category:Caching]]
[[Category:Caching]]

Latest revision as of 13:32, 14 January 2022

This is an overview of our currently deployed and active cache hardware at the Traffic layer.

Deployed Hardware Classes

We have purchased and retired multiple classes of server hardware over the years in staggered timeframes. In the general case we'll always have multiple overlapping classes of hardware as various warranty and support periods expire. These are the currently-active hardware configuration classes:

Label Model CPU Type/Speed Phys Cores RAM Cache Storage NIC speed, type, driver DC Ops Config
L Dell R430 2x Xeon E5-2650 v4 @ 2.20GHz 24 384 GB 2x Intel S3710 800GB SSD 10G, BCM57810, bnx2x Legacy
F1 Dell R440 2x Xeon Gold 5118 @ 2.3Ghz 24 384 GB 1x Samsung PM1725a 1.6TB NVMe (U.2 SFF) 10G, BCM57412, bnxt F-10G, +storage card
F2 Dell R440 2x Xeon Gold 5118 @ 2.3Ghz 24 384 GB 1x Samsung PM1725b 1.6TB NVMe (HHHL Card) 10G, BCM57412, bnxt F-10G, +storage card
F3 Dell R440 2x Xeon Gold 5118 @ 2.3Ghz 24 384 GB 1x Samsung PM1725b 1.6TB NVMe (HHHL Card) 10/25G, BCM57412, bnxt F-10G, +storage card, +10/25G NIC variant

Deployed Server Hardware by Datacenter and Cluster

Datacenter text upload total
eqiad 8x F1 8x F1 16x F1
codfw 8x F2 8x F2 16x F2
esams 8x F2 8x F2 16x F2
ulsfo 6x L + 2x F3 6x L + 2x F3 12x L + 4x F3 = 16
eqsin 6x L + 2x F2 6x L + 2x F2 12x L + 4x F2 = 16
drmrs 8x F3 8x F3 16x F3
total 12x L + 36x Fn = 48 12x L + 36x Fn = 48 24x L + 72x Fn = 96