You are browsing a read-only backup copy of Wikitech. The live site can be found at wikitech.wikimedia.org

Miscweb: Difference between revisions

From Wikitech-static
Jump to navigation Jump to search
imported>Dzahn
(It was requested in {{phab|T281538}})
imported>Dzahn
(→‎Where does the code live?: Note that all the HTML content files are gzipped to reduce image size. If you want to edit HTML inside it you need to gunzip, edit and gzip, then upload to Gerrit.)
Line 3: Line 3:
It was requested in {{phab|T281538}} to replace the legacy service miscweb running on [[Ganeti]] VMs in production.
It was requested in {{phab|T281538}} to replace the legacy service miscweb running on [[Ganeti]] VMs in production.


Also see: [[miscweb1002]], [[miscweb2002]]
Since 2022-01-20 it serves production traffic for [[Microsites#Bugzilla_Archive|static-bugzilla]].


The first of the sites hosted on it that is moving over is [[Microsites#Bugzilla_Archive|static-bugzilla]].
Also see: [[miscweb1002]], [[miscweb2002]] for the legacy machines still serving other microsites.


----
----
== Sites running on miscweb k8s ==
The first of the sites hosted on miscweb-k8s is [[Microsites#Bugzilla_Archive|static-bugzilla]].
Since 2022-01-20 [https://static-bugzilla.wikimedia.org static-bugzilla.wikimedia.org] is served from k8s.
The actual switch to the new backend was [https://gerrit.wikimedia.org/r/c/operations/puppet/+/755681 made here].
Other micro-sites are going to follow this quarter.


== Where does the code live? ==
== Where does the code live? ==
The docker image is is built by the [[Deployment Pipeline]]/[[CI]] from the repo [https://gerrit.wikimedia.org/r/q/project:operations/container/miscweb operations/container/miscweb]. This is also where the actual content and webserver config can be found.
The docker image is is built by the [[Deployment Pipeline]]/[[contint|CI]] from the repo [https://gerrit.wikimedia.org/r/q/project:operations/container/miscweb operations/container/miscweb]. This is also where the actual content and webserver config can be found.


The [[helm]] charts for [[kubernetes]] are together with the other services in [https://gerrit.wikimedia.org/r/q/project:operations/deployment-charts operations/deployment-charts].
The [[helm]] charts for [[kubernetes]] are together with the other services in [https://gerrit.wikimedia.org/r/q/project:operations/deployment-charts operations/deployment-charts].
Note that all the HTML content files are gzipped to reduce image size. If you want to edit HTML inside it you need to gunzip, edit and gzip, then upload to Gerrit.


== How to deploy changes ==
== How to deploy changes ==
Line 40: Line 52:
== Service names ==
== Service names ==


  miscweb.svc.eqiad.wmnet has address 10.2.2.58
  miscweb.svc.eqiad.wmnet has address 10.2.2.58 ([[eqiad]])
miscweb.svc.codfw.wmnet has address 10.2.1.58  ([[codfw]])


  miscweb.svc.codfw.wmnet has address 10.2.1.58
  miscweb.discovery.wmnet has address 10.2.2.58 ([[DNS/Discovery]])
 
== LVS / discovery ==
 
https://config-master.wikimedia.org/pybal/eqiad/miscweb
 
https://config-master.wikimedia.org/pybal/codfw/miscweb
 
https://config-master.wikimedia.org/discovery/
 
== How this service was made ==
 
Here I am trying to compile a table / list of all the changes made to get this service from scratch into WMF production, in chronological order of how they were merged.


[[Category:Services]]
[[Category:Services]]
{| class="wikitable"
|+ steps for miscweb
|-
! # !! action !! link
|-
| 1 || create phabricator request ticket || Example
|-
| 2 || request gerrit repo  || Example
|-
| 3 || reserve port || Example
|}

Revision as of 00:33, 22 January 2022

This page is about the new service miscweb on kubernetes.

It was requested in task T281538 to replace the legacy service miscweb running on Ganeti VMs in production.

Since 2022-01-20 it serves production traffic for static-bugzilla.

Also see: miscweb1002, miscweb2002 for the legacy machines still serving other microsites.


Sites running on miscweb k8s

The first of the sites hosted on miscweb-k8s is static-bugzilla.

Since 2022-01-20 static-bugzilla.wikimedia.org is served from k8s.

The actual switch to the new backend was made here.

Other micro-sites are going to follow this quarter.

Where does the code live?

The docker image is is built by the Deployment Pipeline/CI from the repo operations/container/miscweb. This is also where the actual content and webserver config can be found.

The helm charts for kubernetes are together with the other services in operations/deployment-charts.

Note that all the HTML content files are gzipped to reduce image size. If you want to edit HTML inside it you need to gunzip, edit and gzip, then upload to Gerrit.

How to deploy changes

Staging

  • ssh deploy1002.eqiad.wmnet
  • [deploy1002:~] $ kube_env miscweb staging
  • [deploy1002:~] $ helmfile -e staging diff
  • [deploy1002:~] $ helmfile -e staging -i apply

And wait.. either it works after a little while or it will automatically revert after 5 minutes.

Production

  • ssh deploy1002.eqiad.wmnet
  • [deploy1002:~] $ kube_env miscweb codfw
  • [deploy1002:~] $ helmfile -e codfw diff
  • [deploy1002:~] $ helmfile -e codfw -i apply

And wait.. either it works after a little while or it will automatically revert after 5 minutes.

  • [deploy1002:~] $ kube_env miscweb eqiad
  • [deploy1002:~] $ helmfile -e eqiad diff
  • [deploy1002:~] $ helmfile -e eqiad -i apply

And wait.. either it works after a little while or it will automatically revert after 5 minutes.

Service names

miscweb.svc.eqiad.wmnet has address 10.2.2.58  (eqiad)
miscweb.svc.codfw.wmnet has address 10.2.1.58  (codfw)
miscweb.discovery.wmnet has address 10.2.2.58  (DNS/Discovery)

LVS / discovery

https://config-master.wikimedia.org/pybal/eqiad/miscweb

https://config-master.wikimedia.org/pybal/codfw/miscweb

https://config-master.wikimedia.org/discovery/

How this service was made

Here I am trying to compile a table / list of all the changes made to get this service from scratch into WMF production, in chronological order of how they were merged.

steps for miscweb
# action link
1 create phabricator request ticket Example
2 request gerrit repo Example
3 reserve port Example