File:Irc-rcstream-deployment.svg

Simplified deplyoment diagram of the publication of change logs.

This is meant as a scratchpad to understand the eqiad -> codfw switchover, not as authoritative documentation.

SVG was generated from the following PlantUML sourcesː

@startuml

Actor Editor
Actor "RCStream consumer" as RCStreamConsumer
Actor "IRC consumer" as IRCConsumer

() "*.wikipedia.org" as w_org
() "stream.wikimedia.org" as stream_w_o
() "irc.wikimedia.org" as irc_w_o
() "UDP IRC echo" as udp_irc_echo

Editor --> w_org
RCStreamConsumer --> stream_w_o
IRCConsumer --> irc_w_o

note top of udp_irc_echo
  Strangely, at the moment the
  udpmxircecho service is used
  through its public IP.
end note

package eqiad {
  node "mw*.eqiad.wmnet" {
    [Mediawiki] as mediawiki_eqiad
  }
  node "rdb100*.eqiad.wmnet" {
    database Redis as redis_eqiad
  }
  node "rcs100*.eqiad.wmnet" {
    [RCStream] as rcstream_eqiad
  }
  node argon.wikimedia.org {
    [udpmxircecho] as udpmxircecho_eqiad
    [IRC] as irc_eqiad
  }

  w_org - mediawiki_eqiad
  stream_w_o - rcstream_eqiad
  irc_w_o - irc_eqiad
  udp_irc_echo -up- udpmxircecho_eqiad

  mediawiki_eqiad -> redis_eqiad: publish changes
  mediawiki_eqiad -up-> udp_irc_echo: publish changes
  rcstream_eqiad -> redis_eqiad: read-only
  udpmxircecho_eqiad -> irc_eqiad
}

package codfw {
  node "mw*.codfw.wmnet" {
    [Mediawiki] as mediawiki_codfw
  }
  node "rdb200*.eqiad.wmnet" {
    database Redis as redis_codfw
  }
  [udpmxircecho] as udpmxircecho_codfw <<new>> #Orange

  w_org - mediawiki_codfw

  mediawiki_codfw -> redis_codfw: publish changes
  mediawiki_codfw -> udpmxircecho_codfw: publish changes
  udpmxircecho_codfw -> irc_eqiad

  note bottom of udpmxircecho_codfw
    To ensure UDP traffic does
    not cross DC boundaries we
    probably need to add an
    instance of udpmxircecho
    in codfw, or at least ensure
    that UDP traffic goes through
    our wave and not through the
    wild internet.
  end note

  note left of udpmxircecho_codfw
    Need to make sure we do not
    have PII in the changelogs if
    this traffic is to cross DC
    boundaries unencrypted.
  end note

}

redis_eqiad --> redis_codfw
redis_codfw --> redis_eqiad: replication

@enduml