Event Platform/Maintainers

Event Platform

Documentation

• Producing events - a guide

---

• Schemas
• Schema guidelines
• Event stream configuration
• Producer requirements
• Flaws
• Decision log
• Differences from EventLogging legacy

---

• Stream Processing/Flink
• Stream Processing/Flink Catalog
• Stream processing use cases
• Stream processing framework evaluation

---

• Disambiguation page
• Maintainers
• History

---

Services, libraries, and repositories

• Event Utilities (code client libraries)
• EventGate service ( admin )
• EventStreams service ( admin )
• EventBus MediaWiki extension
• EventLogging MediaWiki extension
• Schema API
• EventStreams API
• EventStreams WMF Internal API
• Beta Cluster EventStreams API
• Primary event schema repo
• Secondary event schema repo

---

Event data in the Data Lake

• Access
• Ingestion lifecycle
• Sanitization

---

Uses of the Event Platform

• Wikidata Query Service updater
• Search update pipeline
• MediaWiki JobQueue
• Changeprop
• LiftWing streams
• MediaWiki Event Enrichment
• Wikimedia Enterprise ( via EventStreams )

---

See also

• Issue tracker (Phabricator)
• Event Platform epic task (Phabricator)

[ ]

Every Event Platform component should have a steward with a manager, and at least 2 maintainers. If a component has fewer than 2 maintainers, it is in danger of being ill-supported. If maintainers leaves WMF, the steward/manager should find and assign a new maintainers.

Component	Description	Steward	Maintainers
eventgate-wikimedia (4 deployments in prod k8s)	Service	Data Engineering	Thomas Chin , Andrew Otto
EventGate	NodeJS Library	Data Engineering	Andrew Otto , Thomas Chin
eventstreams (2 deployments in k8s)	Service	Data Engineering	Thomas Chin , Andrew Otto
EventStreams	NodeJS Library	Data Engineering	Thomas Chin , Andrew Otto
EventBus	MW Extension	Data Engineering	Andrew Otto , Gabriele Modena
wikimedia-event-utilities	Java Library	Data Engineering	Andrew Otto , David Causse
eventutilities-python	Python / PyFlink library, built on wikimedia-event-utilities	Data Engineering	Andrew Otto , Javier Montón
mediawiki-event-enrichment	PyFlink based applications for streaming enrichment of MediaWiki events	Data Engineering	Javier Montón , Aisha Khatun , Andrew Otto
flink-app helm chart	Helm chart for deploying Flink applications in Kubernetes	Data Engineering	Andrew Otto , Gabriele Modena , Thomas Chin , David Cause, Brian King
flink-kubernetes-operator helm chart	Helm chart for deploying flink-kubernetes-operator, a dependency for the flink-app chart	Data Engineering	Andrew Otto , Brian King
flink and flink-kubernetes-operator production docker images	Base image for Flink applications and flink-kubernetes-operator deployed in Kubernetes	Data Engineering	Andrew Otto , Brian King
EventStreamConfig	MW Extension: Lib and (action) API endpoint	Data Engineering	Andrew Otto , Sam Smith
Schema Repositories ( 1 , 2 ) and Service	Repository / Service	Data Engineering	Andrew Otto , Sam Smith
jsonschema-tools	NodeJS library	Data Engineering	Andrew Otto , Thomas Chin , Javier Montón