You are browsing a read-only backup copy of Wikitech. The primary site can be found at wikitech.wikimedia.org
Stream.wikimedia.org: Difference between revisions
Jump to navigation
Jump to search
imported>Nemo bis (→Usage: +Cocytus) |
imported>Krinkle No edit summary |
||
| Line 10: | Line 10: | ||
{{Alert|content=As of January 2015, RCStream implements version 0.9 of the Socket.IO protocol, not 1.0 ([[phab:T68232]]). See also [https://github.com/Automattic/socket.io/tree/0.9.17 socket.io 0.9] and [https://github.com/Automattic/socket.io-client/tree/0.9.17 socket.io-client 0.9] on GitHub for more information.}} | {{Alert|content=As of January 2015, RCStream implements version 0.9 of the Socket.IO protocol, not 1.0 ([[phab:T68232]]). See also [https://github.com/Automattic/socket.io/tree/0.9.17 socket.io 0.9] and [https://github.com/Automattic/socket.io-client/tree/0.9.17 socket.io-client 0.9] on GitHub for more information.}} | ||
== | == Clients == | ||
* [http://codepen.io/Krinkle/pen/laucI Demo client], Example listener for stream.wikimedia.org using JavaScript in the browser. | |||
* [http://codepen.io/Krinkle/pen/laucI Demo client | |||
* [[mw:Manual:Pywikibot|pywikibot]] | * [[mw:Manual:Pywikibot|pywikibot]] | ||
== | == Consumers == | ||
* Researchers (per wiki-research-l, December 2014) | |||
* [https://github.com/notconfusing/cocytus Cocytus] (tracks citations on Wikipedia) | |||
* [http://wikimedia.meteor.com/ Meteor DDP] (proxies change events combined with page content and diff from the API) | |||
* [http://datasift.com/source/44/wikipedia Datasift] (includes page content) | |||
== See also == | == See also == | ||
* [[RCStream]]: The application running on this domain. | * [[RCStream]]: The application running on this domain. | ||
* [[irc.wikimedia.org]]: The service that will be superseded by stream.wikimedia.org. | * [[irc.wikimedia.org]]: The service that will be superseded by stream.wikimedia.org. | ||
* [https://github.com/wikimedia/operations-puppet/blob/1dffa7ab/manifests/role/rcstream.pp puppet-rcstream role]: Wikimedia's puppet role for stream.wikimedia.org. | * [https://github.com/wikimedia/operations-puppet/blob/1dffa7ab/manifests/role/rcstream.pp puppet-rcstream role]: Wikimedia's puppet role for stream.wikimedia.org. | ||
Revision as of 14:53, 19 February 2016
Example client at codepen.io/Krinkle/pen/laucI
stream.wikimedia.org is a service to provide a live data stream of edits on Wikimedia wikis that anyone can tap and use to power editor tools and web apps, create beautiful visualisations, inform research, and extend MediaWiki.
It uses RCStream to subscribe to the RCFeed of Wikimedia's production cluster, and publishes this on the endpoint stream.wikimedia.org/rc. As a web developer, one can tap the stream using JavaScript. As an app developer, one can use a suitable client library for your platform.
Consuming RCStream is a cleaner approach than parsing the change messages from irc.wikimedia.org. Wikimedia Foundation continues to operate both (configured via $wgRCFeeds in wmf-config).
The RCStream server also responds at http://stream.wikimedia.org/rcstream_status with a simple text message; check this if you do not receive any events.
As of January 2015, RCStream implements version 0.9 of the Socket.IO protocol, not 1.0 (phab:T68232). See also socket.io 0.9 and socket.io-client 0.9 on GitHub for more information.
Clients
- Demo client, Example listener for stream.wikimedia.org using JavaScript in the browser.
- pywikibot
Consumers
- Researchers (per wiki-research-l, December 2014)
- Cocytus (tracks citations on Wikipedia)
- Meteor DDP (proxies change events combined with page content and diff from the API)
- Datasift (includes page content)
See also
- RCStream: The application running on this domain.
- irc.wikimedia.org: The service that will be superseded by stream.wikimedia.org.
- puppet-rcstream role: Wikimedia's puppet role for stream.wikimedia.org.