You are browsing a read-only backup copy of Wikitech. The primary site can be found at

Incident documentation/20170222-www-portals: Difference between revisions

From Wikitech-static
Jump to navigation Jump to search
m (Real bullet points)
(Automatically fixing double redirect from Incidents/20170222-www-portals to Incidents/2017-02-22 www-portals in a maintenance job)
(2 intermediate revisions by 2 users not shown)
Line 1: Line 1:
== Summary ==
#REDIRECT [[Incidents/2017-02-22 www-portals]]
At about 17:00 UTC Feb. 22 the page was severely broken for about an hour. 
The text on the page was invisible. This bug was caused by a javascript file being improperly cached and returning a 404.
== Timeline ==
* A bug was filed at around 17:09 UTC Feb.22 noting that the text on is invisible. {{PhabT|158782}}
* We were made aware of this bug at about 17:40 UTC
* at 18:15 UTC an attempt was made to rollback to the previous deploy. The deploy was visible on mwdebug1002 without error, but the error persisted in production. 
* at 18:20 UTC we purged the URL of the specific javascript file, fixing the issue.
== Conclusions ==
* The portal depends on a specific order of syncing followed by purging urls, which is fragile and needs some rethinking. 
* Errors in javascipt should not make the page unusable.
== Actionables ==
* Adding an entire list of asset URLs to purge ({{PhabT|158810}})
* Preventing javascript from hiding page content indefinitetly ({{PhabT|158809}})
* Use query params for cache-busting ({{PhabT|158808}})
[[Category:Incident documentation]]

Latest revision as of 18:16, 8 April 2022