Jump to content

This is a read-only backup copy of Wikitech. The live site can be found at wikitech.wikimedia.org

Talk : Data Platform/Systems/Iceberg

From Wikitech
Latest comment: 1 year ago by Bearloga in topic Documenting recomputation patterns
The printable version is no longer supported and may have rendering errors. Please update your browser bookmarks and please use the default browser print function instead.

Documenting recomputation patterns

In https://gitlab.wikimedia.org/repos/product-analytics/data-pipelines/-/merge_requests/4#note_73155 @ Aleksandar_Mastilovic looked into DELETE + INSERT vs. INSERT OVERWRITE patterns/strategies for situations where data needs to be recomputed.

I recommend documenting those learnings here. – Bearloga ( talk ) 19:40, 6 March 2024 (UTC) Reply