You are browsing a read-only backup copy of Wikitech. The live site can be found at wikitech.wikimedia.org

Data Engineering/Currently working on: Difference between revisions

From Wikitech-static
Jump to navigation Jump to search
imported>Aklapper
m (typo fix)
imported>ODimitrijevic
m (Update link)
 
Line 3: Line 3:
== Currently Working On ==
== Currently Working On ==


* [[Analytics/Systems/Airflow|Airflow]] - This is the job scheduler that will be executing our analytics tasks and pipelines
* [[Data Engineering/Systems/Airflow|Airflow]] - This is the job scheduler that will be executing our analytics tasks and pipelines
* [[Analytics/Systems/DataHub|Datahub]] - This is a metadata catalog that will be used as the canonical reference to the datasets owned by the Foundation
* [[Data Engineering/Systems/DataHub|Datahub]] - This is a metadata catalog that will be used as the canonical reference to the datasets owned by the Foundation

Latest revision as of 16:33, 2 September 2022

Currently Working On

  • Airflow - This is the job scheduler that will be executing our analytics tasks and pipelines
  • Datahub - This is a metadata catalog that will be used as the canonical reference to the datasets owned by the Foundation