You are browsing a read-only backup copy of Wikitech. The live site can be found at

Data Engineering/Currently working on

From Wikitech-static
Jump to navigation Jump to search

Currently Working On

  • Airflow - This is the job scheduler that will be executing our analytics tasks and pipelines
  • Datahub - This is a metadata catalog that will be used as the canonical reference to the datasets owned by the Foundation