You are browsing a read-only backup copy of Wikitech. The live site can be found at wikitech.wikimedia.org

User:Accraze/MachineLearning/Lift Wing: Difference between revisions

From Wikitech-static
Jump to navigation Jump to search
imported>Accraze
(→‎Development: add link to MiniKF notes)
 
imported>Accraze
Line 17: Line 17:


== Development ==
== Development ==
We have been using multiple sandbox clusters running [[User:Accraze/MachineLearning/MiniKF|MiniKF]] for development purposes.
We are developing inference services on the [[User:Accraze/MachineLearning/ML-Sandbox|ML Sandbox]] using our own WMF KServe images & charts.
 
We previously used multiple sandbox clusters running [[User:Accraze/MachineLearning/MiniKF|MiniKF]].


== Services ==
== Services ==
We are serving ML models as Inference Services, which are containerized applications.
We are serving ML models as Inference Services, which are containerized applications.
The code is currently hosted on gerrit: https://gerrit.wikimedia.org/g/machinelearning/liftwing/inference-services
The code is currently hosted on gerrit: https://gerrit.wikimedia.org/g/machinelearning/liftwing/inference-services
More information about Inference Services can be found here: [[User:Accraze/MachineLearning/Lift Wing/Inference Services]]

Revision as of 19:44, 13 January 2022

Lift Wing

A scalable machine learning model serving infrastructure build off Kubeflow & Kubernetes.

Hosts

eqiad

  • ml-serve1001-4

codfw

  • ml-serve2001-4

Components

Logging

  • Common Logging Schema for logstash/kibana

Serving

Development

We are developing inference services on the ML Sandbox using our own WMF KServe images & charts.

We previously used multiple sandbox clusters running MiniKF.

Services

We are serving ML models as Inference Services, which are containerized applications. The code is currently hosted on gerrit: https://gerrit.wikimedia.org/g/machinelearning/liftwing/inference-services

More information about Inference Services can be found here: User:Accraze/MachineLearning/Lift Wing/Inference Services