Prateek Sachdev

US Patent:

20200401491, Dec 24, 2020

Filed:

Jun 20, 2019

Appl. No.:

16/447739

Inventors:

- Redmond WA, US
Manish Swaminathan - Sunnyvale CA, US
Shunlin Liang - San Jose CA, US
Prateek Sachdev - Sunnyvale CA, US
Vivek Desai - Sunnyvale CA, US
Adam R. Peck - Redwood City CA, US
Sunny Sanjiv Ketkar - Fremont CA, US

Assignee:

Microsoft Technology Licensing, LLC - Redmond WA

International Classification:

G06F 11/22
G06N 20/00

Abstract:

The disclosed embodiments provide a system for testing machine learning workflows. During operation, the system obtains a configuration for a staging test of a machine learning model, wherein the configuration includes a model name for the machine learning model, a duration of the staging test, and a use case associated with the machine learning model. Next, the system selects a staging test host for the staging test. The system then deploys the staging test on the staging test host in a staging environment, wherein the deployed staging test executes the machine learning model based on live traffic received from a production environment. After the staging test has completed, the system outputs a set of metrics representing a system impact of the machine learning model on the staging test host.