Exam Professional Machine Learning Engineer topic 1 question 245 discussion - ExamTopics


AI Summary Hide AI Generated Summary

Problem Description

The article presents a scenario involving the development of a machine learning (ML) model for predicting used car prices. The model uses data such as location, condition, model type, color, and engine/battery efficiency, updated nightly. The goal is to create a cost-effective retraining workflow using Google's Vertex AI platform.

Proposed Solutions

Four options for configuring a retraining workflow are provided. These options differ in how they compare model performance (using training/evaluation losses or comparing to previous runs) and whether they incorporate model monitoring using training/serving skew thresholds.

  • A & C: Compare current run losses (A) or compare to previous run results (C). Deploy nightly using a cron job.
  • B & D: Compare current run losses (B) or previous run results (D). Deploy to Vertex AI with model monitoring. Redeploy only when monitoring thresholds are triggered.

Suggested Solution

The suggested solution is option D: Comparing performance to previous runs and deploying with model monitoring. This is more cost-effective because it avoids unnecessary redeployments unless model performance significantly degrades.

Sign in to unlock more AI features Sign in with Google

You are developing an ML model that predicts the cost of used automobiles based on data such as location, condition, model type, color, and engine/battery efficiency. The data is updated every night. Car dealerships will use the model to determine appropriate car prices. You created a Vertex AI pipeline that reads the data splits the data into training/evaluation/test sets performs feature engineering trains the model by using the training dataset and validates the model by using the evaluation dataset. You need to configure a retraining workflow that minimizes cost. What should you do?

  • A. Compare the training and evaluation losses of the current run. If the losses are similar, deploy the model to a Vertex AI endpoint. Configure a cron job to redeploy the pipeline every night.
  • B. Compare the training and evaluation losses of the current run. If the losses are similar, deploy the model to a Vertex AI endpoint with training/serving skew threshold model monitoring. When the model monitoring threshold is triggered redeploy the pipeline.
  • C. Compare the results to the evaluation results from a previous run. If the performance improved deploy the model to a Vertex AI endpoint. Configure a cron job to redeploy the pipeline every night.
  • D. Compare the results to the evaluation results from a previous run. If the performance improved deploy the model to a Vertex AI endpoint with training/serving skew threshold model monitoring. When the model monitoring threshold is triggered redeploy the pipeline.
Show Suggested Answer Hide Answer
Suggested Answer: D πŸ—³οΈ

Was this article displayed correctly? Not happy with what you see?

Tabs Reminder: Tabs piling up in your browser? Set a reminder for them, close them and get notified at the right time.

Try our Chrome extension today!


Share this article with your
friends and colleagues.
Earn points from views and
referrals who sign up.
Learn more

Facebook

Save articles to reading lists
and access them on any device


Share this article with your
friends and colleagues.
Earn points from views and
referrals who sign up.
Learn more

Facebook

Save articles to reading lists
and access them on any device