Exam Professional Machine Learning Engineer topic 1 question 279 discussion - ExamTopics


AI Summary Hide AI Generated Summary

Problem

The question presents a scenario where an ML pipeline needs to be orchestrated across various Google Cloud services, triggered only by the addition of new files to a Cloud Storage bucket. The goal is to minimize costs.

Options

  • A: Using Vertex AI Pipelines with a scheduler to periodically check for new files.
  • B: Employing a Cloud Function with a Cloud Storage trigger to deploy a Cloud Composer DAG.
  • C: Combining Vertex AI Pipelines with a Cloud Function triggered by Cloud Storage to deploy the pipeline.
  • D: Utilizing a Cloud Composer DAG with a GCSObjectUpdateSensor to detect new files.

Suggested Solution

The suggested answer is C. This option combines the scalability of Vertex AI Pipelines with the event-driven nature of Cloud Functions, efficiently triggering pipeline execution only when necessary, thus minimizing cost.

Sign in to unlock more AI features Sign in with Google

You are creating an ML pipeline for data processing, model training, and model deployment that uses different Google Cloud services. You have developed code for each individual task, and you expect a high frequency of new files. You now need to create an orchestration layer on top of these tasks. You only want this orchestration pipeline to run if new files are present in your dataset in a Cloud Storage bucket. You also want to minimize the compute node costs. What should you do?

  • A. Create a pipeline in Vertex AI Pipelines. Configure the first step to compare the contents of the bucket to the last time the pipeline was run. Use the scheduler API to run the pipeline periodically.
  • B. Create a Cloud Function that uses a Cloud Storage trigger and deploys a Cloud Composer directed acyclic graph (DAG).
  • C. Create a pipeline in Vertex AI Pipelines. Create a Cloud Function that uses a Cloud Storage trigger and deploys the pipeline.
  • D. Deploy a Cloud Composer directed acyclic graph (DAG) with a GCSObjectUpdateSensor class that detects when a new file is added to the Cloud Storage bucket.
Show Suggested Answer Hide Answer
Suggested Answer: C πŸ—³οΈ

Was this article displayed correctly? Not happy with what you see?

Tabs Reminder: Tabs piling up in your browser? Set a reminder for them, close them and get notified at the right time.

Try our Chrome extension today!


Share this article with your
friends and colleagues.
Earn points from views and
referrals who sign up.
Learn more

Facebook

Save articles to reading lists
and access them on any device


Share this article with your
friends and colleagues.
Earn points from views and
referrals who sign up.
Learn more

Facebook

Save articles to reading lists
and access them on any device