Exam Professional Machine Learning Engineer topic 1 question 292 discussion - ExamTopics


AI Summary Hide AI Generated Summary

Question

The question involves optimizing a TensorFlow Extended (TFX) pipeline to efficiently process 100TB of data from BigQuery while leveraging Vertex AI for metrics, parameters, and artifact tracking.

Options

  • Option A: Run the pipeline in Vertex AI Pipelines using Vertex AI Training jobs with distributed processing.
  • Option B: Run the pipeline in Vertex AI Pipelines, setting Apache Beam parameters for Dataflow processing.
  • Option C: Run the pipeline in Dataproc using the Apache Beam TFX orchestrator, configuring Vertex AI permissions for metadata publishing.
  • Option D: Run the pipeline in Dataflow using the Apache Beam TFX orchestrator, configuring Vertex AI permissions for metadata publishing.

Answer

The correct answer is B. This approach leverages Vertex AI Pipelines for orchestration and Apache Beam's Dataflow capabilities for scalable data preprocessing.

Sign in to unlock more AI features Sign in with Google

You are developing a TensorFlow Extended (TFX) pipeline with standard TFX components. The pipeline includes data preprocessing steps. After the pipeline is deployed to production, it will process up to 100 TB of data stored in BigQuery. You need the data preprocessing steps to scale efficiently, publish metrics and parameters to Vertex AI Experiments, and track artifacts by using Vertex ML Metadata. How should you configure the pipeline run?

  • A. Run the TFX pipeline in Vertex AI Pipelines. Configure the pipeline to use Vertex AI Training jobs with distributed processing.
  • B. Run the TFX pipeline in Vertex AI Pipelines. Set the appropriate Apache Beam parameters in the pipeline to run the data preprocessing steps in Dataflow.
  • C. Run the TFX pipeline in Dataproc by using the Apache Beam TFX orchestrator. Set the appropriate Vertex AI permissions in the job to publish metadata in Vertex AI.
  • D. Run the TFX pipeline in Dataflow by using the Apache Beam TFX orchestrator. Set the appropriate Vertex AI permissions in the job to publish metadata in Vertex AI.
Show Suggested Answer Hide Answer
Suggested Answer: B πŸ—³οΈ

Was this article displayed correctly? Not happy with what you see?

Tabs Reminder: Tabs piling up in your browser? Set a reminder for them, close them and get notified at the right time.

Try our Chrome extension today!


Share this article with your
friends and colleagues.
Earn points from views and
referrals who sign up.
Learn more

Facebook

Save articles to reading lists
and access them on any device


Share this article with your
friends and colleagues.
Earn points from views and
referrals who sign up.
Learn more

Facebook

Save articles to reading lists
and access them on any device