Model Quality Monitoring Quiz

5 questions Pass: 70% +25 pts (50 with Pro)

Quiz covering Model Monitoring

What you'll be asked

  1. Which of the following metrics is most commonly used to monitor for data drift in numerical input features?
  2. You notice that your model's prediction distribution has shifted significantly compared to the training data, but the input feature distributions remain stable. What is the most likely cause?
  3. Why is it important to define a 'reference dataset' when setting up model monitoring?
  4. In a real-world production environment, what is the primary challenge associated with monitoring 'Prediction Drift' compared to 'Feature Drift'?
  5. When monitoring for 'Data Integrity' issues in a production pipeline, which of the following scenarios is the most critical to trigger an immediate alert?

Answers and explanations come after you submit.