CloudWatch ML Metrics Quiz
5 questions Pass: 70% +25 pts (50 with Pro)
Quiz covering Model Monitoring
What you'll be asked
- Which AWS service is primarily used to collect and store model performance metrics such as latency and invocation counts?
- When monitoring an Amazon SageMaker endpoint, which metric is most useful for identifying if your model is struggling to keep up with incoming request volume?
- You have configured a CloudWatch Alarm to trigger when the 99th percentile of model latency exceeds 200ms. Why is it better to use P99 rather than Average latency for this alarm?
- Which feature allows you to visualize multiple model performance metrics, such as Invocations and ModelLatency, on a single screen in the AWS Console?
- You notice that your SageMaker endpoint is triggering an 'Invocation4XXErrors' alarm. What is the most likely cause you should investigate first?
Answers and explanations come after you submit.
Course Content
- Data Cleaning Techniques
- Data Cleaning Techniques Quiz5q
- Feature Scaling Normalization
- Feature Scaling Normalization Quiz5q
- Encoding Techniques
- Encoding Techniques Quiz5q
- Glue DataBrew
- Glue DataBrew Quiz5q
- SageMaker Feature Store
- SageMaker Feature Store Quiz5q
- Ground Truth Labeling
- Ground Truth Labeling Quiz5q
- SageMaker Training Jobs
- SageMaker Training Jobs Quiz5q
- Hyperparameter Tuning
- Hyperparameter Tuning Quiz5q
- Distributed Training
- Distributed Training Quiz5q
- Fine-Tuning Models
- Fine-Tuning Models Quiz5q
- Regularization Techniques
- Regularization Techniques Quiz5q
- Model Registry
- Model Registry Quiz5q
- Ensemble Methods
- Ensemble Methods Quiz5q