Regression Testing for FMs Quiz
5 questions Pass: 70% +25 pts (50 with Pro)
Quiz covering Testing Strategies
What you'll be asked
- What is the primary objective of regression testing in the context of Foundation Models (FMs)?
- When building an automated regression suite for an LLM, which of the following is considered a 'gold standard' practice for assessing output consistency?
- You have fine-tuned an existing FM for a specific classification task. During regression testing, you notice the model is performing significantly better on the new task but worse on its original general-purpose reasoning tasks. What is this phenomenon called?
- In the context of testing LLMs, why is it often difficult to use simple exact-match (string comparison) assertions for regression testing?
- When implementing a 'Model-based Evaluation' (LLM-as-a-Judge) for regression testing, what is the most significant risk to the validity of your test results?
Answers and explanations come after you submit.
Course Content