Regression Testing for FMs Quiz

5 questions Pass: 70% +25 pts (50 with Pro)

Quiz covering Testing Strategies

What you'll be asked

  1. What is the primary objective of regression testing in the context of Foundation Models (FMs)?
  2. When building an automated regression suite for an LLM, which of the following is considered a 'gold standard' practice for assessing output consistency?
  3. You have fine-tuned an existing FM for a specific classification task. During regression testing, you notice the model is performing significantly better on the new task but worse on its original general-purpose reasoning tasks. What is this phenomenon called?
  4. In the context of testing LLMs, why is it often difficult to use simple exact-match (string comparison) assertions for regression testing?
  5. When implementing a 'Model-based Evaluation' (LLM-as-a-Judge) for regression testing, what is the most significant risk to the validity of your test results?

Answers and explanations come after you submit.