Model Evaluation Quiz

5 questions Pass: 70% +25 pts (50 with Pro)

Quiz covering GenAI Model Lifecycle

What you'll be asked

  1. What is the primary purpose of evaluating a Generative AI model after it has been trained?
  2. When evaluating a Large Language Model (LLM) for a customer support chatbot, which metric is most useful for identifying if the model is providing factually incorrect information?
  3. Which of the following describes the 'Human-in-the-Loop' (HITL) approach in the model evaluation lifecycle?
  4. Why is it important to use a 'Hold-out' test set that was not part of the training data during model evaluation?
  5. In a scenario where a model is evaluated using 'LLM-as-a-judge,' what is the primary risk that engineers must mitigate?

Answers and explanations come after you submit.