Evaluating Models and Flows Quiz

5 questions Pass: 70% +25 pts (50 with Pro)

Quiz covering Building with Microsoft Foundry

What you'll be asked

  1. Which tool within Azure AI Foundry is primarily used to evaluate the quality of a prompt flow by comparing model outputs against a ground truth dataset?
  2. When evaluating a RAG (Retrieval-Augmented Generation) application in Azure AI Foundry, which metric specifically measures how well the generated answer is supported by the retrieved context?
  3. You are building a flow that summarizes long documents. Which approach is considered best practice for evaluating the flow's performance effectively?
  4. What is the primary benefit of using 'AI-assisted' evaluators in Azure AI Foundry compared to traditional deterministic metrics like BLEU or ROUGE?
  5. In a complex multi-step flow, you notice the 'Groundedness' score is low, but the 'Relevance' score is high. What is the most likely structural issue in your application?

Answers and explanations come after you submit.