Fine-Tuning Generative Models Quiz

5 questions Pass: 70% +25 pts (50 with Pro)

Quiz covering Optimizing Generative AI

What you'll be asked

  1. What is the primary goal of fine-tuning a pre-trained generative model?
  2. When fine-tuning a model, what is the main risk associated with using a dataset that is too small or lacks diversity?
  3. Which of the following describes the 'Parameter-Efficient Fine-Tuning' (PEFT) approach, such as LoRA?
  4. In the context of fine-tuning, what is 'Catastrophic Forgetting'?
  5. You are fine-tuning a model for a highly specific technical domain. Your training loss is decreasing, but your validation loss is increasing significantly. Which strategy is most effective to resolve this?

Answers and explanations come after you submit.