Pre-Training Quiz

5 questions Pass: 70% +25 pts (50 with Pro)

Quiz covering GenAI Model Lifecycle

What you'll be asked

  1. What is the primary goal of the pre-training phase in a Large Language Model's lifecycle?
  2. During the pre-training process, what is the most common objective used to train Transformer-based models?
  3. Which of the following best describes the data requirements for pre-training a foundation model?
  4. Why is 'data deduplication' a critical step during the pre-training data preparation phase?
  5. When pre-training a model on a distributed cluster, which factor is most likely to cause a 'bottleneck' that limits the scaling of training throughput?

Answers and explanations come after you submit.