Context Windows Quiz

5 questions Pass: 70% +25 pts (50 with Pro)

Quiz covering Foundation Model Design

What you'll be asked

  1. What is the primary definition of a 'context window' in the context of Large Language Models?
  2. If a user provides an input prompt that exceeds the model's defined context window, what is the most common behavior of a standard Transformer-based model?
  3. When building an application that requires referencing a massive legal document (e.g., 500 pages), which strategy is most effective if the document exceeds the context window?
  4. Why does doubling the context window in a Transformer model often lead to a non-linear increase in computational cost?
  5. In the context of 'Lost in the Middle' phenomena, what does this concept imply for long-context model performance?

Answers and explanations come after you submit.