Context Windows Quiz
5 questions Pass: 70% +25 pts (50 with Pro)
Quiz covering Foundation Model Design
What you'll be asked
- What is the primary definition of a 'context window' in the context of Large Language Models?
- If a user provides an input prompt that exceeds the model's defined context window, what is the most common behavior of a standard Transformer-based model?
- When building an application that requires referencing a massive legal document (e.g., 500 pages), which strategy is most effective if the document exceeds the context window?
- Why does doubling the context window in a Transformer model often lead to a non-linear increase in computational cost?
- In the context of 'Lost in the Middle' phenomena, what does this concept imply for long-context model performance?
Answers and explanations come after you submit.
Course Content