The context window is the maximum number of tokens (prompt plus output) the model can process at once.
Exceeding it either errors or forces truncation, so older content is silently dropped.
Even inside the window, models can miss information buried in the middle of a long prompt ("lost in the middle").
Manage it with conversation summarization, sliding windows, retrieval instead of stuffing everything in, and pruning history by relevance; remember attention cost and latency grow with context length.
Loading…