What a Context Window Is, and Why It Matters

Every large language model works with a fixed amount of text at a time. This limit is called the context window. It includes everything the model can see in a single exchange: your instructions, any documents you share, earlier messages in the conversation, and the reply it is writing.

Measured in tokens

Context windows are measured in tokens, not words. A token is a small piece of text, often a short word or part of a longer one. When a conversation grows past the limit, the oldest material drops out of view or has to be shortened. The model does not keep it anywhere else. For that exchange, it is simply gone.

Why it matters

The size of the window shapes what you can ask. A larger window lets you share a full contract, a long report, or a large block of code and ask questions about all of it at once. A smaller window forces you to split the work into pieces.

The window also explains a common frustration. In a very long chat, a model may forget a detail you gave at the start. It is not ignoring you. That detail may no longer fit.

Size is not everything

A large window helps only if the model can find what it needs inside it. Recall matters as much as capacity. Some models handle long inputs well, while others can lose track of details buried deep in the text.

Practical tips

Repeat important instructions in your latest message. Start a new conversation when you switch topics. For long documents, point the model to the section you care about.