What is Context Window?
How much text an AI can hold in memory at once. A larger window means more context — some models now handle millions of tokens.
A context window is how much text an AI can hold in its "working memory" at the same time. Picture a desk: everything that fits on the desk is what the AI can see and use right now. What does not fit goes into a drawer and is forgotten. The bigger the desk (context window), the more the AI can remember in one conversation.
Size is measured in tokens — the small chunks of text the AI processes. A small context window might hold a few pages; the largest models today can hold the equivalent of entire books, sometimes millions of tokens, at once. Everything you have written in the conversation plus the AI's replies must fit within this window.
When the window fills up, the oldest content starts to fall out. That is why an AI sometimes loses the thread in very long conversations — what you said at the start has simply dropped out of memory.
Why does context window size matter for your business?
Context window size determines how large a task an AI can handle. If you want it to summarise a long contract or answer questions from your full product catalogue, all of that needs to fit in the window at the same time.
A larger window gives smarter answers in complex cases, but also costs more because you pay per token. Choosing the right size for the job matters.
Context window in practice
A consultancy wants an AI to read a 40-page requirements document and answer questions about it. If the whole document fits in the context window, the AI can reason about the full picture. If the window is too small, the document must be split up and answers get worse.
At ZORC we help you choose the right AI model and build solutions where the context window is large enough for your documents and needs.
Common questions about Context Window
What does context window mean?
A context window is how much text an AI can remember and use at once. It is measured in tokens — the larger the window, the more information the AI can hold in a single conversation.
Why does AI forget what I wrote earlier?
When the context window fills up, the oldest text drops out of the AI's memory. In very long conversations, what you wrote at the start may simply have fallen out.
Is a larger context window always better?
A larger window helps with big documents and complex tasks, but it also costs more because you pay per token. The right size depends on the job.
Related terms
AI Agent
AI that can carry out tasks for you — not just answer questions. Books meetings, sends emails, makes decisions.
AI Agent vs Chatbot
The chatbot answers questions. The AI agent goes and fixes it. One talks; the other rolls up its sleeves.
Copilot
An AI assistant that works alongside you and suggests next steps. You are still the captain — it is the co-pilot, not autopilot.
Embedding
Turning text into numbers so AI can compare meaning. The foundation for smart search and chatbots.
Fine-Tuning
Training an AI model on your specific data. Expensive but powerful — only when you really need it.
Generative AI
AI that creates new content — text, images, code, audio. Not just analysis. The defining technology shift of the 2020s.