what is a context window? the AI limit that decides how much your model can 'remember'

The context window is how much text an AI can consider at once — your prompt, the conversation, and any documents. It's why chats 'forget', and why… Aliteq Lena Fischer · AI & Local Compute Editor

Context window = how much text the AI can consider at once — prompt + conversation + pasted documents.

Measured in tokens (~¾ of a word) — models have limits like 8K, 32K, or 128K tokens.

It's why long chats 'forget' — older messages fall out of the window as it fills.

Bigger context = more VRAM on local hardware — the 'KV cache' grows with context length.

Match context to your need — long documents want a big window; short chats don't.

Read the full story

Aliteq what is a context window? the AI limit that decides how much your model can 'remember' Read the full story on Aliteq