context window

3 articles · newest first

Flat illustration of a conveyor belt of coloured blocks, new ones added on the right, the oldest tipping off the left end

Why the AI keeps forgetting what you told it — and how to stop it

The model has no memory of its own. Once a conversation outgrows its window, your earlier decisions quietly fall out. See what drops, what gets summarised, and the habit that keeps what matters in view.

Syntax · Sep 26 · 4 min

Flat illustration of a person dropping coloured blocks into a nearly full transparent glass box with a fill line

BuildInteractive

The AI's working memory has a hard edge, and you keep hitting it

Everything the model can see at once — your prompt, the chat so far, your files, its own reply — sits in one window with a fixed limit. Tap to watch it fill, and see why bigger isn't automatically better.

Syntax · Sep 26 · 4 min

A laptop screen showing a local AI language model running in a terminal window

three free AI models all claim a 128K memory — only one actually holds onto it

Phi-4 Mini, Gemma 3, and Llama 3.2 all advertise roughly the same 128K context window. Benchmark data says that number means something very different for each one.

Tensor · Aug 4 · 7 min