local ai explained

3 articles · newest first

AI

what are tokens in AI? the units that decide cost, speed, and how much your model can read

AI doesn't read words — it reads tokens. They're why API pricing, context limits, and speed are all measured the way they are. Here's what a token actually is, in plain English.

Lena Fischer · Aug 3 · 10 min

AI

what is a context window? the AI limit that decides how much your model can 'remember'

The context window is how much text an AI can consider at once — your prompt, the conversation, and any documents. It's why chats 'forget', and why long context eats VRAM. Explained simply.

Lena Fischer · Aug 3 · 10 min

AI

what is quantization, and why it's the reason you can run AI on a normal PC

Quantization is the trick that shrinks giant AI models to fit consumer GPUs, with almost no quality loss. Here's what those Q4/Q5/Q8 labels actually mean — in plain English.

Lena Fischer · Aug 1 · 10 min