tokens per second

2 articles · newest first

Hardware

how to make your local AI faster — the settings that actually boost tokens per second

If your local model feels sluggish, it's usually one of a few fixable things. Here's how to speed up local LLM inference, from the one change that matters most to the fine-tuning.

Ravi Malhotra · 2h ago · 10 min

AI

what are tokens in AI? the units that decide cost, speed, and how much your model can read

AI doesn't read words — it reads tokens. They're why API pricing, context limits, and speed are all measured the way they are. Here's what a token actually is, in plain English.

Lena Fischer · 2h ago · 10 min