AI
can you run gpt-oss-20b locally? Yes — on a single 16GB GPU (with one catch)
OpenAI's gpt-oss-20b fits on a 16GB graphics card and runs fast: RunAIHome reports 225 tokens/second on an RTX 4090 at 8K context. But there's a context-length trap that quietly eats your VRAM — here's what you actually need.
Aliteq Team · Aug 4 · 10 min