AI
run Mistral Small 24B locally in 2026: VRAM, which GPU, and how fast
Mistral Small 24B fits a single 24GB card at Q4 (~14GB). VRAM by quant, which GPU, realistic speeds by runtime, and the cheapest way to run it — own or rent.
Aliteq Team · Sep 24 · 7 min