AI
What is the best local LLM for a 32GB RTX 5090? Qwen3.6 35B-A3B, and four more that fit
For most RTX 5090 owners it is Qwen3.6 35B-A3B at Q5_K_M with the 128K context Qwen asks for, about 27 GB of the card's 32. Four more picks by job, the VRAM worked out for each, and what still doesn't fit. Checked Nov 3, 2026.
Aliteq Team · · 11 min