
Local AI
Can you run Inkling 2 Mini locally? Yes, even on a 12 GB GPU, with one long-context catch
Thinking Machines' Inkling 2 Mini is a 26.4B looped MoE that fits a 12 GB card at 2-bit and a 24 GB card at 4-bit. What each GPU needs, the speeds people posted from an 8 GB RTX 4060 to an RTX 5090, and why its memory climbs faster at long context than a 26B model should. Checked Nov 21, 2026.
Ari Vale · · 9 min