run locally

7 articles · newest first

Editorial illustration of four graphics cards of rising size in a row, each holding a matching Gemma 4 model block, near-black background with indigo-violet and a coral accent

Run Gemma 4 locally: which size fits your GPU (E4B, 12B, 26B-A4B or 31B)

Gemma 4 comes in five sizes, from a phone model to a 31B that wants a 24GB card. Here is the one that fits your GPU, the exact Ollama tag (the bare one pulls a small model), and when Qwen3.8 27B is the better pick in November 2026.

Aliteq Team · Nov 1, 2026 · 13 min

Isometric diorama of a code editor window and a graphics card together on a desk with a small padlock, near-black background, indigo-violet with a coral accent

Qwen2.5-Coder-32B locally: a private Copilot on a 24GB card

Qwen2.5-Coder-32B still runs a serious private coding assistant on a single 24GB card, with a 32K native context (128K with YaRN). The VRAM math, the tight-but-real fit, and how it stands against the newer Qwen3-Coder.

Aliteq Team · Sep 26, 2026 · 7 min

Realistic painterly illustration of a small compact glowing processor on a dark surface, deep indigo-violet with a warm coral highlight

Phi-4 locally: a small model that's still handy, with one dated catch

Microsoft's Phi-4 is a compact 14B that runs on a mid-range card — but at 16K context and a late-2024 release, it shows its age next to newer 14B-class models. The VRAM math and an honest verdict.

Aliteq Team · Sep 26, 2026 · 7 min

Editorial infographic of a solid dense 27B model block fitting neatly inside a 24GB graphics card, near-black background, indigo-violet with a coral accent

Qwen3.6 27B locally: the all-dense 24GB Qwen

Qwen3.6's dense 27B is the no-fuss 24GB-card option — every parameter fires, nothing to offload, a real 256K context. The VRAM math, the GPU, and how it differs from the 35B-A3B MoE.

Aliteq Team · Sep 26, 2026 · 7 min

Isometric diorama of a huge grid of expert blocks overflowing off a single graphics card into several system-RAM sticks, near-black background, indigo-violet with a coral accent

Qwen3-Next 80B-A3B locally: an 80B at home, if you can hold it

Qwen3-Next 80B-A3B activates only 3B parameters per token — so it's fast. But 80B of weights still have to live somewhere. The honest VRAM math, the offload trick, and what it really takes.

Aliteq Team · Sep 26, 2026 · 7 min

Line-art illustration on a dark background next to the headline: Still worth the 35B? Qwen3.6 35B-A3B vs the 3.8 generation. A card reads Active per token: 3B (fast on 16GB).

Qwen3.6 35B-A3B in late 2026: who should still run it, and when to switch to Qwen3.8

The fast 35B MoE that thinks like a 3B is now last generation. It still makes sense for speed on a 16 to 24 GB card and for its coder fine-tunes. For the best answers, Reddit owners are moving to Qwen3.8 27B or Flash Next.

Aliteq Team · Updated Nov 1, 2026 · 8 min

Editorial infographic of a compact AI model badge flowing into a mid-range GPU that comfortably fits it, near-black background, indigo-violet with a coral accent

Qwen3.5 9B locally: the model 'ollama run qwen3.5' actually gives you

Type ollama run qwen3.5 and this is the model you get — the 9B. What it is, how little VRAM it needs, and the cheapest card that runs it well.

Aliteq Team · Sep 26, 2026 · 7 min