Qwen3.6 35B-A3B in late 2026: who should still run it, and when to switch to Qwen3.8

Updated Nov 1, 2026: Qwen3.6 is now the previous generation. Added who should still run it, when to move to Qwen3.8 27B or Flash Next, and re-checked the specs against the config.

Qwen3.6 35B-A3B was the default pick for a fast local model through the summer: 35B parameters on disk, only about 3B used for any one token, so it answers like a small model while knowing more than one. By November 2026 the Qwen3.8 generation has replaced it as the model Reddit owners recommend first. It has not stopped being useful, though, and if it already runs well on your card there are good reasons to keep it.

The VRAM figures here are computed from the published config, not measured. The Aliteq Team has not run this model on a card; speed and quality reports are Reddit users' own, attributed and linked.

What Qwen3.6 35B-A3B actually is

From the Qwen3.6 35B-A3B model card and its config.json (re-read Nov 1, 2026): 35,951,822,704 parameters in BF16, described as "35B in total and 3B activated", a 262,144-token native context, Apache-2.0. The repo was created on April 15, 2026.

The catch every MoE guide has to make clear: "3B active" describes compute, not memory. All 35.95B parameters still have to be loaded, into VRAM or into system RAM with offload. So it is fast to run, but it is not small to store.

The linear-attention layout helps on context. Only every fourth layer keeps a growing cache, and those 10 layers have just 2 KV heads each, so the fp16 cache is 20 KiB per token: 2 x 10 x 2 x 256 x 2 bytes. That is about 0.3 GB at 16K tokens and 2.5 GB at 128K.

How much VRAM Qwen3.6 35B-A3B needs

Computed by our VRAM engine (weights at the engine's effective bits per weight, plus the cache above, plus 0.78 GB runtime overhead). Full table on cost to run Qwen3.6 35B-A3B.

At about 21.4 GB, Q4_K_M fits a 24 GB card with room, and even 128K tokens of context stays under 24 GB, though only just. On a 16 GB card the whole model only fits at Q2_K, about 15 GB, which our 16 GB guide calls tight. The better route on 16 GB is to keep Q4 and offload experts.

Running it on 16 GB: MoE offload

This is the model MoE offload was built for. Keep the attention layers and the active path on the GPU, push the idle experts to system RAM, and a 35B-A3B runs on a 12 to 16 GB card, slower but usable. The llama.cpp flag is --n-cpu-moe N, the number of layers whose experts go to RAM; raise it until the model fits. Our guide on what `--n-cpu-moe` actually does shows the settings.

The price is memory bandwidth. System RAM is far slower than VRAM, so the more you offload, the more speed you trade. Fit as much on the GPU as it will hold and offload only the rest.

Who should still run it in November 2026

You want speed. With about 3B parameters active, each token reads roughly 1.7 GB of Q4_K_M weights (3B x 4.85 bits / 8), against about 15.7 GB for Qwen3.8 27B dense. That is our arithmetic, not a benchmark, but it is why MoE models feel fast. In an r/ollama thread, one user on a 16 GB RTX 4070 Ti Super reported 10 to 20 tokens a second from a 27B dense model and moved to a 35B-A3B MoE coder fine-tune to get agent speed. A reply took the other side: 20 tokens a second of better output beats 120 of worse.

You have a 16 to 24 GB card. On 24 GB it fits at Q4_K_M with long context. On 16 GB it runs at Q4 with offload, where a dense 27B has to drop to 3-bit.

You use a fine-tune built on it. The 35B-A3B coder fine-tunes in that thread exist only for this base. If one works in your agent setup, a newer base model does not make it worse.

You want Apache-2.0 at this size. Qwen3.8 27B is Apache-2.0 too, but Qwen3.8 Flash Next ships under a custom "qwen-community-1.0" licence, per its model card.

When to move to Qwen3.8 27B or Flash Next

The Reddit mood in October was clear, if not unanimous. Under a beginner's guide to the previous generation's dense model, Qwen 3.6 27B, one reply simply said to "delete it and download qwen 3.8 27B instead". That advice was about the 3.6 dense model, but the same move is the common answer for anyone on the 3.6 generation who wants better answers.

The poster of a widely upvoted r/LocalLLaMA post ran Qwen3.8 Flash Next at Q2 on 8 GB of VRAM and 32 GB of RAM in the Strata engine, reported up to 30 tokens a second of generation, and found it better than any Qwen 3.6 35B-A3B fine-tune or Qwen 3.8 27B they had tested. The top comment was surprised that a below-Q4 quant held up; below-Q4 quality is contested elsewhere, so test it on your own work. In an r/ollama thread, a user with 24 GB of VRAM and 64 GB of RAM found qwen3.6:27b much slower than expected, switched to Flash Next and reported 80 to 100 tokens a second.

A simple rule for which way to go from here:

• Move to Qwen3.8 27B if you have a 24 GB card and care about answer quality more than speed. It fits fully on the card at Q4_K_M with about 80K of context. Its cost-to-run page and best GPU page have the live numbers.
• Try Qwen3.8 Flash Next if you have a small card and plenty of system RAM, and you can set the sampling by hand. Owners disagree on how it compares with 27B, and many bad reports trace to an engine defaulting to greedy decoding.
• Stay on 35B-A3B if speed matters most, your fine-tune depends on it, or it already does the job.

For everything a 24 GB card holds side by side, see the best local LLM for 24 GB.

Which GPU runs it

At Q4_K_M the natural home is a 24 GB card, an RTX 3090 or 4090. With MoE offload, a 16 GB card runs it too, trading speed for the smaller VRAM. The VRAM calculator shows every quant at any context length.

How to run it

ollama run qwen3.6         # the bare tag pulled the 35B-A3B (MoE) when we read it on 26 Sep
# smaller GPU? offload experts with llama.cpp:
llama-server -hf <qwen3.6-35b-a3b-GGUF> --n-cpu-moe 24

When we read the Ollama tags on 26 September, the bare qwen3.6 tag pulled this 35B-A3B and qwen3.6:27b was the dense 27B sibling. Ollama tags can change, so check the size it reports before you pull. The --n-cpu-moe number is how many layers' experts go to RAM; raise it until the model fits your GPU.

Who should skip it

Skip Qwen3.6 35B-A3B if you are starting fresh on a 24 GB card and want the best answers: Qwen3.8 27B is the newer pick there. Skip it on a 12 GB card if you have no patience for offload; a dense model that fits fully will be simpler. And if you only have system RAM and an old GPU, MoE offload works, but expect single-digit tokens per second.