gemma

7 articles · newest first

Editorial infographic of three model badges converging on a single 24GB graphics card with a fork in the path, near-black background, indigo-violet with a coral accent

Which 24GB-class model should you run? Mistral Small 24B vs Qwen3.6 27B vs Gemma 4 31B

You've got a 24GB card and three excellent dense models that fit it. Here's how Mistral Small 24B, Qwen3.6 27B and Gemma 4 31B differ on VRAM, context and modality — and a clear pick for each kind of user.

Tensor · Sep 26 · 7 min

Editorial infographic of a mixture-of-experts model: a few active expert blocks on a GPU and the rest resting in system memory, near-black background, indigo-violet with a coral accent

Gemma 4 26B-A4B locally: the Gemma that runs fast on 16GB

Gemma 4's mixture-of-experts model holds about 26B parameters but activates only 3.8B — so it's quick, and it fits a 16GB card at Q4. The VRAM math, the GPU, and the run command.

Tensor · Sep 26 · 7 min

Realistic painterly illustration of a large glowing processor die radiating soft light on a dark surface, deep indigo-violet with a warm coral highlight

Gemma 4 31B locally: the 24GB-card Gemma

Gemma 4 31B is the big dense Gemma — the one that asks for a 24GB card and rewards it. The VRAM per quant, the GPU that fits, and how to run it without pulling the wrong tag.

Tensor · Sep 26 · 7 min

Isometric diorama of a friendly glowing AI chip seated on a mid-range graphics card, near-black background, indigo-violet with a coral accent

Gemma 4 12B locally: the VRAM, the GPU, and one Ollama gotcha

Google's Gemma 4 12B is the multimodal open model that fits a mid-range card — if you pull the right Ollama tag. The honest VRAM math, the cheapest GPU that runs it, and how to start.

Tensor · Sep 26 · 7 min

A person using an AI chatbot app on an Android phone

before you drop $800 on a GPU for AI, know what your phone can already do for free

Android Police ran a real local model on a real phone as a daily driver. it's not a GPU replacement — but it covers more than the GPU-shopping conversation usually admits.

Tensor · Aug 16 · 6 min

A small ESP32-S3 microcontroller development board on a workbench, the $8 chip now capable of running a 28.9-million-parameter AI language model.

Hardware

someone got a real ai talking on a chip that costs less than your coffee

A hobbyist just proved a genuine language model can run entirely on an $8 microcontroller — no cloud, no GPU, no internet connection required.

Voltage · Aug 6 · 6 min

A small ESP32-S3 microcontroller development board wired up on a workbench

someone crammed a working AI language model onto a $10 chip. it writes actual stories

No cloud, no Wi-Fi, no GPU — just a cheap microcontroller quietly telling itself bedtime stories, one token at a time.

Tensor · Jul 31 · 6 min