ALITEQ.

A new AI model just ran real agent tasks on a Raspberry Pi no GPU, no cloud bill, nothing

Liquid AI's new LFM2.5-2.6B beats models four times its size at tool-calling and runs entirely on-device — down to a Raspberry Pi. Here's what that actually means before you cancel your GPU shopping.

Lena FischerUpdated 1h ago8 min readWeb story
A Raspberry Pi single-board computer, the kind of hardware Liquid AI's LFM2.5-2.6B can run agentic AI tasks on

Liquid AI released a 2.69-billion-parameter model this week called LFM2.5-2.6B, and on its own tool-calling benchmark it beats Qwen3.5-9B — a model more than three times its size — 77.83 to 76.44 on ToolSandbox. It runs entirely on-device: phones, laptops, PCs, and, according to VentureBeat, hardware as modest as a Raspberry Pi. No GPU, no cloud API bill, no data leaving the device. That's the real claim, and the numbers behind it are worth walking through before you decide what it actually changes for you.

The numbers behind the claim

LFM2.5-2.6B vs. larger models, per Liquid AI's published benchmarks

ToolSandbox

Benchmark
77.83
LFM2.5-2.6B
76.44
Qwen3.5-9B
65.00

Multi-IF

Benchmark
80.07
LFM2.5-2.6B
62.55
Qwen3.5-9B
77.35

IFStruct

Benchmark
85.49
LFM2.5-2.6B
78.50
Qwen3.5-9B
76.65

IFBench

Benchmark
59.17
LFM2.5-2.6B
56.47
Qwen3.5-9B
39.24

BFCLv4

Benchmark
56.88
LFM2.5-2.6B
60.13
Qwen3.5-9B
46.39

LiveCodeBench v6

Benchmark
59.41
LFM2.5-2.6B
69.86
Qwen3.5-9B

Read that table honestly and the picture is more interesting than a clean win. LFM2.5-2.6B leads on three of the four instruction-following and tool-use metrics against a model nearly four times larger — that's the genuinely impressive part, since parameter-efficient tool-calling is exactly what makes a model viable to run on a phone in the first place. But it loses on BFCLv4, a broader function-calling benchmark, and clearly loses on LiveCodeBench v6, a coding-specific test. This is a specialist model, not a smaller version of a generalist one. Liquid AI says as much directly: it's built for agentic workloads, not agentic coding.

How fast is it really, and where

220 tok/s

Apple M5 Max

under 2.5GB memory

113 tok/s

AMD Ryzen CPU

~30 tok/s

Phone (on-device)

131,072 tokens

Context window

A smartphone displaying an AI assistant interface, representative of on-device model use
Liquid AI clocked roughly 30 tokens per second running LFM2.5-2.6B directly on a phone — no network round trip required. · Unsplash

What it's actually good for (and bad for)

  • Good: tool calling and multi-step agent workflows — the exact thing it's benchmarked against.
  • Good: structured data extraction and long-context document work, helped by the 131K context window.
  • Good: retrieval-augmented generation (RAG) pipelines running entirely on-device.
  • Good: always-on background automation — calendar management, workflow routines, connectivity-limited settings like vehicles and robotics.
  • Bad: agentic coding — it loses clearly to larger models on LiveCodeBench v6.
  • Bad: deep knowledge-heavy question answering, where raw parameter count still matters.

The cost angle is the part I think gets underplayed in coverage like this. Once a model this size is downloaded, the marginal cost of every additional run is effectively zero — no API metering, no per-token cloud bill, no data leaving the device. That's a genuinely different economic model from calling a hosted API for every agent step, and it's why Liquid AI is positioning this specifically at regulated industries and always-on background automation rather than at chatbot replacement. Weights are open on Hugging Face under Liquid's own lfm1.0 license, with day-one support across llama.cpp, MLX, vLLM, SGLang and ONNX — so there's no lock-in to a specific runtime to try it.

On-device 2.6B vs. a local GPU running a 14B–20B model

LFM2.5-2.6B, no GPU

Phone / CPU / Pi

vs

14B–20B model

Needs a 12–16GB GPU

$0 extra (existing device)
Hardware cost
$300–700 GPU
Strong for its size
Tool-calling accuracy
Generally stronger overall
Weak
Coding ability
Meaningfully better
Minimal
Power draw
150–250W under load
Always-on agents, RAG, extraction
Best fit
General-purpose local assistant
GPU wins 3wins 2 model

My take: this doesn't replace the GPU-buying conversation this site spends most of its time on — it narrows it. If what you actually want is a general local chatbot that can code, reason deeply, and hold a wide-ranging conversation, you still want real VRAM; see how much RAM you need for local AI and whether an 8GB card is enough for that path. But if what you actually need is a background agent that calls tools, extracts data, and runs a workflow without touching the cloud, LFM2.5-2.6B genuinely means you might not need to buy anything at all. Those are two different jobs, and conflating them is how you end up either overspending on hardware you didn't need or under-provisioning a project that actually needed a real GPU.

7/ 10

Verdict

Is this worth trying?

Yes, and it costs nothing to test — the weights are open and it runs on hardware you probably already own. Just be honest about which job you're hiring it for; it's a tool-calling specialist, not a general-purpose local ChatGPT replacement.

Best for: Anyone building always-on agents, RAG pipelines, or automation on hardware without a GPU — not coders looking for a local Copilot.

Common questions

Can it really run on a Raspberry Pi with no GPU?
Yes — Liquid AI and VentureBeat both confirm it runs on devices as small as a Raspberry Pi, using CPU inference with under 2.5GB of memory in its published benchmarks.
Is it better than Qwen3.5-9B?
It beats Qwen3.5-9B on three of four tool-use and instruction-following benchmarks despite being roughly a quarter of the parameter count, but loses on BFCLv4 and coding tasks.
Is it free to use?
Weights are open on Hugging Face under Liquid AI's own lfm1.0 license, with day-one support in llama.cpp, MLX, vLLM, SGLang and ONNX.
Should I use it instead of a local GPU setup?
Only for the jobs it's built for — tool-calling agents, RAG, and data extraction. For coding or deep reasoning, a GPU running a larger model is still the better choice.

The bigger trend worth watching is how fast the on-device tier is closing the gap on tasks that used to require real infrastructure. A year ago, tool-calling agents this capable meant a cloud API call or a dedicated GPU box. Now it means a phone you already own. That doesn't kill the local-GPU market — coding, reasoning and general-purpose assistants are still firmly GPU territory — but it does mean the next question worth asking isn't just what to buy, but whether you need to buy anything at all.

AI & Local Compute Editor

Lena Fischer

Lena runs more GPUs at home than she'll admit to and has quantized more models than she's finished reading about. She writes about running AI on your own hardware — what actually fits, what's genuinely fast, and what the polished cloud demos quietly leave out.

Work out the hardware

The Aliteq brief

The tech worth knowing — hardware, AI, gaming, deals. No spam, unsubscribe anytime.

Keep reading