apple silicon

14 articles · newest first

Hand-drawn editorial illustration of a laptop with a tall stack of off-white memory blocks on its keyboard, part of the stack lifted by a violet hand pulling a lever along a coral dashed line

MLX vs llama.cpp on a Mac: Which Runtime to Pick, and the Memory Limit That Matters

Four ways to run a local model on Apple silicon: mlx-lm, llama.cpp, Ollama and LM Studio. I read each project's docs to sort out who each is for, which model files they take, and the one sysctl the MLX README tells you to try when a model runs slow.

Aliteq Team · Oct 16 · 9 min

Photoreal macro of a bare processor chip on a dark indigo surface with a thin warm rim light

Software

macOS 27 has an AI model in Terminal: what the fm command does, and what Apple doesn't say

Apple's new Mac update ships a command called fm that talks to its on-device language model. No account, no API key, no install. I read Apple's own docs and WWDC sessions to find out what it can do, which Macs get it, and the numbers Apple left out.

Aliteq Team · Oct 11 · 7 min

Low-angle macro photo of the front edge of a small silver aluminum desktop computer on a dark desk, a tiny green status light glowing, violet and coral light behind it

Hardware

Before You Buy a Mac Mini for Local AI, Read This (It’ll Save You $1,800)

I mapped every Mac mini and Mac Studio Apple sells today, all 17 configs, against 13 popular local AI models. If your biggest model is 27B-class, the math says a $1,299 Mac mini holds what a $3,099 Mac Studio holds.

Aliteq Team · Oct 4 · 16 min

Flat illustration of a person at a desk with a small plain mini desktop computer and an AI brain shape split into two pieces above it

gpt-oss-20b on a Mac mini (16GB): yes, but get 24GB

llama.cpp's own guide runs it on a 16GB Mac with one flag. But on a Mac the CPU and GPU share one pool of memory, so the whole model still has to fit, and 16GB leaves almost nothing for macOS. Here's the maths.

Aliteq Team · Sep 25 · 6 min

Apple Mac mini compact desktop computer on a desk

Hardware

Apple just launched two new Macs with zero fanfare — and the cheap one is the interesting one

No keynote, no event — just a $899 Mac mini with a 2-nanometer chip and a $5,499 Mac Studio built for serious AI work.

Aliteq Team · Aug 26 · 7 min

Apple Mac Studio desktop computer on a desk

Hardware

Apple's new Mac Studio has more AI memory than a $13,000 Nvidia box. let that sink in

The M5 Ultra tops out at 512GB of unified memory — here's the actual math on whether that beats a real GPU for running big local models.

Aliteq Team · Aug 26 · 8 min

apple quietly cut its priciest Mac's RAM by 81% — and it might still be the smarter local-AI buy

Apple's own memory shortage just raised Mac Studio prices and gutted its top RAM tier — here's whether it's still worth buying over a GPU PC for running models at home.

Aliteq Team · Aug 4 · 8 min

An Apple Mac Studio on a desk, used for running local AI models

someone measured the real electricity cost of running AI at home. it's almost nothing

A developer wall-calibrated an Apple Silicon power meter against a smart plug and found the real number: fractions of a cent per million tokens.

Aliteq Team · Aug 3 · 6 min

Apple's Mac Studio desktop computer on a desk

Hardware

apple's mac studio just beat nvidia's own local-AI chip — and the win doesn't add up

Tom's Hardware ran the numbers on three very different local-AI machines, and the Mac won on raw speed almost across the board — just not by the margin its spec sheet promised.

Aliteq Team · Aug 2 · 6 min

the best laptop for running local AI in 2026 is a MacBook — and it's not close, for one reason

Gaming laptops have fast GPUs, but they cap out at 16GB of VRAM. A MacBook Pro's unified memory goes to 128GB. For running AI models on the go, memory wins.

Aliteq Team · Jul 30 · 9 min

Mac Mini M4 or M4 Pro for local AI? the answer comes down to one number you set at checkout

Both run local models silently and efficiently, but the gap between them for AI isn't the chip — it's the memory bandwidth and how much you can buy. Here's which Mac Mini to get.

Aliteq Team · Jul 28 · 9 min

Apple Mac mini held in one hand, showing its small size

the $1,999 Mac mini runs a 30B model in near silence on 40 watts. here's the catch nobody puts in the headline

A palm-sized box that sips power and runs mid-size local models is a genuinely great story — until you ask it to process a long prompt. What the M4 Pro Mac mini is brilliant at, and the one thing it's quietly bad at.

Aliteq Team · Jul 22 · 9 min

Mac vs NVIDIA for AI: the M5 Mac Studio changed the math on local LLMs

Older Macs held huge models but crawled through long prompts. On llama.cpp's own scoreboard, the M5 Max and M5 Ultra now match or beat a used RTX 3090 on small models. Here is where each machine still wins, with the numbers and their caveats.

Aliteq Team · Jul 22 · 10 min

DGX Spark for local LLMs: fast at reading prompts, slow at writing replies

Same machine, same benchmarks, three months apart: prefill improved 27%, generation got slower on every model. Tokens per second for seven models, the $4,699 price, and who should actually buy one.

Aliteq Team · Jul 21 · 11 min