mac

1 article · newest first

Hand-drawn editorial illustration of a laptop with a tall stack of off-white memory blocks on its keyboard, part of the stack lifted by a violet hand pulling a lever along a coral dashed line

MLX vs llama.cpp on a Mac: Which Runtime to Pick, and the Memory Limit That Matters

Four ways to run a local model on Apple silicon: mlx-lm, llama.cpp, Ollama and LM Studio. I read each project's docs to sort out who each is for, which model files they take, and the one sysctl the MLX README tells you to try when a model runs slow.

Aliteq Team · 14h ago · 9 min