
MLX or llama.cpp on a Mac? Pick the runtime and know the memory limit
Four ways to run a local model on Apple silicon: mlx-lm, llama.cpp, Ollama and LM Studio. I read each project's docs to sort out who each is for, which model files they take, and the one sysctl the MLX README tells you to try when a model runs slow.
Ari Vale · · 9 min






