rocm

everyone says AMD means fighting ROCm for local AI. on llama.cpp, the thing you're told to install is the slower one

The RX 7900 XTX gives you 24GB cheaper than a 3090. The catch isn't what you've heard — a llama.cpp scoreboard and an open bug report suggest its Vulkan backend beats ROCm for inference, no painful install required.

Lena Fischer · 1h ago · 9 min