
AI
I compared Ollama, vLLM and LM Studio — only one of them survives a second user
at one person typing, all three are basically tied. add a second and the gap turns into a cliff
Lena Fischer · Aug 22 · 7 min
2 articles · newest first

at one person typing, all three are basically tied. add a second and the gap turns into a cliff
Lena Fischer · Aug 22 · 7 min

AMD's own numbers put its workstation GPU at 53 tokens a second on Meta's new 30B model. Nvidia's flagship does more — for over three times the price.
Ravi Malhotra · Aug 11 · 6 min