vllm

2 articles · newest first

A developer's laptop screen showing a terminal window running a local AI model

I compared Ollama, vLLM and LM Studio — only one of them survives a second user

at one person typing, all three are basically tied. add a second and the gap turns into a cliff

Lena Fischer · Aug 22 · 7 min

A server rack with network cabling in green light

how to turn your local AI into an API — a private, free drop-in for the OpenAI API

Point your apps, scripts, and coding tools at a model on your own machine instead of a paid cloud API. It's an OpenAI-compatible endpoint, it's free, and it's one command to start.

Lena Fischer · Aug 1 · 10 min