multi-gpu

3 articles · newest first

An NVIDIA RTX 3090 and RTX 4090 graphics card side by side, showing the size difference

Multi-GPU for Local AI in 2026: Two Used 3090s vs One RTX 5090

Two used RTX 3090s give you 48GB of VRAM for a third of a 5090's price — so is a dual-GPU build the smart move for local AI? The honest math, whether models really split across cards, and the power-and-complexity costs the sticker price hides.

Tensor · Sep 22 · 8 min

Rows of GPUs mounted in an open server rack used for large-scale AI inference

DeepSeek's 'cheap' AI model costs 3 cents a query in the cloud. running it yourself needs $10k of GPUs

the model that made headlines for being nearly free to rent turns out to be one of the most expensive things you could try to self-host

Tensor · Aug 4 · 6 min

Two graphics cards installed in a desktop PC

Hardware

Two RTX 3090s or one RTX 5090 for local LLMs? The answer isn't the one everyone gives

Two 3090s give you 48GB, but not double the speed for chat, because llama.cpp's default multi-GPU mode makes the cards take turns. What the benchmarks say, rechecked in October 2026.

Voltage · Jul 21 · 11 min