Two used 3090s give you 48GB of VRAM for about $2,000; one RTX 5090 gives you 32GB on a single, roughly twice-as-fast card. What each one runs, what it costs per GB, the power it needs and when renting first is the smarter move, from the vendors' own pages read Nov 3, 2026.
Some links on this page are referral links: we may earn a commission, at no cost to you.
Share
Buy two used RTX 3090s if you want to run 70B-class models; buy one RTX 5090 if everything you run fits in 32GB. Two 3090s give you 48GB of VRAM for about $2,000 (hardware-corner.net lists a $1,000 average US market value per card, read Nov 3, 2026), enough for Llama 3.3 70B at Q4, which no single 32GB card can hold. One 5090 runs models that fit in 32GB about twice as fast, at 575W instead of 700W for the pair, with none of the multi-GPU setup. The catch is its price: NVIDIA's Founders Edition lists at $1,999 but was out of stock on NVIDIA's US store on Nov 1, 2026, and hardware-corner.net's average US market value for a 5090 was $3,699 on Nov 3, 2026.
Which is cheaper per GB of VRAM?
Two used 3090s, by a wide margin. VRAM is what decides which models load, so cost per GB is the number that matters most for local AI.
Two used RTX 3090s vs one RTX 5090 (vendor pages and hardware-corner.net, read Nov 3, 2026)
VRAM
2× used RTX 3090
48GB (24GB GDDR6X per card)
1× RTX 5090
32GB GDDR7
Price
2× used RTX 3090
About $2,000 (2 × $1,000 average used)
1× RTX 5090
$3,699 average market value; $1,999 Founders Edition list
Cost per GB
2× used RTX 3090
About $42
1× RTX 5090
About $116 (about $62 at list)
Card power (NVIDIA)
2× used RTX 3090
700W (350W each)
1× RTX 5090
575W
NVIDIA's system power figure
2× used RTX 3090
750W for one card; hardware-corner says 1200–1600W for multi-3090 builds
1× RTX 5090
1000W
Speed on a model that fits one card
2× used RTX 3090
One 3090 scores 51% of a 5090
1× RTX 5090
Baseline (100%)
2× used RTX 3090
1× RTX 5090
VRAM
48GB (24GB GDDR6X per card)
32GB GDDR7
Price
About $2,000 (2 × $1,000 average used)
$3,699 average market value; $1,999 Founders Edition list
Cost per GB
About $42
About $116 (about $62 at list)
Card power (NVIDIA)
700W (350W each)
575W
NVIDIA's system power figure
750W for one card; hardware-corner says 1200–1600W for multi-3090 builds
1000W
Speed on a model that fits one card
One 3090 scores 51% of a 5090
Baseline (100%)
What 1GB of VRAM costs you (our arithmetic, prices read Nov 3, 2026)
2× used RTX 3090$42/GB
$2,000 ÷ 48GB (hardware-corner average, $1,000 per card)
RTX 5090 at Founders Edition list$62/GB
$1,999 ÷ 32GB, if you can find one at list
RTX 5090 at average market value$116/GB
$3,699 ÷ 32GB (hardware-corner average market value)
hardware-corner.net's RTX 5090 page: $3,699 average US market value (no date on the figure; the page says its benchmarks were updated March 2026). Read November 3, 2026. · Screenshot of hardware-corner.net by aliteq
The same site's RTX 3090 page: $1,000 average US market value for a used card. Read November 3, 2026. · Screenshot of hardware-corner.net by aliteq
hardware-corner.net's averages carry no date of their own, so treat them as a guide and check recently sold listings before you pay. The used 3090 price is for one card in unknown condition; our used RTX 3090 buying guide has the checks to run on each one.
What can 48GB run that 32GB can't?
A dense 70B model at a normal 4-bit quantization. That's the whole case for the dual-3090 build. By our VRAM calculator's formula, Llama 3.3 70B at Q4_K_M needs about 40GB for its weights, plus about 2.5GB of KV cache at 8K context and under 1GB of overhead: roughly 43GB. That fits in two 24GB cards with a little room to spare, and doesn't fit in 32GB. hardware-corner.net's 3090 FAQ puts a 70B model at "48–80 GB VRAM depending on quantization."
On a single 5090 you can still load a 70B, but only at about 3-bit (IQ3_XS comes to around 30GB at 8K context in our formula), which leaves almost no room for longer context and costs more quality than Q4. For models up to about 32B, both setups work: Qwen3 32B at Q4_K_M is about 18.5GB of weights, so it fits on one 3090 and on the 5090 with plenty of room for long context. Check your exact model on /cost-to-run/llama-3.3-70b or /cost-to-run/qwen3-32b.
If the biggest models you want are 32B or smaller, the 48GB buys you nothing you'll use, and the 5090's speed is the better deal.
Are two 3090s faster than one 5090?
No. Two cards give you more memory, not more speed for a single chat. hardware-corner.net's relative index puts one RTX 3090 at 51% of an RTX 5090's token-generation speed; on its Qwen3 14B Q4 test the 5090 is listed at 123.8 tokens a second at 4K context and the 3090 at 70.0. A model split across two 3090s still runs at roughly 3090 speed, because of how the split works.
The cleanest like-for-like numbers come from llama.cpp's own community CUDA scoreboard: llama-bench runs of one pinned model on a single GPU. We don't run our own benchmarks, so these are other people's measurements.
Llama 2 7B Q4_0, llama-bench, flash attention on (scoreboard, read Oct 4, 2026)
RTX 5090
Writing the reply (tg128)
300.40 t/s
Reading the prompt (pp512)
14,970 t/s
RTX 3090 Ti
Writing the reply (tg128)
172.26 t/s
Reading the prompt (pp512)
6,924 t/s
RTX 3090
Writing the reply (tg128)
161.89 t/s
Reading the prompt (pp512)
5,560 t/s
5090 vs 3090
Writing the reply (tg128)
1.86x
Reading the prompt (pp512)
2.69x
Writing the reply (tg128)
Reading the prompt (pp512)
RTX 5090
300.40 t/s
14,970 t/s
RTX 3090 Ti
172.26 t/s
6,924 t/s
RTX 3090
161.89 t/s
5,560 t/s
5090 vs 3090
1.86x
2.69x
Two things fall out of that table. Writing a reply tracks memory bandwidth: the 5090 has 1.91 times the 3090's bandwidth (1,792 GB/s against 936 GB/s) and writes 1.86 times as fast. Reading a prompt tracks compute: there the 5090 is 2.69 times faster, far more than bandwidth predicts. If you feed it long documents, whole codebases or agent loops, that prefill gap is the strongest single reason to pick the 5090.
llama.cpp's own options for spreading a model over several GPUs. The default, layer, is pipelined: each card runs its share of the layers in turn. Read November 3, 2026. · Screenshot of github.com/ggml-org/llama.cpp by aliteq
llama.cpp (and the tools built on it, such as Ollama and LM Studio): the default --split-mode layer "split layers and KV across GPUs (pipelined)", per its README. The cards take turns, so a single chat runs at about the speed of one card. --tensor-split 1,1 sets how much goes on each card. The row and tensor modes run the cards in parallel; llama.cpp marks tensor as EXPERIMENTAL.
vLLM: its docs say that if "the model is too large for a single GPU but fits on a single node with multiple GPUs, use tensor parallelism", with --tensor-parallel-size 2 for two cards. That runs both GPUs on each step and suits serving several requests at once, but vLLM takes more setup than Ollama.
The 3090 supports an NVLink bridge (NVIDIA lists "NVIDIA NVLink (SLI-Ready)" in its spec table); llama.cpp's options above work over the normal PCIe slots. If you value speed on models that fit in 32GB, one 5090 is the faster machine.
How much power and PSU do two 3090s need?
More than one 5090. NVIDIA lists 350W of graphics card power for each RTX 3090, so 700W for the pair, against 575W for an RTX 5090. NVIDIA's required system power is 750W for a single 3090 and 1000W for a 5090. For two 3090s, hardware-corner.net's FAQ says "Multi-RTX 3090 setups commonly require power supplies in the 1200 W to 1600 W range."
Should I rent first?
Yes, if you're not sure which you need, or you'd only run the card a few hours a week. When our tracker read prices at 15:20 UTC on Nov 3, 2026, a single 24GB RTX 3090 rented on Vast.ai from $0.11 an hour on-demand and a 32GB RTX 5090 from $0.45 an hour; on Runpod the same cards were $0.50 and $1.19 an hour. An evening on each tells you whether your model fits and whether the speed is enough. Prices change hourly: /cloud-gpu shows today's, and our rent vs buy break-even works out when buying starts to pay.
Pros
+ Two used RTX 3090s: 48GB for about $2,000, about $42 per GB
+ Runs dense 70B models at Q4, which no single 32GB card can
+ Inference splits across cards in llama.cpp, Ollama, LM Studio and vLLM
+ You can start with one 3090 and add the second later
Cons
− More memory, not more speed; one 5090 is about twice as fast on models that fit
− 700W for the two cards; a 1200–1600W power supply, per hardware-corner.net
− Two thick cards need the right motherboard, spacing and airflow
− Two used cards, two sets of unknown history
Verdict
Two 3090s or one 5090
Pick by the biggest model you want to run. If that's a 70B at Q4, buy two used RTX 3090s: 48GB for about $2,000 is the cheapest way to get there, and you accept more power, a bigger PSU and more setup. If everything you run fits in 32GB, buy one RTX 5090: it's about twice as fast, uses less power and just works, but only buy it near its $1,999 list price; at the $3,699 average it's a poor deal for the VRAM. If you'd only use it a few hours a week, rent either one by the hour instead.
Best for: Anyone choosing between a dual-GPU local-AI build and a single high-end card
Common questions
Two used RTX 3090s or one RTX 5090 for local AI: which is better?
Two 3090s if you want 70B-class models: 48GB for about $2,000 (hardware-corner.net average of $1,000 per used card, read Nov 3, 2026) runs Llama 3.3 70B at Q4. One 5090 if your models fit in 32GB: it's about twice as fast, uses 575W instead of 700W, and needs no multi-GPU setup. Its average US market value was $3,699 on Nov 3, 2026, against a $1,999 list price.
Can a single LLM use two GPUs at once?
Yes, for inference. llama.cpp (which Ollama and LM Studio build on) splits a model's layers across GPUs by default, and vLLM uses tensor parallelism with --tensor-parallel-size 2. You get the memory of both cards; with llama.cpp's default layer split you get roughly the speed of one.
Are two RTX 3090s faster than one RTX 5090?
No. hardware-corner.net's index puts one 3090 at 51% of a 5090's token-generation speed, and splitting a model across two 3090s adds memory, not speed for a single chat. The pair only wins when the model is too big for 32GB.
What power supply do I need for two RTX 3090s?
NVIDIA lists 350W per RTX 3090, so 700W for the two cards alone. hardware-corner.net says multi-3090 setups commonly need power supplies in the 1200W to 1600W range. For comparison, NVIDIA's required system power for one RTX 5090 is 1000W.
Can an RTX 5090 run a 70B model?
Only at about 3-bit. Llama 3.3 70B at Q4_K_M needs about 43GB with 8K context by our VRAM engine, more than the 5090's 32GB; at IQ3_XS it comes to around 30GB, which fits with little room for longer context.
Do I need NVLink for two 3090s?
No for llama.cpp-based tools: their split modes work across normal PCIe slots. The RTX 3090 does support an NVLink bridge, per NVIDIA's spec table.
Do the two cards need to be identical?
Not strictly; llama.cpp's --tensor-split lets you give each card a different share. Two matching 3090s keep the VRAM balanced and avoid waiting on a slower card, which is why the dual-3090 build is the common one.
Prices were read on hardware-corner.net on Nov 3, 2026 (its averages carry no date) and on NVIDIA's US marketplace on Nov 1, 2026. Specs and power figures are from NVIDIA's own pages, and the multi-GPU behavior from llama.cpp's and vLLM's own documentation, read Nov 3, 2026. VRAM figures come from our calculator's formula, not a test we ran; we haven't built this machine ourselves. Rental prices are from our tracker of Vast.ai and Runpod at 15:20 UTC on Nov 3, 2026. The Vast.ai buttons are referral links, and we may earn a fee if you rent through them; the advice above often says to buy instead.