aliteq.

RTX 3080: 12 GB, what it runs and what it costs

Specs checked · Aliteq Team · How we compute this

The short answer

The NVIDIA GeForce RTX 3080 12GB has 12 GB of VRAM and 912 GB/s of memory bandwidth (2022). At Q4_K_M quality or better with an 8K context it runs 14 of the open models we track; the largest that fits with room to spare is Gemma 3 12B. We don't see it for rent on the providers we track right now.

VRAM
12 GB
Bandwidth
912 GB/s
Board power
350 W
Launched
2022

Source: NVIDIA specification · bandwidth not yet confirmed by a second source, so we don't estimate speed from it

Buy it or rent it

Not for rent on the providers we track right now. See every card that is.

Which AI models run on the RTX 3080

Computed by our VRAM engine for an 8K context: the best quality each model fits at in 12 GB. Speeds are upper-bound estimates from memory bandwidth, not benchmarks.

ModelBest fitVRAM used~tok/s
DeepSeek R1 Distill 14BQ5_012 GB98% · tight—
Qwen2.5-Coder 14BQ5_012 GB98% · tight—
Qwen3 14BQ5_K_M12 GB98% · tight—
Phi-4 14BQ5_012 GB98% · tight—
Gemma 3 12BQ6_K11 GB88%—
Gemma 4 12BQ6_K10 GB84%—
Qwen3.5 9BQ8_011 GB88%—
Qwen3 8BQ8_010 GB83%—
Gemma 4 E4BQ8_09 GB73%—
Qwen2.5 7B InstructQ8_09 GB73%—
Mistral 7B Instruct v0.3Q8_09 GB75%—
Gemma 4 E2BF1610 GB86%—

Fits only below Q4 quality: Qwen3.5 27B (IQ3_XS), Qwen3.6 27B (IQ3_XS), Qwen3.8 27B (IQ3_XS), Gemma 4 26B-A4B (MoE) (Q2_K), Mistral Small 24B (Q2_K).

Too big for 12 GB (rent a bigger card instead): what it costs to run Qwen3 30B-A3B (MoE), what it costs to run Qwen3-Coder 30B-A3B (MoE), what it costs to run Gemma 4 31B, what it costs to run NVIDIA Nemotron 3 Nano 30B-A3B (MoE).

Check a model and context of your own in the VRAM calculator.

AI video on the RTX 3080

Alibaba's Wan 2.2 is an open video model you can run yourself in ComfyUI. With 12 GB the RTX 3080 fits:

  • Wan 2.2 5B, with ComfyUI's native offloading (8 GB and up, per ComfyUI's Wan 2.2 docs)

What each setup needs, the cheapest card to rent and what one clip costs: cloud GPUs for ComfyUI with Flux and Wan 2.2. Against an app or an API: AI video cost per clip, app vs API vs rented GPU. Rather not run a model yourself? Hosted video models such as Seedance, Veo and Hailuo are compared in Kling AI alternatives, priced per clip.

Our guides on the RTX 3080

Cards to compare it with

Every card by VRAM tier: all GPUs for gaming and local AI.

RTX 3080: common questions

How much VRAM does the RTX 3080 have?
12 GB, with 912 GB/s of memory bandwidth, per the maker's specification.
What is the biggest AI model the RTX 3080 can run?
Of the open models we track, Gemma 3 12B is the largest that fits at Q4_K_M or better with an 8K context and room to spare (about 11 GB of 12 GB). DeepSeek R1 Distill 14B also squeezes in, but with almost no memory left for longer context. Bigger models only fit at lower-quality quants or need more memory.
Can I rent an RTX 3080 in the cloud?
We don't see it on Vast.ai, Runpod or the other providers we track right now. The cloud GPU table lists every card that is for rent.
Is 12 GB enough?
1080p and light 1440p gaming; small local models (7–8B) at good quality.