AMD Instinct MI300X: 192 GB, what it runs and what it costs
Specs checked · Rental prices from 18m ago · Aliteq Team · How we compute this
The short answer
The AMD Instinct MI300X has 192 GB of VRAM and 5300 GB/s of memory bandwidth (2023). At Q4_K_M quality or better with an 8K context it runs 43 of the open models we track; the largest that fits with room to spare is Qwen3.5 122B-A10B (MoE). The cheapest rental right now is $2.390/hr (Runpod, on demand).
- VRAM
- 192 GB
- Bandwidth
- 5300 GB/s
- Board power
- 750 W
- Launched
- 2023
Source: AMD specification · bandwidth not yet confirmed by a second source, so we don't estimate speed from it
Buy it or rent it
| Provider | Type | From, per hour | Rent |
|---|---|---|---|
| Runpod | On demand | $2.390/hr | Runpod |
Lowest price per provider in our hourly snapshot (18m ago). Rent buttons are referral links. Every card side by side: cloud GPU prices.
Which AI models run on the AMD Instinct MI300X
Computed by our VRAM engine for an 8K context: the best quality each model fits at in 192 GB. Speeds are upper-bound estimates from memory bandwidth, not benchmarks.
| Model | Best fit | VRAM used | ~tok/s |
|---|---|---|---|
| Qwen3 235B-A22B (MoE) | Q6_K | 182 GB95% · tight | — |
| MiniMax-M2.5 (MoE) | Q6_K | 177 GB92% · tight | — |
| Qwen3.8-Flash-Next (MoE) | Q8_0 | 179 GB93% · tight | — |
| Qwen3.5 122B-A10B (MoE) | Q8_0 | 125 GB65% | — |
| NVIDIA Nemotron 3 Super 120B-A12B (MoE) | Q8_0 | 123 GB64% | — |
| gpt-oss 120B (MoE) | Q8_0 | 117 GB61% | — |
| Llama 4 Scout 17B-16E (MoE) | Q8_0 | 109 GB57% | — |
| GLM-4.5-Air (MoE) | Q8_0 | 107 GB56% | — |
| Qwen3-Next 80B-A3B (MoE) | F16 | 150 GB78% | — |
| Qwen3-Coder-Next 80B-A3B (MoE) | F16 | 149 GB78% | — |
| DeepSeek R1 Distill 70B | F16 | 135 GB70% | — |
| Mixtral 8x7B (MoE) | F16 | 89 GB46% | — |
Fits only below Q4 quality: MiniMax-M3 (MoE) (Q2_K).
Too big for 192 GB (rent a bigger card instead): what it costs to run GLM-5.3 (MoE), what it costs to run DeepSeek V4.1 Flash (MoE), what it costs to run DeepSeek V4 Pro (MoE), what it costs to run Kimi K3 (MoE).
Check a model and context of your own in the VRAM calculator.
Cards to compare it with
- B200 · 192 GB
- H200 SXM · 141 GB
- RTX PRO 6000 Blackwell Server Edition · 96 GB
- H100 SXM · 80 GB
- A100 SXM · 80 GB
- H100 PCIe · 80 GB
Every card by VRAM tier: all GPUs for gaming and local AI.