sm120

NVFP4 is Nvidia's 4-bit trick that gets FP8 accuracy at 3x the speed — but only on Blackwell

The new 4-bit format baked into RTX 50-series and Blackwell chips runs AI models at up to 3x the inference throughput of FP8, at nearly the same accuracy. Here's how it works and why it's exclusive to your newest GPU.

Lena Fischer · 2d ago · 8 min