AI
the cheapest way to run Llama 70B isn't buying two GPUs — it's renting one big one for a couple dollars
A dual-GPU rig to run Llama 70B costs $2,000+. But you can rent an A100 that holds it for around a dollar an hour. For anything but constant use, the cloud wins big.
Tensor · Jul 28 · 9 min