a100

2 articles · newest first

AI

the best cloud GPU for fine-tuning an LLM costs about a dollar — here's the one to rent and why

Fine-tuning sounds expensive until you realize you can rent the perfect GPU for it by the hour. For small models a 4090 does it for pennies; for bigger jobs an A100 is the workhorse. Here's the cheapest path.

Lena Fischer · 2d ago · 9 min

AI

the cheapest way to run Llama 70B isn't buying two GPUs — it's renting one big one for a couple dollars

A dual-GPU rig to run Llama 70B costs $2,000+. But you can rent an A100 that holds it for around a dollar an hour. For anything but constant use, the cloud wins big.

Lena Fischer · 2d ago · 9 min