llama-3

3 articles · newest first

AI

I priced out every way to run a 70B AI model at home — the cheapest one isn't what you'd guess

Four real paths to running a 70B-parameter model on your own hardware or by the hour — priced out with actual 2026 numbers.

Lena Fischer · Aug 4 · 8 min

AI

how to run Llama locally — Meta's famous open model, on your own PC in one command

Llama is the open model that kicked off the whole local-AI movement, and running it yourself is genuinely one command. Here's how, and which size fits your GPU.

Lena Fischer · Aug 3 · 10 min

AI

everyone thinks fine-tuning an AI model costs a fortune. tuning Llama 8B on your own GPU costs about a coffee

The scary numbers you've seen are for training models from scratch. Fine-tuning an existing Llama 8B on your own data with QLoRA fits a 24GB card, uses ~14GB, and costs under a dollar per run if you rent. Here's the real math.

Lena Fischer · Jul 28 · 9 min