lora

2 articles · newest first

AI

how to fine-tune an AI model on your own data — on a single consumer GPU

You can teach an open model your own style, knowledge, or task on a gaming GPU, in under an hour. The tool is Unsloth, the method is QLoRA, and it fits in as little as 8GB.

Tensor · Aug 1 · 10 min

AI

everyone thinks fine-tuning an AI model costs a fortune. tuning Llama 8B on your own GPU costs about a coffee

The scary numbers you've seen are for training models from scratch. Fine-tuning an existing Llama 8B on your own data with QLoRA fits a 24GB card, uses ~14GB, and costs under a dollar per run if you rent. Here's the real math.

Tensor · Jul 28 · 9 min