qlora

3 articles · newest first

An abstract visualization of a neural network training

how to fine-tune an AI model on your own data — on a single consumer GPU

You can teach an open model your own style, knowledge, or task on a gaming GPU, in under an hour. The tool is Unsloth, the method is QLoRA, and it fits in as little as 8GB.

Lena Fischer · Aug 1 · 10 min

A cloud GPU workstation for fine-tuning AI models

the best cloud GPU for fine-tuning an LLM costs about a dollar — here's the one to rent and why

Fine-tuning sounds expensive until you realize you can rent the perfect GPU for it by the hour. For small models a 4090 does it for pennies; for bigger jobs an A100 is the workhorse. Here's the cheapest path.

Lena Fischer · Jul 28 · 9 min

A high-end GPU workstation used for AI model training

everyone thinks fine-tuning an AI model costs a fortune. tuning Llama 8B on your own GPU costs about a coffee

The scary numbers you've seen are for training models from scratch. Fine-tuning an existing Llama 8B on your own data with QLoRA fits a 24GB card, uses ~14GB, and costs under a dollar per run if you rent. Here's the real math.

Lena Fischer · Jul 28 · 9 min