what is model distillation

1 article · newest first

A silver molecular network structure on a black background

what are DeepSeek R1's distilled models? Why a 14B can rival a giant (2026)

You keep seeing 'R1 distill 8B/14B/32B' — but what does 'distilled' mean, and why is a small distill so good at reasoning? Here's the plain-English explanation.

Lena Fischer · 2h ago · 10 min