evals

1 article · newest first

Overhead photo of a desk at night with a row of blank white cards above four small trays, one tray holding green sticky notes and another coral ones, while a hand with a pen sorts cards, lit in warm and violet light

You changed the prompt. Is it actually better? LLM evals, explained

An eval is a test for an AI feature: a fixed set of tasks, a way to grade each answer, and a score you can compare before and after a change. Here is how golden sets, graders, LLM judges and regression gates work, read from Anthropic's and OpenAI's own guidance.

Aliteq Team · 14h ago · 12 min