benchmarks

2 articles · newest first

Overhead photo of a desk at night with a row of blank white cards above four small trays, one tray holding green sticky notes and another coral ones, while a hand with a pen sorts cards, lit in warm and violet light

You changed the prompt. Is it actually better? LLM evals, explained

An eval is a test for an AI feature: a fixed set of tasks, a way to grade each answer, and a score you can compare before and after a change. Here is how golden sets, graders, LLM judges and regression gates work, read from Anthropic's and OpenAI's own guidance.

Aliteq Team · 3h ago · 12 min

security analyst monitoring code and alerts across multiple screens

Software

Microsoft says its AI beat Anthropic's top security model. read the fine print first

the 96% score is real. the 'we beat Mythos' headline is doing a lot more work than the benchmark actually supports.

Aliteq Team · Aug 3 · 7 min