testing

2 articles · newest first

Hand-drawn editorial illustration of a paper checklist with every box ticked while a small coral beetle walks off the edge of the page, a lavender magnifying glass lying unused beside it

AI wrote your tests and they all pass. Do they prove anything? Unit vs integration tests

A test the AI wrote by reading your code can only agree with your code, bugs included. What unit and integration tests each catch, why coverage misleads, and how a mutation score shows whether your tests would notice a bug, from Fowler, Google, Stryker and PIT.

Aliteq Team · 14h ago · 9 min

Overhead photo of a desk at night with a row of blank white cards above four small trays, one tray holding green sticky notes and another coral ones, while a hand with a pen sorts cards, lit in warm and violet light

Agents

You changed the prompt. Is it actually better? LLM evals, explained

An eval is a test for an AI feature: a fixed set of tasks, a way to grade each answer, and a score you can compare before and after a change. Here is how golden sets, graders, LLM judges and regression gates work, read from Anthropic's and OpenAI's own guidance.

Aliteq Team · 14h ago · 12 min