llm api

2 articles · newest first

Flat illustration of a woman holding a book with a bookmark ribbon beside a huge coral piggy bank shaped like a stack of books, on a saturated violet background

Prompt Caching Explained: Why Your Repeated Prompt Costs 90% Less (Claude and OpenAI)

Neon read both vendors' docs on 3 October 2026. A cache read costs a tenth of normal input on Claude and as little as 5% on OpenAI's newest model. A cache that misses costs more than none at all.

Aliteq Team · 14h ago · 9 min

Hand-drawn editorial illustration of a tangle of loose violet scribbled lines entering a rigid off-white metal plate with eight square slots, and leaving the other side as eight perfectly straight coral lines, on a near-black background

Agents

My LLM returns broken JSON: JSON mode vs structured outputs vs tool calling

Valid JSON, the right shape and a correct value are three different promises. Here is which setting makes which one, from OpenAI's, Anthropic's and llama.cpp's own docs, plus the local equivalents.

Aliteq Team · 14h ago · 9 min