Small models are quietly taking the boring jobs
Classification, extraction and routing rarely need a frontier model. Moving them down a tier is usually the cheapest performance win available.
Category: AI
Retrieval or a bigger context window: how to actually decide
Context windows got big enough that "just paste everything in" is a real option. Here is where that stops being the cheaper answer.