llm 92% Cached: The Economics That Let One Mac Serve 12x More Coding Agents
A public benchmark showed 92% of coding-agent tokens were served from cache — a 12.5x cost difference. A teardown of oMLX's prefix cache, the six gaps in it, and the three ceilings that decide how many agents one machine can serve.