Why Appending to Your Agent's System Prompt Breaks Prompt Caching
pr0h0•
Appending new instructions to an agent’s system prompt invalidates the cached prompt prefix, forcing full-price reprocessing and turning a $21 task into a $200 bill, so cache-stable prompt ordering is an architecture decision.
llm-agentsprompt-cachinginference-cost