Tag: cost-optimization

Auditing Model Routing and Prompt Caching Before You Trust the Cost Chart

pr0h0•October 27, 2026

A hands-on audit framework for verifying that an LLM gateway's model routing and prompt caching actually cut token spend before you trust the vendor's cost chart.

llm-gatewayprompt-cachingcost-optimization

Measuring Tokens-per-Task in JavaScript Agents with Per-Step Cost Tracing and Budget Limits

pr0h0•September 26, 2026

A hands-on guide to instrumenting JavaScript AI agents with per-step token accounting, cost tracing, and hard budget limits so you can measure real tokens-per-task instead of guessing from aggregate usage.

javascriptai-agentstoken-economics

Cost per Useful Agent Task: Why Cached Tokens Break Naive Inference Pricing Math

pr0h0•September 23, 2026

Naive token-based pricing for LLM agents fails to account for cached tokens and cache-hit rates, leading to inaccurate cost-per-useful-task estimates.

prompt-cachinginference-costllm-agents