Provable Inference for LLMs: Latency Costs and What It Misses

A short breakdown of provable inference for LLMs: what a certificate actually claims, what the public record leaves open, the measured latency cost in the author's local harness, and the failure modes a certificate still misses. The harness numbers come from one small classifier, not Anthropic's work. Full write-up: https://hackyjs.com/posts/provable-inference-for-llms-latency-costs-and-failure-modes-it-misses

Read the post →