From a senior to future senior Hackers

Why Appending to Your Agent's System Prompt Breaks Prompt Caching
Featured

Why Appending to Your Agent's System Prompt Breaks Prompt Caching

Appending new instructions to an agent’s system prompt invalidates the cached prompt prefix, forcing full-price reprocessing and turning a $21 task into a $200 bill, so cache-stable prompt ordering is an architecture decision.

pr0h0•
llm-agentsprompt-cachinginference-costsystem-promptsai-architecture

Latest Posts

View all posts →

Latest Videos

View all videos →
Provable Inference for LLMs: Latency Costs and What It Misses

Provable Inference for LLMs: Latency Costs and What It Misses

A short breakdown of provable inference for LLMs: what a certificate actually claims, what the public record leaves open, the measured latency cost in the author's local harness, and the failure modes a certificate still misses. The harness numbers come from one small classifier, not Anthropic's work. Full write-up: https://hackyjs.com/posts/provable-inference-for-llms-latency-costs-and-failure-modes-it-misses

llm-inferenceformal-verificationai-safety
Vetting Heim Datacenter's EU Expansion: Latency Budgets, Failover, Exit Terms

Vetting Heim Datacenter's EU Expansion: Latency Budgets, Failover, Exit Terms

Heim Datacenter took Omnes Capital investment for a European expansion, and that headline is the entire public substance. This short walks through how to vet the announcement as an engineering decision instead of a press release: separating what was actually stated from the gaps that decide your architecture, sizing the datacenter-attributable slice of a 300 millisecond p95 budget, probing from the instance class you intend to buy with a cold connection per sample, and the sampling window and jitter measurements that keep a single week of data from misleading you. It closes on the exit terms that belong in the contract rather than in a call: termination for convenience, the egress price list and its notice period, and how you export your data. Full write-up, including the due-diligence questionnaire and the Node.js harness: https://hackyjs.com/posts/vetting-heim-datacenters-european-expansion-latency-failover-and-exit-terms

datacenterlatencyfailover
Trust Boundaries in AI Coding Extensions: Auditing What Cursor Installs and Executes

Trust Boundaries in AI Coding Extensions: Auditing What Cursor Installs and Executes

A malicious Claude Code extension served through Cursor's supply-chain path is a reminder that the editor is the least-audited privileged process on a developer laptop. We keep lockfiles for npm dependencies and SBOMs for production services, then install extensions into a Node.js process that can read ~/.ssh and ~/.aws/credentials, inherit every token exported in the launching shell, and spawn any binary the user can spawn. This video walks the reproducible part: how the VS Code extension host works and why it is a full runtime rather than a sandbox, how activation events like a wildcard event or a workspace-contains rule fire with no user action, and what the terminal commands show when you list your installed extensions and read the metadata record for versions and install paths. It also covers why a marketplace signature is a tampering control and not a code review, why an AI coding extension turns a static install into a standing capability because the model chooses commands at runtime, and how project-scoped MCP server entries can arrive with a clone. The fix is scoped and practical: deny by default and allowlist specific command prefixes, review project-scoped MCP servers before they start, pin extension versions, and treat auto-run as equivalent to running the repository's code with your credentials. Defensive, lab-scoped, and runnable on your own machine. On the underlying report: SecurityWeek published a piece on 2 November 2026 describing a malicious extension distributed under Claude Code branding through the Cursor distribution path. Details such as the extension identifier, affected version range, and payload behaviour are not established here, and this video does not guess at them. The audit steps work whether or not an advisory ever exists. Full write-up: https://hackyjs.com/posts/trust-boundaries-in-ai-coding-extensions-auditing-what-cursor-installs-and-executes

supply-chain-securitycursorai-coding-agents