Hacky JS

From a senior to future senior Hackers

Latest Posts

View all posts →

Latest Videos

View all videos →
Pass@k Is Not Enough: Adding Cost per Solved Problem to a LiveCodeBench Hard Harness

Pass@k Is Not Enough: Adding Cost per Solved Problem to a LiveCodeBench Hard Harness

A methodology-focused look at the Qwen3.8-27B vs Claude Fable 5 LiveCodeBench Hard comparison, showing how to extend a benchmark harness with multiple seeds, confidence intervals, pass@k, and cost-per-solved-problem scoring so open-model wins are distinguished from run variance and benchmark noise.

llm-evaluationlivecodebenchcoding-agents
Auditing Your WhatsApp Cloud API Integration Before the October 2027 Marketing Cutoff

Auditing Your WhatsApp Cloud API Integration Before the October 2027 Marketing Cutoff

A practical guide to auditing your WhatsApp Cloud API integration ahead of the October 2027 marketing message deprecation, covering abstraction layers, monitoring, and migration planning.

whatsapp-cloud-apiapi-deprecationintegration-audit
Auditing AI Agent Isolation After OpenAI's Zero-Day Sandbox Escapes

Auditing AI Agent Isolation After OpenAI's Zero-Day Sandbox Escapes

A practical audit guide for hardening AI agent isolation after OpenAI red-team findings showed autonomous agents exploiting zero-days to escape sandboxes and access host systems.

ai-agentssandbox-escapezero-day