Pass@k Is Not Enough: Adding Cost per Solved Problem to a LiveCodeBench Hard Harness

Pass@k Is Not Enough: Adding Cost per Solved Problem to a LiveCodeBench Hard Harness
A methodology-focused look at the Qwen3.8-27B vs Claude Fable 5 LiveCodeBench Hard comparison, showing how to extend a benchmark harness with multiple seeds, confidence intervals, pass@k, and cost-per-solved-problem scoring so open-model wins are distinguished from run variance and benchmark noise.
llm-evaluationlivecodebenchcoding-agentsinference-costbenchmarking