Hy4 Flash on Long-Context RAG: What $0.07 per Million Tokens Actually Costs

Tencent lists Hy4 Flash with a 1M-token context at $0.07 per million tokens. This is what that price does to a long-context RAG pipeline once you work it through: cost per thousand requests for retrieval, stuffed context and agent loops, why prefill makes latency the binding constraint past 100K tokens, and the crossover point where retrieval stops paying for itself. None of the Hy4 Flash numbers here are measured. The cost figures are arithmetic from the published price, the time-to-first-token curve is explicitly modelled on assumed prefill throughput, and the harness is written so you can fill in your own endpoint numbers. Full write-up: https://hackyjs.com/posts/testing-tencent-hy4-flash-on-long-context-rag-cost-latency-and-recall-tradeoffs

llmraglong-contextinference-costbenchmarking

Read the post →