From a senior to future senior Hackers

Latest Posts

View all posts →

Latest Videos

View all videos →
Benchmarking joey-1: throughput, retries, and the real cost of a swap

Benchmarking joey-1: throughput, retries, and the real cost of a swap

joey-1 is reported as a 2B decision model from Baseten at $0.01 per 1M tokens, covered by MarkTechPost and The Next Web on 2026-10-29. This video works through the arithmetic that decides a swap, and why the token price isn't it. At 700 input and 5 output tokens per decision, a million routing calls cost about $7.05 in tokens, $43.50 in escalation at 2%, and $500 for a 0.1% human audit — roughly $550.76 all in, where the model bill is 9% of the total and the audit line is 91%. The post also covers what the launch coverage confirms versus what you still have to verify (billing unit, cached input, minimum billable unit, rate limits), a Node harness with bounded concurrency that times each request, counts retryable attempts and prices calls from the provider's reported usage, and the eval-set rules that make an accuracy delta trustworthy: sample from production logs, over-sample the ambiguous cases, hold out a final fifth, and freeze the prompt pair. Important: the author has not run joey-1. Every figure is stated arithmetic on a reported price with assumptions written out, and the harness output comes from a mock adapter used to validate the instrument. Full write-up: https://hackyjs.com/posts/benchmarking-joey-1-on-throughput-retries-and-total-cost-before-you-swap-models

aiinferencebenchmarking
Open Weights, Licensed Hosting: Auditing Mistral Large 4's Terms for Commercial API Builders

Open Weights, Licensed Hosting: Auditing Mistral Large 4's Terms for Commercial API Builders

Mistral put weights for Mistral Large 4 online for free — coverage describes a 1T-parameter model, published on Hugging Face, with coding performance said to rival a closed frontier model. The same coverage says hosting providers need a licence. That clause is the difference between a download and a product. This walkthrough treats an open-weights release as a distribution decision rather than a permission slip. It splits the licence into four independent grants — running the weights, redistributing them, serving them to third parties, and relicensing a derivative — and explains why silence on any one of them isn't a grant. Then it runs the fifteen-minute audit: pin a revision, pull the licence file, the model card and the architecture config, hash them, and record the date, so the answer is still checkable when the next revision lands. Read the full post: https://hackyjs.com/posts/open-weights-licensed-hosting-auditing-mistral-large-4s-terms-for-commercial-api-builders One caveat the post makes itself: the coverage it draws on does not reproduce the licence text, so the hosting clause's real scope — tenancy, revenue, public availability — has to be verified against the licence file in the repository you actually pull. Nothing here is legal advice, and there's no exploit content: it's licence auditing and record-keeping for teams shipping a commercial API.

mistralopen-weightsai-licensing
Auditing GitHub Issue Automation After a 61-Repo Supply-Chain Campaign

Auditing GitHub Issue Automation After a 61-Repo Supply-Chain Campaign

GitHub issues are an input channel for CI automation. This short walks through the 61-repo issue campaign, why issue text can become shell input, and a defensive audit path: check workflow token permissions, trace issue fields to sinks, and gate write steps with reviewers. Read the full audit: https://hackyjs.com/posts/auditing-github-issue-automation-after-a-61-repo-supply-chain-campaign

githubsupply-chainci-cd