From a senior to future senior Hackers

Auditing Reproducibility in Apex-35B, an Agent-Built Qwen3.6 Model
Featured

Auditing Reproducibility in Apex-35B, an Agent-Built Qwen3.6 Model

A technical walkthrough of auditing reproducibility in Apex-35B, an agent-built Qwen3.6 model, examining where agentic training loops break down and what applied ML teams should borrow.

pr0h0•
ai-agentsreproducibilityllm-trainingmodel-evaluationml-engineering

Latest Posts

View all posts →

Latest Videos

View all videos →
What Private Datasets Hide: Auditing Intelligence Index v5 Rankings

What Private Datasets Hide: Auditing Intelligence Index v5 Rankings

Intelligence Index v5 moved to majority private evaluation sets, and the reported ordering shifted: OpenAI models gained ground while Muse Wonder and Kimi dropped. That is where the public report stops — no per-model score deltas, no item counts, no provenance for the private sets. This video walks through what a majority-private index can and cannot tell you. Private is an access label, not a methodology: held-out items, licensed items and vendor-supplied items carry very different risks, and only the first avoids contamination before the run rather than hiding it afterwards. The pipeline still collects items, holds them back or licenses them, scores each model and aggregates — but only the ranking is published, so label noise, run-to-run variance, item counts per category and whether a ranked model saw the items all stay invisible. The useful response is to demote the ranking from evidence to hypothesis. Record the index version and the date you read it, pin the exact model snapshots, and run those snapshots on tasks drawn from your own workload. Directional movement, cost, latency and a second independent methodology still give you something checkable. Read the full audit checklist, the verification table and the section on what hidden sets do to benchmark gaming at https://hackyjs.com/posts/what-private-datasets-hide-auditing-intelligence-index-v5-model-rankings

ai-benchmarksmodel-evaluationllm
Google TPUs on OCI: Capacity, Scheduling, and Abstraction Before 2027

Google TPUs on OCI: Capacity, Scheduling, and Abstraction Before 2027

Oracle plans to offer Google TPUs on OCI from 2027. That single sentence, reported on 28 October 2026, is the entire confirmed claim: no named TPU generation, no region list, no pricing, and no statement about whether buyers reserve capacity or request it on demand. This short works through what to do with a fact that thin. It covers why accelerator capacity planning is really a negotiation over allocation shapes, why a TPU slice is a topology rather than a device, how the job spec ends up naming a geometry instead of a chip, and where the checkpoint interval arithmetic lands once preemption is treated as a scheduled event rather than an incident. The position argued in the post: architect for abstraction at the orchestration layer now, keep the compiler layer vendor-specific, and treat the 2027 date as a reason not to foreclose an option rather than a reason to commit budget. Every performance number and topology sketch in the piece is an assumption to be replaced, not a specification. Full write-up: https://hackyjs.com/posts/google-tpus-on-oci-capacity-scheduling-and-abstraction-before-2027

google-tpuoracle-cloudmulti-cloud
Why One HTTP Header Parser Bug Reached .NET, FFmpeg, ClickHouse, and Apache Arrow

Why One HTTP Header Parser Bug Reached .NET, FFmpeg, ClickHouse, and Apache Arrow

One HTTP header parsing flaw — reported under the researcher names HTTP2Shell and PHP2Shell — has reportedly reached .NET, FFmpeg, ClickHouse, and Apache Arrow, and CISA has reportedly warned that one side is under active attack. This short separates what the public reporting actually supports from what it doesn't: the summaries carry no CVE identifier, no affected version ranges, and no named parser function. Then it looks at the bug class itself. Header parsing is string handling with security consequences, and what spread between these four ecosystems is a permissive mental model — split on the colon, trim, lowercase, merge duplicates, move on — not a single shared line of code. What the video covers: - The reported timeline of 27 and 28 October 2026, and which outlet said what - RFC 9110 and RFC 9112 on whitespace before the colon, obsolete line folding, duplicate field names, and Transfer-Encoding together with Content-Length - The decision points where parsers diverge, and why divergence is the exploitable part - Why Kestrel, FFmpeg's HTTP protocol handler, the ClickHouse HTTP interface, and Arrow Flight all end up parsing headers outside a hardened frontend - The trust boundary that matters: attacker-controlled bytes, parser A, normalized value, parser B - How to scope and test your own exposure before you patch This is defensive, lab-scoped material: header grammar probes only, with no exploit payloads and no target lists. Names are not identifiers — for triage, go to the CISA Known Exploited Vulnerabilities catalog and the vendor bulletin for your specific versions, not to a news summary. The author's sources here are secondary summaries, and the post lists what was not tested. Read the full post: https://hackyjs.com/posts/why-one-http-header-parser-bug-reached-net-ffmpeg-clickhouse-and-apache-arrow

securityvulnerabilityhttp