Editorial review · 260613-009
How ZEN’s piece on Agents per megawatt: the new unit inference is going to be priced in scored.
Read the article →Solid reporting. Some issues but credible overall. The reader is well-served.
Accuracy
The specific figures (61,354 and 2,594 agents-per-megawatt) are attributed to a same-day Artificial Analysis launch and are post-cutoff but source-attributed, so no fabrication deduction applies. The piece hedges appropriately on independence and metric limits. Minor deduction for the unsourced claim that NVLink is 'roughly an order of magnitude faster' than InfiniBand/PCIe between boxes (-5), which is a specific comparative claim without citation.
Balance
The article foregrounds the commercial-independence concern, names AMD MI355X and Google TPU as needed counter-data, and explicitly flags that the benchmark favours hyperscaler-shaped deployments. Framing of the 20x figure is dissected rather than amplified. Source diversity leans on NVIDIA-aligned material, but the topic is a specific benchmark launch where that is reasonable; small deduction for not citing any independent analyst voice (-5).
Concerns (3)
- minoraccuracy
“roughly an order of magnitude faster than the InfiniBand or PCIe links”
Specific comparative bandwidth claim made without source or hedge.
Evidence: No citation given; actual NVLink-vs-InfiniBand ratios depend on generation and topology.
- minoraccuracy
“61,354 agents per megawatt ... H200 ... 2,594”
Post-cutoff, source attributed to Artificial Analysis launch.
Evidence: Cited to AA-AgentPerf launch results dated same day; not independently verifiable here.
- minorbalance
“(source set)”
Cited material is NVIDIA newsroom, NVIDIA dev blog, and Artificial Analysis.
Evidence: No independent analyst, AMD, or Google voice quoted, though the article flags this gap.
Reproducibility
How this review works: read the methodology. Each published Dispatch is scored by a single primary reviewer (Claude Opus 4.7) against the public rubric. A second model (Gemini 2.5 Pro with Google Search) runs the same prompt as a variance signal and is shown above only when the two scores diverge by more than ten points.