Artificial Analysis Clarifies Mercury 3 Benchmark Scores Are Not Comparable
In response to Inception's claim that Mercury 3 outperforms models like GPT-6 Luna, Artificial Analysis clarified that the cited AA-Omniscience and GDPval-AA v2 scores do not follow their official methodology. Due to private datasets and differing grading standards, these metrics are not comparable to scores on the Artificial Analysis Intelligence Index.
Full Report
Artificial Analysis (@ArtificialAnlys) · 2026-10-19 19
Note that this is not our Intelligence Index. The announcement also referred to scores for AA-Omniscience and GDPval-AA v2, which do not follow our methodology and are not comparable to scores on Artificial Analysis.
AA-Omniscience uses a private dataset (though we open sourced a public subset of 10%) and GDPval-AA v2 needs to use our grading methodology and our model comparison set to be comparable.
↳ 引用 @_inception_ai (Inception): Mercury 3 is live: the most capable diffusion LLM released to date.
It outperforms GPT-6 Luna and Claude Haiku 5.5 across a range of benchmarks while running at over 1,000 tokens per second.
More than 40x the size of Mercury 1, 3x more intelligent across standard benchmarks, and just as fast, with a 1M-token context window.
Available today on the Inception API, @baseten, and @OpenRouter .