Artificial Analysis 澄清 Mercury 3 基准分不可比

原标题:Note that this is not our Intelligence Index. The announcement also referred to scores for AA-Omnisc...
45AI 研判分

针对 Inception 发布 Mercury 3 并宣称超越 GPT-6 Luna 等模型的声明,Artificial Analysis 指出其引用的 AA-Omniscience 和 GDPval-AA v2 分数并非基于官方 Intelligence Index。由于数据集私有及评估方法差异,这些分数与 Artificial Analysis 标准榜单不具备可比性。

报道正文

Artificial Analysis (@ArtificialAnlys) · 2026-10-19 19

Note that this is not our Intelligence Index. The announcement also referred to scores for AA-Omniscience and GDPval-AA v2, which do not follow our methodology and are not comparable to scores on Artificial Analysis.

AA-Omniscience uses a private dataset (though we open sourced a public subset of 10%) and GDPval-AA v2 needs to use our grading methodology and our model comparison set to be comparable.

↳ 引用 @_inception_ai (Inception): Mercury 3 is live: the most capable diffusion LLM released to date.

It outperforms GPT-6 Luna and Claude Haiku 5.5 across a range of benchmarks while running at over 1,000 tokens per second.

More than 40x the size of Mercury 1, 3x more intelligent across standard benchmarks, and just as fast, with a 1M-token context window.

Available today on the Inception API, @baseten, and @OpenRouter .