Termsslug: aa-lcr-25

AA-LCR-25

Long-context reasoning benchmark; v1.1 raises repeats per question to 25 to tighten confidence intervals.

Curated Intelligence

1 items · Page 1/1
Artificial AnalysisT1·Tools
58 pts
Artificial Analysis Ships Endpoint Accuracy Index v1.1

Artificial Analysis released Endpoint Accuracy Index v1.1, tightening confidence intervals and reducing grader error on its long-context AA-LCR-25 benchmark while adding coverage for GLM-5.3 Flash and Muse Spark Open. Of 103 serverless endpoints benchmarked, 24 score statistically below the self-hosted reference, quantifying accuracy trade-offs from quantization, custom kernels and inference-stack tuning.