LLM Benchmarks — Scores, Methodology & Live Rankings
What each benchmark measures, how models score, and the current rankings
Longbench v2 (≤ 1M)
Long Context
Longbench v2 (≤ 1M) - long context understanding benchmark, up to 1M tokens.
MRCR v2 256K (8-needle)
Long Context
MRCR v2 256K (8-needle) - Multi-Ring Curve Retrieval benchmark v2, 256K context, 8-needle setting.
Beam128K
Long Context
Beam128K - long context retrieval and understanding benchmark at 128K tokens.
MRCR v2 128K (8-needle)
Long Context
MRCR v2 128K (8-needle) - Multi-Ring Curve Retrieval benchmark v2, 128K context, 8-needle setting.
LongBenchPro
Long Context
LongBenchPro - long context understanding benchmark with professional-level tasks.
NoLiMa
Long Context
NoLiMa - long context benchmark evaluating retrieval and reasoning without explicit long-context matching.
RULER 128K
Long Context
RULER 128K - long context retrieval benchmark evaluated at 128K tokens. As evaluated on the LFM3-1.7B card: model served via vLLM in BF16 at its full 262,144...