LLM Benchmarks — Scores, Methodology & Live Rankings
What each benchmark measures, how models score, and the current rankings
IMOAnswerBench
STEM & Reasoning
IMOAnswerBench - International Mathematical Olympiad answer evaluation benchmark.
AIME 26
STEM & Reasoning
AIME 26 - American Invitational Mathematics Examination 2026 (I & II).
HMMT Feb 26
STEM & Reasoning
HMMT Feb 26 - Harvard-MIT Mathematics Tournament February 2026.
HMMT Nov 25
STEM & Reasoning
HMMT Nov 25 - Harvard-MIT Mathematics Tournament November 2025.
Humanity's Last Exam
STEM & Reasoning
HLE - Humanity's Last Exam - extremely difficult expert-level questions across domains.
LiveCodeBench v6
STEM & Reasoning
LiveCodeBench v6 - competitive programming evaluation with latest problems.
HMMT Feb 25
STEM & Reasoning
HMMT Feb 25 - Harvard-MIT Mathematics Tournament February 2025.
IOI 2025
STEM & Reasoning
IOI 2025 - International Olympiad in Informatics 2025 competitive programming score.
IMOAnswerBench (with tools)
STEM & Reasoning
IMOAnswerBench - with tools variant. International Mathematical Olympiad answer evaluation benchmark with tool use.
CritPt (no tools)
STEM & Reasoning
CritPt - critical point identification benchmark, no tools variant.
HLE (with tools)
STEM & Reasoning
HLE (with tools) - Humanity's Last Exam with tool use variant.
SciCode (subtask)
STEM & Reasoning
SciCode (subtask) - scientific code generation benchmark, subtask-level scoring.
Apex-Shortlist (no tools)
STEM & Reasoning
Apex-Shortlist - no tools variant. Competitive math benchmark without tool use.
Apex-Shortlist (with tools)
STEM & Reasoning
Apex-Shortlist - with tools variant. Competitive math benchmark with tool use.
AIME 2025 (with tools)
STEM & Reasoning
AIME 2025 (with tools) - American Invitational Mathematics Examination 2025 with tool use variant.
CodeForces
STEM & Reasoning
CodeForces - competitive programming rating evaluated on custom query set.
HLE with search
STEM & Reasoning
HLE with search - Humanity's Last Exam with web search access variant.
BigBench Extra Hard
STEM & Reasoning
BigBench Extra Hard - extended and more challenging version of BigBench.
AIME 2024 (with tools)
STEM & Reasoning
AIME 2024 (with tools) - American Invitational Mathematics Examination 2024 with tool use variant.
AIME 2025
STEM & Reasoning
AIME 2025 (American Invitational Mathematics Examination) - math competition problems evaluated pass@1 without tools.
AIME 2024
STEM & Reasoning
AIME 2024 (American Invitational Mathematics Examination) - math competition problems evaluated pass@1 without tools.
GPQA Diamond (with tools)
STEM & Reasoning
GPQA Diamond (with tools) - Google-Proof Q&A benchmark for graduate-level scientific reasoning with tool use variant.
CodeForces (with tools)
STEM & Reasoning
CodeForces (with tools) - competitive programming rating evaluated with terminal tool access similar to Codex CLI.
SUPERChem
STEM & Reasoning
Chemistry reasoning benchmark reported in the Tencent Hy4 preview model card appendix.
ArXivMath
STEM & Reasoning
Math reasoning benchmark over arXiv-style problems, reported in the Tencent Hy4 preview model card appendix.
BrokenArXiv
STEM & Reasoning
Math reasoning benchmark reported in the Tencent Hy4 preview model card appendix.
LCB-Pro 25Q2 (Easy)
STEM & Reasoning
LiveCodeBench Pro 25Q2 (Easy) - competitive programming evaluation, easy difficulty subset of LCB-Pro 2025 Q2.
LCB-Pro 25Q2 (Medium)
STEM & Reasoning
LiveCodeBench Pro 25Q2 (Medium) - competitive programming evaluation, medium difficulty subset of LCB-Pro 2025 Q2.
MathArena Apex 2025
STEM & Reasoning
MathArena Apex 2025 - hardest math contest problems of the 2025 MathArena set.
HorizonMath (pass@4)
STEM & Reasoning
HorizonMath - long-horizon math reasoning, pass@4 protocol, reported in the Tencent Hy4 preview model card appendix.
CLadder
STEM & Reasoning
CLadder: causal reasoning benchmark based on structural causal models, scored as accuracy on a 0-100 scale in Cloudflare's internal Decision Index 0.2.1 suite.
Overall (EN)
STEM & Reasoning
Kolibri card composite 'Overall (EN)': unweighted mean of the English category averages (Knowledge, Math, Agentic, Code, Instruction Following, Grounding/Hal...
Overall (DE)
STEM & Reasoning
Kolibri card composite 'Overall (DE)': unweighted mean of the German category averages (Knowledge, Math, Agentic Retrieval, Industry RAG). Evaluation via Ale...
GPQA Diamond (DE)
STEM & Reasoning
Aleph Alpha's official German translation of GPQA Diamond, evaluated with the AA eval-framework (same setup as EN GPQA Diamond on the Kolibri card).
Humanity's Last Exam (DE)
STEM & Reasoning
Aleph Alpha's official German translation of Humanity's Last Exam, evaluated with the AA eval-framework (same setup as EN HLE on the Kolibri card).
AIME 2025 (DE)
STEM & Reasoning
Aleph Alpha's official German translation of AIME 2025, evaluated with the AA eval-framework (pass@1, no tools; same setup as EN AIME 2025 on the Kolibri card).
AIME 2026 (DE)
STEM & Reasoning
Aleph Alpha's official German translation of AIME 2026, evaluated with the AA eval-framework (pass@1, no tools; same setup as EN AIME 2026 on the Kolibri card).
HLE-Diamond (no tools)
STEM & Reasoning
Humanity's Last Exam (Diamond subset) evaluated without tool access, reported on the Muse Spark Open model card (xhigh reasoning effort, temperature 1.0, top...
LiveCodeBench Pro 25Q2
STEM & Reasoning
LiveCodeBench Pro 2025 Q2 aggregate over all difficulty splits. As evaluated on the LFM3-1.7B card: vLLM BF16 at full 262,144-token context, temperature 0.6,...
LogicVista
STEM & Reasoning
LogicVista as evaluated on the LFM3-VL-2B card (vision benchmark, with-thinking setting): Math & logical reasoning category, with-thinking column. Multimodal...
GPQA Diamond
STEM & Reasoning
GPQA Diamond - Google-Proof Q&A benchmark for graduate-level scientific reasoning.
BioMysteryBench
STEM & Reasoning
Biology research-agent benchmark (99-task initial release); per model card footnote evaluated with Claude Code harness, judged by Kimi-K3.