AIME 2025
AIME 2025 (American Invitational Mathematics Examination) - math competition problems evaluated pass@1 without tools.
Category
STEM & Reasoning
Score type
percent
Scale
100%
higher is better
Models tested
21
What is AIME 2025?
AIME 2025 uses the problems of the American Invitational Mathematics Examination 2025 (I & II) as a benchmark. These are competition math problems that only have their exact numeric answer graded. Because the problems are new and public, a model can barely rely on training-data memorisation — the year variants show whether a model really computes or just remembers.
What does it test?
AIME 2025 measures hard reasoning in science, technology, engineering and math. In detail, it checks:
- competition-level math problem solving
- exact numeric answers (graded answers must be exact)
- multi-step reasoning without tools (unless explicitly 'with tools')
- fresh problems that defeat memorised answer lists
How to read the score
The score is accuracy: the percentage of tasks answered or solved correctly. 100% means every task was solved perfectly; higher is better.
Frequently asked questions
What is the AIME 2025 benchmark?
AIME 2025 uses the problems of the American Invitational Mathematics Examination 2025 (I & II) as a benchmark. These are competition math problems that only have their exact numeric answer graded. Because the problems are new and public, a model can barely rely on training-data memorisation — the year variants show whether a model really computes or just remembers.
What does AIME 2025 test?
AIME 2025 mainly measures hard reasoning in science, technology, engineering and math. Concretely, it checks: competition-level math problem solving; exact numeric answers (graded answers must be exact); multi-step reasoning without tools (unless explicitly 'with tools').
How is the AIME 2025 score calculated?
The score is accuracy: the percentage of tasks answered or solved correctly. 100% means every task was solved perfectly; higher is better. The declared maximum score of this benchmark is 100.0.
Where do I get AIME 2025 data and scores?
The official source is https://artofproblemsolving.com/wiki/index.php/2025_AIME. The official benchmark page/reference is linked on this page. Every score on Open LLM Radar is also available as open data: download the scores JSON (http://open-llm-radar-api:8000/api/v1/benchmarks/aime-2025/scores) or pull it directly from the Open LLM Radar API with any HTTP client.
Benchmark data & downloads
Where to get, inspect and reuse the data behind this benchmark.
Official benchmark page / paper
The benchmark maintainer's website, paper or leaderboard
Benchmark dataset
The question/task data itself — download and evaluate locally
Benchmark metadata (JSON)
This page's benchmark record from the Open LLM Radar API
All model scores (JSON download)
Full score table as JSON; paginate with limit/offset params
Open LLM Radar API docs
Swagger UI to explore and reuse all radar API endpoints
Model scores 21 models tested
| # | Model | Score | Date | Source | Verified |
|---|---|---|---|---|---|
| 1 |
Muse-Spark-Open-816B-A42B
Meta Superintelligence Lab
|
100%
|
— | Report | Unverified |
| 2 |
Ripple-65B Preview
Ricursive Intelligence
|
98.3%
|
— | Report | Verified |
| 3 |
Kolibri-1
Aleph Alpha
|
96.9%
|
03.10.2026 | Report | Verified |
| 4 |
Bonsai 2 27B — GGUF
Prism ML
|
95%
|
17.09.2026 | Report | Verified |
| 5 |
NVIDIA-Nemotron-3-Ultra-550B-A55B-BF16
NVIDIA
|
94.2%
|
— | Report | Unverified |
| 6 |
GPT-OSS-120B
OpenAI
|
92.5%
|
08.08.2025 | Report | Verified |
| 7 |
GPT-OSS-20B
OpenAI
|
91.7%
|
05.08.2025 | Report | Verified |
| 8 |
Qwen3-Next-80B-A3B-Thinking
Qwen
|
87.8%
|
10.09.2025 | Report | Verified |
| 9 |
MiniCPM5-2B
OpenBMB
|
86.5%
|
— | Report | Verified |
| 10 |
Qwen3-30B-A3B-Thinking-2507
Qwen
|
85%
|
31.07.2025 | Report | Verified |
| 11 |
Qwen3-235B-A22B
Qwen Team (Alibaba Cloud)
|
81.5%
|
31.07.2025 | Report | Verified |
| 12 |
granite-4.2-3B
IBM
|
79.4%
|
— | Report | Verified |
| 13 |
Qwen3.5-4B
Qwen
|
78.8%
|
— | Report | Verified |
| 14 |
Qwen3-30B-A3B
Qwen
|
70.9%
|
29.04.2025 | Report | Verified |
| 15 |
Qwen3-VL-30B-A3B
Qwen
|
69.3%
|
04.10.2025 | Report | Verified |
| 16 |
Nemotron-3-Nano-4B
NVIDIA
|
56.3%
|
— | Report | Verified |
| 17 |
LFM2.5-8B-A1B
LiquidAI
|
46%
|
— | Report | Verified |
| 18 |
LFM2.5-2.6B
LiquidAI
|
41.9%
|
— | Report | Verified |
| 19 |
Gemma4-E4B
Google
|
37.1%
|
— | Report | Verified |
| 20 |
Gemma4-E2B
Google
|
31.7%
|
— | Report | Verified |
| 21 |
Qwen3.5-2B
Qwen Team (Alibaba Cloud)
|
29.6%
|
— | Report | Verified |