MATH-500

MATH-500 - 500 competition-level mathematics problems, pass@1 without tools.

Category

Math

Max Score

100.0

Score Type

percent

Active

Yes

Model Scores

Scores for MATH-500

Model Score Date Verified
MiniCPM5-2B
67.65%
— Verified
LFM2.5-2.6B
30.88%
— Verified
Qwen3.5-2B
2.94%
— Verified
Gemma4-E2B
85.40
— Verified
Qwen3.5-4B
100.00%
— Verified
granite-4.2-3B
85.29%
— Verified
Nemotron-3-Nano-4B
45.59%
— Verified
Gemma4-E4B
20.59%
— Verified
LFM2.5-8B-A1B
57.35%
— Verified