GPQA
Google-Proof Q&A - graduate-level science questions. 5-shot.
Category
Reasoning
Max Score
100.0
Score Type
percent
Active
Yes
Model Scores
Scores for GPQA
| Model | Score | Date | Verified |
|---|---|---|---|
| Gemma 3 4B PT |
15.00
|
27.02.2025 | Verified |
| Gemma 3 12B PT |
16.72%
|
27.02.2025 | Verified |
| Gemma 3 27B PT |
14.95%
|
27.02.2025 | Verified |
| Spark-X2.5-1.7B |
46.30%
|
— | Verified |
| Qwen3.5-9B |
100.00%
|
— | Verified |
| Qwen3.5-4B |
83.92%
|
— | Verified |
| Qwen3.5-2B |
47.59%
|
— | Verified |
| Gemma4-12B |
92.93%
|
— | Verified |
| Gemma4-E4B |
63.50%
|
— | Verified |
| Gemma4-E2B |
46.30%
|
— | Verified |
| Qwen3-Next-80B-A3B-Thinking |
100.00%
|
10.09.2025 | Verified |
| Qwen3-VL-30B-A3B |
89.07%
|
04.10.2025 | Verified |
| Spark-X2.5-4B |
84.24%
|
— | Verified |