ARC-c
AI2 Reasoning Challenge (Challenge set) - grade-school science questions. 25-shot.
Category
Reasoning
Max Score
100.0
Score Type
percent
Active
Yes
Model Scores
Scores for ARC-c
| Model | Score | Date | Verified |
|---|---|---|---|
| Gemma 3 1B PT |
38.40
|
27.02.2025 | Verified |
| Gemma 3 4B PT |
55.28%
|
27.02.2025 | Verified |
| Gemma 3 12B PT |
94.72%
|
27.02.2025 | Verified |
| Gemma 3 27B PT |
100.00%
|
27.02.2025 | Verified |