HellaSwag
HellaSwag is a benchmark for commonsense NLI. 10-shot.
Category
Reasoning
Max Score
100.0
Score Type
percent
Active
Yes
Model Scores
Scores for HellaSwag
| Model | Score | Date | Verified |
|---|---|---|---|
| Gemma 3 4B PT |
60.08%
|
27.02.2025 | Verified |
| Gemma 3 12B PT |
88.31%
|
27.02.2025 | Verified |
| Gemma 3 27B PT |
93.95%
|
27.02.2025 | Verified |
| Gemma 3 1B PT |
62.30
|
27.02.2025 | Verified |
| GLM-5.3-Flash |
100.00%
|
27.08.2026 | Verified |