MMLU Pro COT

MMLU-Pro with chain-of-thought reasoning. 5-shot.

Category

Knowledge

Max Score

100.0

Score Type

percent

Active

Yes

Model Scores

Scores for MMLU Pro COT

Model Score Date Verified
Gemma 3 4B PT
29.20
27.02.2025 Verified
Gemma 3 12B PT
70.00%
27.02.2025 Verified
Gemma 3 27B PT
100.00%
27.02.2025 Verified