MBPP
Mostly Basic Python Problems - Python coding tasks. 3-shot.
Category
Code
Max Score
100.0
Score Type
percent
Active
Yes
Model Scores
Scores for MBPP
| Model | Score | Date | Verified |
|---|---|---|---|
| Gemma 3 12B PT |
73.47%
|
27.02.2025 | Verified |
| Gemma 3 27B PT |
100.00%
|
27.02.2025 | Verified |
| Gemma 3 4B PT |
46.00
|
27.02.2025 | Verified |