WMT24++ (en→xx)

WMT24++ (en→xx) - machine translation benchmark, English to other languages.

Category

Multilingual

Max Score

100.0

Score Type

percent

Active

Yes

Model Scores

Scores for WMT24++ (en→xx)

Model Score Date Verified
NVIDIA-Nemotron-3-Ultra-550B-A55B-BF16
93.81%
04.06.2026 Verified
MiniMax-M2.7
92.02%
04.06.2026 Unverified
GLM-5.1
95.21%
04.06.2026 Unverified
Qwen3.5-397B-A17B
100.00%
04.06.2026 Unverified
DeepSeek-V4-Pro
98.20%
04.06.2026 Unverified
DeepSeek-V4-Flash
98.20%
04.06.2026 Unverified
Qwen3.5-4B
59.68%
01.02.2026 Verified
Qwen3.5-122B-A10B
83.03%
01.02.2026 Verified
Qwen3.5-27B
81.64%
01.02.2026 Unverified
Qwen3.5-35B-A3B
79.04%
01.02.2026 Unverified
Qwen3-235B-A22B
78.04%
01.02.2026 Unverified
GPT-5-mini 2025-08-07
87.82%
01.02.2026 Unverified
Gemma 3 1B PT
36.70
27.02.2025 Verified
Gemma 3 4B PT
23.35%
27.02.2025 Verified
Gemma 3 12B PT
34.33%
27.02.2025 Verified
Gemma 3 27B PT
37.92%
27.02.2025 Verified
Kimi K2.6
95.41%
04.06.2026 Unverified