Qwen-AgentWorld-397B-A17B vs OpenAI o3
New ComparisonScores are fetched live from the current database on every visit — nothing is cached.
Benchmark Scores Comparison
Qwen-AgentWorld-397B-A17B
OpenAI o3
Qwen-AgentWorld-397B-A17B
Score: 15.0
OpenAI o3
Score: 15.0
Coverage matrix
2 models × 9 benchmarks — hover a benchmark name for its category
Shading = score relative to the best score among the selected models:
Low
Mid
High
Missing (—)
The totals row shows how many of the 9 benchmarks each model has scores for.
| Benchmark | Qwen-AgentWorld-397B-A17B Qwen Team (Alibaba Cloud) | OpenAI o3 OpenAI |
|---|---|---|
| AgentWorldBench Terminal | 57.73 | — |
| AgentWorldBench Overall | 58.71 | — |
| AgentWorldBench Web | 50.98 | — |
| MMMLU | — | 88.8 |
| AgentWorldBench Search | 37.82 | — |
| AgentWorldBench OS | 67.89 | — |
| AgentWorldBench MCP | 68.24 | — |
| AgentWorldBench SWE | 68.49 | — |
| AgentWorldBench Android | 60.2 | — |
| Covered | 8/9 | 1/9 |
Scorecard
Overall 0–100 score — category strengths (50%), shared-benchmark wins (30%), coverage (20%)
| Model | Overall score | Shared benchmark wins | Coverage | Strongest at | Weakest at |
|---|---|---|---|---|---|
| Qwen-AgentWorld-397B-A17B | 88.9 | — | 8 of 9 (89.0%) | — | — |
| OpenAI o3 | 11.1 | — | 1 of 9 (11.0%) | — | — |
Partial coverage benchmarks
Scored by at least one but not all selected models (9) — missing scores show as —
| Benchmark | Category | Qwen-AgentWorld-397B-A17B | OpenAI o3 |
|---|---|---|---|
| AgentWorldBench Terminal 1/2 models | general_agent | 57.73 | — |
| AgentWorldBench Overall 1/2 models | general_agent | 58.71 | — |
| AgentWorldBench Web 1/2 models | general_agent | 50.98 | — |
| MMMLU 1/2 models | multilingual | — | 88.8 |
| AgentWorldBench Search 1/2 models | general_agent | 37.82 | — |
| AgentWorldBench OS 1/2 models | general_agent | 67.89 | — |
| AgentWorldBench MCP 1/2 models | general_agent | 68.24 | — |
| AgentWorldBench SWE 1/2 models | general_agent | 68.49 | — |
| AgentWorldBench Android 1/2 models | general_agent | 60.2 | — |