OpenAI o3 vs Inkling 2 Small
New ComparisonScores are fetched live from the current database on every visit — nothing is cached.
Benchmark Scores Comparison
OpenAI o3
Inkling 2 Small
OpenAI o3
Score: 15.0
Inkling 2 Small
594.1B params
Coverage matrix
2 models × 17 benchmarks — hover a benchmark name for its category
Shading = score relative to the best score among the selected models:
Low
Mid
High
Missing (—)
The totals row shows how many of the 17 benchmarks each model has scores for.
| Benchmark | Inkling 2 Small Thinking Machines | OpenAI o3 OpenAI |
|---|---|---|
| GPQA Diamond | 93 | — |
| BioMysteryBench | 70 | — |
| TAU3-Bench | 40.4 | — |
| ScreenSpot Pro | 83.8 | — |
| MuirBench | 79.2 | — |
| DeepSearch QA | 90.9 | — |
| MMMU-Pro | 81.6 | — |
| MMMLU | — | 88.8 |
| Terminal-Bench Science 0.1 | 5.7 | — |
| CharXiv (RQ) | 85.6 | — |
| SWE-bench Multilingual | 81.2 | — |
| Global-MMLU-Lite | 91 | — |
| Terminal-Bench 2.1 (Terminus-2) | 81.3 | — |
| DeepSWE | 72.1 | — |
| HMMT Feb 26 | 95.8 | — |
| SimpleVQA | 68.2 | — |
| MCP-Atlas | 85 | — |
| Covered | 16/17 | 1/17 |
Scorecard
Overall 0–100 score — category strengths (50%), shared-benchmark wins (30%), coverage (20%)
| Model | Overall score | Shared benchmark wins | Coverage | Strongest at | Weakest at |
|---|---|---|---|---|---|
| Inkling 2 Small | 94.1 | — | 16 of 17 (94.0%) | — | — |
| OpenAI o3 | 5.9 | — | 1 of 17 (6.0%) | — | — |
Partial coverage benchmarks
Scored by at least one but not all selected models (17) — missing scores show as —
| Benchmark | Category | OpenAI o3 | Inkling 2 Small |
|---|---|---|---|
| GPQA Diamond 1/2 models | stem_reasoning | — | 93 |
| BioMysteryBench 1/2 models | stem_reasoning | — | 70 |
| TAU3-Bench 1/2 models | general_agent | — | 40.4 |
| ScreenSpot Pro 1/2 models | general_agent | — | 83.8 |
| MuirBench 1/2 models | video_understanding | — | 79.2 |
| DeepSearch QA 1/2 models | general_agent | — | 90.9 |
| MMMU-Pro 1/2 models | vision_language | — | 81.6 |
| MMMLU 1/2 models | multilingual | 88.8 | — |
| Terminal-Bench Science 0.1 1/2 models | coding_agent | — | 5.7 |
| CharXiv (RQ) 1/2 models | document_understanding | — | 85.6 |
| SWE-bench Multilingual 1/2 models | coding_agent | — | 81.2 |
| Global-MMLU-Lite 1/2 models | multilingual | — | 91 |
| Terminal-Bench 2.1 (Terminus-2) 1/2 models | coding_agent | — | 81.3 |
| DeepSWE 1/2 models | coding_agent | — | 72.1 |
| HMMT Feb 26 1/2 models | stem_reasoning | — | 95.8 |
| SimpleVQA 1/2 models | vision_language | — | 68.2 |
| MCP-Atlas 1/2 models | general_agent | — | 85 |