Ornith-1.5-35B-A3B vs Qwen3.8-27B
New ComparisonScores are fetched live from the current database on every visit — nothing is cached.
Benchmark Scores Comparison
Ornith-1.5-35B-A3B
Qwen3.8-27B
Ornith-1.5-35B-A3B
36.0B params
Score: 100.0
Qwen3.8-27B
27.0B params
Score: 100.0
Coverage matrix
2 models × 58 benchmarks — hover a benchmark name for its category
Shading = score relative to the best score among the selected models:
Low
Mid
High
Missing (—)
The totals row shows how many of the 58 benchmarks each model has scores for.
| Benchmark | Qwen3.8-27B Qwen Team (Alibaba Cloud) | Ornith-1.5-35B-A3B Ornith AI |
|---|---|---|
| GPQA Diamond | 89.2 | 89.2 |
| IFBench (prompt loose) | 79.5 | — |
| LiveCodeBench v6 | 90.3 | — |
| SWE-bench Pro | 61.7 | 59.6 |
| BFCL-V4 | 72.4 | — |
| RealWorldQA | 85.9 | — |
| Agents' Last Exam (Score) | 42.9 | — |
| AA-LCR | 80.3 | — |
| MathVision | 90 | — |
| AIME 26 | 98.8 | — |
| AndroidWorld | 81.9 | — |
| Agents' Last Exam | 20.4 | — |
| Toolathlon Verified | 67.1 | 48.7 |
| RecreationBench | 47.1 | — |
| AutomationBench (Public) | 58.7 | — |
| GDPVal | 63.5 | — |
| WildClawBench | — | 72.5 |
| SWE Atlas - QnA | — | 39.8 |
| NL2Repo | 42.3 | 46.2 |
| BabyVision | 65.7 | — |
| Claw-Eval Avg | 56.9 | — |
| Multi-Challenge | 63.6 | — |
| SWE-MM | 38.6 | — |
| MMLU-Pro | 85.7 | — |
| OSWorld-Verified | 84.3 | — |
| HLE (with tools) | 30.8 | 33.4 |
| LVBench | 72.4 | — |
| CharXiv (RQ) | 83.7 | — |
| GDP.pdf | 11.2 | — |
| BrowseComp | — | 67.6 |
| NL2Repo-Bench | 42.3 | — |
| WebArena-Verified | 64.8 | — |
| CoWorkBench | 70.7 | — |
| AA-Omniscience Index (public set) | -0.5 | — |
| SWE-bench Multilingual | 73.8 | 71.4 |
| IFBench | 79.5 | — |
| SWE-bench Verified | 74.6 | 79 |
| Humanity's Last Exam | 30.8 | 25.6 |
| ERQA | 65.5 | — |
| QwenSWEBench | 79 | — |
| Terminal-Bench 2.1 (Terminus-2) | 73 | 67.8 |
| DeepSWE | — | 22 |
| OmniDocBench 1.5 | 91.1 | — |
| HMMT Feb 26 | 95.8 | — |
| Terminal-Bench Lite | 67 | — |
| JobBench | 33.4 | — |
| Frontier-Bench v0.1 | — | 5.1 |
| OSWorld 2.0 (Partial) | 48 | — |
| OSWorld 2.0 (Binary) | 19.4 | — |
| WideSearch | — | 67.8 |
| Vision2Web | 62.9 | — |
| Claw-Eval Pass^3 | 57.4 | — |
| MCP-Atlas | — | 70.2 |
| DeepSWE 1.1 | 42.2 | — |
| Terminal-Bench 2.1 (Claude Code) | — | 68.5 |
| Chatbot Korean (internal) | 90.1 | — |
| SciCode | 44.6 | — |
| BrowseComp Plus | 58 | — |
| Covered | 50/58 | 17/58 |
Fully comparable benchmarks
Scored by all 2 selected models (9)
| Benchmark | Category | Ornith-1.5-35B-A3B | Qwen3.8-27B |
|---|---|---|---|
| GPQA Diamond | stem_reasoning | 89.2 | 89.2 |
| SWE-bench Pro | coding_agent | 59.6 | 61.7 |
| Toolathlon Verified | general_agent | 48.7 | 67.1 |
| NL2Repo | coding_agent | 46.2 | 42.3 |
| HLE (with tools) | stem_reasoning | 33.4 | 30.8 |
| SWE-bench Multilingual | coding_agent | 71.4 | 73.8 |
| SWE-bench Verified | coding_agent | 79 | 74.6 |
| Humanity's Last Exam | stem_reasoning | 25.6 | 30.8 |
| Terminal-Bench 2.1 (Terminus-2) | coding_agent | 67.8 | 73 |
Partial coverage benchmarks
Scored by at least one but not all selected models (49) — missing scores show as —
| Benchmark | Category | Ornith-1.5-35B-A3B | Qwen3.8-27B |
|---|---|---|---|
| IFBench (prompt loose) 1/2 models | instruction_following | — | 79.5 |
| LiveCodeBench v6 1/2 models | stem_reasoning | — | 90.3 |
| BFCL-V4 1/2 models | general_agent | — | 72.4 |
| RealWorldQA 1/2 models | vision_language | — | 85.9 |
| Agents' Last Exam (Score) 1/2 models | general_agent | — | 42.9 |
| AA-LCR 1/2 models | long_context | — | 80.3 |
| MathVision 1/2 models | vision_language | — | 90 |
| AIME 26 1/2 models | stem_reasoning | — | 98.8 |
| AndroidWorld 1/2 models | general_agent | — | 81.9 |
| Agents' Last Exam 1/2 models | general_agent | — | 20.4 |
| RecreationBench 1/2 models | general_agent | — | 47.1 |
| AutomationBench (Public) 1/2 models | general_agent | — | 58.7 |
| GDPVal 1/2 models | general_agent | — | 63.5 |
| WildClawBench 1/2 models | coding_agent | 72.5 | — |
| SWE Atlas - QnA 1/2 models | coding_agent | 39.8 | — |
| BabyVision 1/2 models | vision_language | — | 65.7 |
| Claw-Eval Avg 1/2 models | coding_agent | — | 56.9 |
| Multi-Challenge 1/2 models | instruction_following | — | 63.6 |
| SWE-MM 1/2 models | coding_agent | — | 38.6 |
| MMLU-Pro 1/2 models | knowledge | — | 85.7 |
| OSWorld-Verified 1/2 models | general_agent | — | 84.3 |
| LVBench 1/2 models | video_understanding | — | 72.4 |
| CharXiv (RQ) 1/2 models | document_understanding | — | 83.7 |
| GDP.pdf 1/2 models | long_context | — | 11.2 |
| BrowseComp 1/2 models | general_agent | 67.6 | — |
| NL2Repo-Bench 1/2 models | coding_agent | — | 42.3 |
| WebArena-Verified 1/2 models | general_agent | — | 64.8 |
| CoWorkBench 1/2 models | general_agent | — | 70.7 |
| AA-Omniscience Index (public set) 1/2 models | knowledge | — | -0.5 |
| IFBench 1/2 models | instruction_following | — | 79.5 |
| ERQA 1/2 models | spatial_intelligence | — | 65.5 |
| QwenSWEBench 1/2 models | coding_agent | — | 79 |
| DeepSWE 1/2 models | coding_agent | 22 | — |
| OmniDocBench 1.5 1/2 models | document_understanding | — | 91.1 |
| HMMT Feb 26 1/2 models | stem_reasoning | — | 95.8 |
| Terminal-Bench Lite 1/2 models | coding_agent | — | 67 |
| JobBench 1/2 models | general_agent | — | 33.4 |
| Frontier-Bench v0.1 1/2 models | coding_agent | 5.1 | — |
| OSWorld 2.0 (Partial) 1/2 models | general_agent | — | 48 |
| OSWorld 2.0 (Binary) 1/2 models | general_agent | — | 19.4 |
| WideSearch 1/2 models | general_agent | 67.8 | — |
| Vision2Web 1/2 models | vision_language | — | 62.9 |
| Claw-Eval Pass^3 1/2 models | coding_agent | — | 57.4 |
| MCP-Atlas 1/2 models | general_agent | 70.2 | — |
| DeepSWE 1.1 1/2 models | coding_agent | — | 42.2 |
| Terminal-Bench 2.1 (Claude Code) 1/2 models | coding_agent | 68.5 | — |
| Chatbot Korean (internal) 1/2 models | multilingual | — | 90.1 |
| SciCode 1/2 models | — | — | 44.6 |
| BrowseComp Plus 1/2 models | general_agent | — | 58 |