$OneMillion-Bench
$OneMillion-Bench - expert score. Evaluated using gemini-3.1-pro-preview.
Category
General Capabilities
Score type
percent
Scale
relative
higher is better
Models tested
5
What is $OneMillion-Bench?
$OneMillion-Bench is a benchmark for broad everyday usefulness across domains. The official description says: "$OneMillion-Bench - expert score". Below we describe in simple words what benchmarks of this type generally examine.
What does it test?
$OneMillion-Bench measures broad everyday usefulness across domains. In detail, it checks:
- realistic, open-ended requests from varied professional fields
- correct, well-structured and helpful responses
- consistent quality across very different task types
- judgement and advice quality, not just factual recall
How to read the score
The score is accuracy: the percentage of tasks answered or solved correctly. 100% means every task was solved perfectly; higher is better.
Official methodology note: $OneMillion-Bench - expert score. Evaluated using gemini-3.1-pro-preview.
Frequently asked questions
What is the $OneMillion-Bench benchmark?
$OneMillion-Bench is a benchmark for broad everyday usefulness across domains. The official description says: '$OneMillion-Bench - expert score'. Below we describe in simple words what benchmarks of this type generally examine.
What does $OneMillion-Bench test?
$OneMillion-Bench mainly measures broad everyday usefulness across domains. Concretely, it checks: realistic, open-ended requests from varied professional fields; correct, well-structured and helpful responses; consistent quality across very different task types.
How is the $OneMillion-Bench score calculated?
The score is accuracy: the percentage of tasks answered or solved correctly. 100% means every task was solved perfectly; higher is better.
Where do I get $OneMillion-Bench data and scores?
The official benchmark page/reference is linked on this page. Every score on Open LLM Radar is also available as open data: download the scores JSON (http://open-llm-radar-api:8000/api/v1/benchmarks/onemillion-bench/scores) or pull it directly from the Open LLM Radar API with any HTTP client.
Benchmark data & downloads
Where to get, inspect and reuse the data behind this benchmark.
Benchmark dataset
The question/task data itself — download and evaluate locally
Benchmark metadata (JSON)
This page's benchmark record from the Open LLM Radar API
All model scores (JSON download)
Full score table as JSON; paginate with limit/offset params
Open LLM Radar API docs
Swagger UI to explore and reuse all radar API endpoints
Model scores 5 models tested
| # | Model | Score | Date | Source | Verified |
|---|---|---|---|---|---|
| 1 |
Hy4 preview
Tencent
|
65.4%
|
28.08.2026 | Tencent Hy4 preview model card benchmark appendix (https://huggingface.co/tencent/Hy4-preview#benchmark-appendix) | Verified |
| 2 |
GLM-5.3
Zhipu AI
|
64.5%
|
28.08.2026 | Tencent Hy4 preview model card benchmark appendix (https://huggingface.co/tencent/Hy4-preview#benchmark-appendix) (Tencent rerun) | Verified |
| 3 |
Kimi K3
Moonshot AI
|
63.5%
|
28.08.2026 | Tencent Hy4 preview model card benchmark appendix (https://huggingface.co/tencent/Hy4-preview#benchmark-appendix) (Tencent rerun) | Verified |
| 4 |
Qwen3.8-2.4T-A95B
Qwen
|
52.5%
|
18.08.2026 | Report | Verified |
| 5 |
Hy3
Tencent
|
51.5%
|
28.08.2026 | Tencent Hy4 preview model card benchmark appendix (https://huggingface.co/tencent/Hy4-preview#benchmark-appendix) | Verified |