HLE-Diamond (no tools)

Humanity's Last Exam (HLE) is a question set of over 2,500 expert questions from about a hundred domains, designed to be the very edge of human knowledge — created specifically because frontier models had become too good at all existing benchmarks. The score reflects the accuracy of the final answer.

HLE-Diamond (no tools) measures hard reasoning in science, technology, engineering and math. In detail, it checks:

• extremely difficult interdisciplinary questions
• genuine expert reasoning instead of pattern matching
• compositional thinking across several fields
• accuracy even when guessing would be plausible

The score is accuracy: the percentage of tasks answered or solved correctly. 100% means every task was solved perfectly; higher is better.

What is the HLE-Diamond (no tools) benchmark?

Humanity's Last Exam (HLE) is a question set of over 2,500 expert questions from about a hundred domains, designed to be the very edge of human knowledge — created specifically because frontier models had become too good at all existing benchmarks. The score reflects the accuracy of the final answer.

What does HLE-Diamond (no tools) test?

HLE-Diamond (no tools) mainly measures hard reasoning in science, technology, engineering and math. Concretely, it checks: extremely difficult interdisciplinary questions; genuine expert reasoning instead of pattern matching; compositional thinking across several fields.

How is the HLE-Diamond (no tools) score calculated?

The score is accuracy: the percentage of tasks answered or solved correctly. 100% means every task was solved perfectly; higher is better. The declared maximum score of this benchmark is 100.0.

Where do I get HLE-Diamond (no tools) data and scores?

The official benchmark page/reference is linked on this page. Every score on Open LLM Radar is also available as open data: download the scores JSON (http://open-llm-radar-api:8000/api/v1/benchmarks/hle-diamond-no-tools/scores) or pull it directly from the Open LLM Radar API with any HTTP client.