SuperGPQA

SuperGPQA is a graduate-level multiple-choice exam covering 285 disciplines — a very broad, very hard knowledge test. It extends the GPQA idea to many more fields and professions.

SuperGPQA measures broad factual and academic knowledge. In detail, it checks:

• expert knowledge across hundreds of fields
• hard distractors with several plausible answers
• long-tail knowledge, not just famous textbook facts
• resistance to shallow pattern matching

The score is accuracy: the percentage of tasks answered or solved correctly. 100% means every task was solved perfectly; higher is better.

What is the SuperGPQA benchmark?

SuperGPQA is a graduate-level multiple-choice exam covering 285 disciplines — a very broad, very hard knowledge test. It extends the GPQA idea to many more fields and professions.

What does SuperGPQA test?

SuperGPQA mainly measures broad factual and academic knowledge. Concretely, it checks: expert knowledge across hundreds of fields; hard distractors with several plausible answers; long-tail knowledge, not just famous textbook facts.

How is the SuperGPQA score calculated?

The score is accuracy: the percentage of tasks answered or solved correctly. 100% means every task was solved perfectly; higher is better. The declared maximum score of this benchmark is 100.0.

Where do I get SuperGPQA data and scores?

The official benchmark page/reference is linked on this page. Every score on Open LLM Radar is also available as open data: download the scores JSON (http://open-llm-radar-api:8000/api/v1/benchmarks/supergpqa/scores) or pull it directly from the Open LLM Radar API with any HTTP client.