LLM Benchmarks — Scores, Methodology & Live Rankings
What each benchmark measures, how models score, and the current rankings
Decision Index (public suite)
Decision
Public decision-suite benchmark (v0.3 public suite) in multimodalart's jev-decision-index leaderboard on Hugging Face; measures binary/multi-choice decision ...
DecisionBench (Hanno Labs)
Decision
DecisionBench v1 by Hanno Labs, a decision-making benchmark suite (https://huggingface.co/datasets/Hanno-Labs/decision-bench). Values reported as percentage.
Decision Bench (decisionbench.ai)
Decision
Decision Bench v4 at decisionbench.ai, a dedicated decision-quality benchmark. Values reported as percentage. Source: https://decisionbench.ai/
Fast Decisions
Decision
Fast Decisions dataset (fastino/fast-decisions on Hugging Face), quick binary judgment tasks. Values reported as percentage. Source: https://huggingface.co/d...
JevBench
Decision
JevBench v1.4.1 (fstandhartinger/jevbench on GitHub), benchmark for judgment/decision tasks. Values reported as percentage. Source: https://github.com/fstand...
WorkflowEvals
Decision
WorkflowEvals (evals.typesafe.ai), benchmark suite over workflow/production decision steps like routing, triage, moderation. Values reported as percentage. S...
Typed Decisions
Decision
Typed Decisions dataset (LocalLLaMA/typed-decisions on Hugging Face), decision tasks with typed answers (numbers, dates, choices). Values reported as percent...