LLM Benchmarks — Scores, Methodology & Live Rankings
What each benchmark measures, how models score, and the current rankings
Agents' Last Exam (Score)
General Agents
Agents' Last Exam - Score (aggregate). Reports the aggregate score rather than Pass@1.
Hy-CompanyBench V2 (Internal)
General Agents
Tencent internal (Hy team) agentic search / company-work benchmark, reported in the Hy4 preview model card appendix.
Hy-LifeSearch (Internal)
General Agents
Tencent internal (Hy team) agentic search benchmark, reported in the Hy4 preview model card appendix.
Hy-BrowseComp-Pro2 (Internal)
General Agents
Tencent internal (Hy team) hard web-browsing benchmark, reported in the Hy4 preview model card appendix.
E-Bench (Internal)
General Agents
Tencent internal (Hy team) office/enterprise-work benchmark, reported in the Hy4 preview model card appendix.
OSWorld 2.0 (Binary)
General Agents
OSWorld 2.0 - Binary score. The binary score is the percentage of tasks that receive the full task reward.
SEC-Bench Pro
General Agents
Security exploitation agent benchmark; DeepSeek-V4.1-Flash evaluated with the Claude Code harness per the official setup; Pass@1.
TauBench V2 Retail
General Agents
tau2-bench - Retail domain. Agentic tool use benchmark for retail customer service scenarios.
TauBench V2 Airline
General Agents
tau2-bench - Airline domain. Agentic tool use benchmark for airline customer service scenarios.
TauBench V2 Telecom
General Agents
tau2-bench - Telecom domain. Agentic tool use benchmark for telecom customer service scenarios.
DeepresearchBII
General Agents
DeepresearchBII - deep-research agentic benchmark used in Xing4.0-29B-A4B and competitor model cards. Evaluation setup as printed: OpenCode harness with an E...
RouterBench
General Agents
RouterBench measures LLM-router quality (selected route quality when deciding between models). Scored on a 0-100 scale in Cloudflare's internal Decision Inde...
Home appliance simulator
General Agents
Home appliance simulator: control of a simulated home appliance environment, scored as case exact accuracy on a 0-100 scale in Cloudflare's internal Decision...
SATA-Bench
General Agents
SATA-Bench: structured-output attribute/typed answer evaluation (case exact accuracy), scored on a 0-100 scale in Cloudflare's internal Decision Index 0.2.1 ...
ToolSandbox
General Agents
Agentic tool-use benchmark with multi-turn tool conversations. As evaluated on the LFM2.5-24B-A2B model card: vLLM, temperature = 0, max output tokens = 1024...
LiveClaw
General Agents
Agentic benchmark reported on the LFM2.5-24B-A2B model card for live agent workflows. As evaluated: vLLM with temperature = 1.0 (vLLM default; the agent sets...
EnterpriseOps-Gym
General Agents
EnterpriseOps-Gym - agentic enterprise-operations benchmark, evaluated using its official repository per the card's footnote; models run at highest thinking ...
BrowseComp Plus
General Agents
BrowseComp Plus (long-document extension of BrowseComp) as reported on the KRAFTON Raon-1 mini preview card; search/agentic benchmark, judge gpt-5.6-luna. Di...
FinWorkBench (Finch)
General Agents
Finance-workflow benchmark measuring creation and editing of spreadsheets for finance and accounting use cases. Blog: ML4 Finch 73.3%, second only to Kimi K3...
B3 Agent Security Benchmark (Attack Resistance)
General Agents
B3 Agent Security Benchmark: resistance of deployed agents to attacks such as system prompt exfiltration and malicious code injection. Blog: ML4 resists 97.1...
Agents' Last Exam (CLI)
General Agents
ALE v1.1 CLI subset (86 of 122 tasks); runs that bypass stated requirements score zero.
GDPval-AA v2.1
General Agents
Elo-scored Artificial Analysis GDPval-AA v2.1 agent benchmark; distinct from GDPVal-AA v2 (index-typed) and plain GDPVal.
Harvey Legal Agent
General Agents
1,251 public tasks with Artificial Analysis's Stirrup harness; score is the all-pass rate over rubric criteria.
HANDBOOK.md
General Agents
Official OpenHands-based harness using tasks from the benchmark's early open-source v1 release.
OSWorld V2.1
General Agents
OSWorld v2.1 computer-use benchmark; Kimi models use the Kimi Agent harness in the official OSWorld v2 repo.
BFCL-V3
General Agents
BFCL-V3 - Berkeley Function Calling Leaderboard version 3, evaluating function calling and tool use.
BFCL-V4
General Agents
BFCL-V4 - Berkeley Function Calling Leaderboard version 4, evaluating function calling and tool use capabilities.
GDPVal
General Agents
GDPVal - agentic benchmark for evaluating general task completion.
GDPVal-AA v2
General Agents
GDPVal-AA v2 - Artificial Analysis GDPVal v2 agentic benchmark for evaluating general task completion. Score is an index value (not percentage).
TAU2-Bench
General Agents
TAU2-Bench - agentic tool use benchmark for customer service scenarios. Airline domain evaluated with fixes from Claude Opus 4.5 system card.
AgentWorldBench Overall
General Agents
AgentWorldBench Overall - mean across all 7 agent interaction domains (MCP, Search, Terminal, SWE, Android, Web, OS). Five-dimensional rubric, normalized to ...