LLM Benchmarks — Scores, Methodology & Live Rankings
What each benchmark measures, how models score, and the current rankings
CharXiv (RQ)
Document Understanding
CharXiv (RQ) - reasoning questions over arXiv figures and tables.
OmniDocBench 1.5
Document Understanding
OmniDocBench 1.5 - document understanding and parsing benchmark.
AI2D_TEST
Document Understanding
AI2D_TEST - grade-school science diagram understanding benchmark.
CC-OCR
Document Understanding
CC-OCR - comprehensive OCR benchmark across diverse content.
ParseBench Mean
Document Understanding
ParseBench Mean - document parsing benchmark mean score across text content and formatting. Pipeline: qwen3_6_35b_a3b_fp8_vllm_parse_layout.
ParseBench Text Content
Document Understanding
ParseBench Text Content - text content extraction accuracy from documents.
ParseBench Text Formatting
Document Understanding
ParseBench Text Formatting - text formatting fidelity in document parsing.
OCRBench
Document Understanding
OCRBench - comprehensive OCR capability evaluation benchmark.
MMLongBench-Doc
Document Understanding
MMLongBench-Doc - long document understanding benchmark evaluating comprehension and retrieval over extended documents.
OCRBench
Document Understanding
OCRBench - comprehensive OCR capability evaluation benchmark.
ContractNLI
Document Understanding
ContractNLI evaluates natural-language inference over non-disclosure agreements, scored as macro-F1 on a 0-100 scale in Cloudflare's internal Decision Index ...
NLI4CT
Document Understanding
NLI4CT: natural-language inference over clinical trial reports, scored as macro-F1 on a 0-100 scale in Cloudflare's internal Decision Index 0.2.1 suite.
OCR Bench v2
Document Understanding
OCRBench v2 is the second-generation OCR/document-understanding benchmark suite with harder reading and parsing tasks. Recorded from the Bonsai 2 27B GGUF ca...
CharXiv (descriptive, val)
Document Understanding
CharXiv (descriptive, val) as evaluated on the LFM3-VL-2B card (vision benchmark, with-thinking setting): Document/OCR & Chart category, with-thinking column...
GDP.pdf w/ python
Document Understanding
Each original PDF sent to a sandbox for IPython processing; rubric graded with Gemini-3.5-Flash (medium effort); task-macro mean rubric pass rate; averaged o...
OfficeQA Pro v2
Document Understanding
Newer v2 of OfficeQA Pro; PDF corpus as page images only; online answer retrieval scores zero.