LLM Benchmarks — Scores, Methodology & Live Rankings
What each benchmark measures, how models score, and the current rankings
MMMU-Pro
Vision & Language
MMMU-Pro - enhanced MMMU with harder questions and refined evaluation.
RealWorldQA
Vision & Language
RealWorldQA - visual question answering on real-world images.
HallusionBench
Vision & Language
HallusionBench - benchmark for language and visual hallucination.
MathVista (mini)
Vision & Language
MathVista (mini) - mathematical reasoning in visual contexts.
MMBench EN-DEV v1.1
Vision & Language
MMBench-EN-DEV v1.1 - multimodal benchmark English dev set.
V-Star
Vision & Language
V* - visual agent benchmark evaluating visual search and grounding capabilities.
DynaMath
Vision & Language
DynaMath - dynamic mathematical reasoning in visual contexts.
VlmsAreBlind
Vision & Language
VlmsAreBlind - benchmark testing visual perception capabilities that reveal blind spots in VLMs.
Vision2Web
Vision & Language
Vision2Web - visual web development benchmark. Scores averaged across frontend, webpage, and website categories. Evaluated with Claude Code harness, judged b...
MathVision
Vision & Language
MathVision - visual math problem solving benchmark. Reports Without CI and With CI (Consistency Inference) scores.
We-Math
Vision & Language
We-Math - visual mathematical reasoning benchmark evaluating step-by-step problem solving.
MedXpertQA-MM
Vision & Language
MedXpertQA-MM - multimodal medical expert question answering benchmark evaluating clinical reasoning with visual inputs.
ZEROBench
Vision & Language
ZEROBench - visual reasoning puzzle benchmark. Very challenging, scores typically in single digits.
PMC-VQA
Vision & Language
PMC-VQA - medical visual question answering benchmark using PubMed Central biomedical images.
SLAKE
Vision & Language
SLAKE - medical visual question answering benchmark using radiology images.
cfcolor
Vision & Language
cfcolor: Cloudflare-internal ("cf") color/asset recognition eval, scored as accuracy on a 0-100 scale in Cloudflare's internal Decision Index 0.2.1 suite.
VAST
Vision & Language
VAST: visual-audio scene/text classification variant, scored as macro-F1 on a 0-100 scale in Cloudflare's internal Decision Index 0.2.1 suite.
WorldVQA (with tools)
Vision & Language
WorldVQA visual question answering evaluated with tools, as printed on the Muse Spark Open model card (xhigh reasoning effort). Distinct from RealWorldQA.
RealWorldQA (spoken)
Vision & Language
RealWorldQA (spoken) as evaluated on the LFM3-Omni-2B card: image benchmarks with each question given only as speech (Omni table, 'Spoken visual QA' group).
MMStar (spoken)
Vision & Language
MMStar (spoken) as evaluated on the LFM3-Omni-2B card: MMStar with each question given only as speech (Omni table, 'Spoken visual QA' group).
POPE
Vision & Language
POPE as evaluated on the LFM3-Omni-2B card: POPE F1 over adversarial, popular, and random subsets (image setting).
POPE (spoken)
Vision & Language
POPE (spoken) as evaluated on the LFM3-Omni-2B card: POPE F1 with each question given only as speech (Omni table, 'Spoken visual QA' group).
ERQA (spoken)
Vision & Language
ERQA (spoken) as evaluated on the LFM3-Omni-2B card: ERQA with each question given only as speech (Omni table, 'Spoken visual QA' group).
EmbSpatial (spoken)
Vision & Language
EmbSpatial (spoken) as evaluated on the LFM3-Omni-2B card: Embodied spatial QA with each question given only as speech (Omni table, 'Spoken visual QA' group).
SEEDBench (image)
Vision & Language
SEEDBench (image) as evaluated on the LFM3-Omni-2B card: image subset of SEED-Bench.
MME
Vision & Language
MME as evaluated on the LFM3-VL-2B card (vision benchmark, with-thinking setting): General category, with-thinking column. Card prints MME as a normalized pe...
SEED-Bench (image)
Vision & Language
SEED-Bench (image) as evaluated on the LFM3-VL-2B card (vision benchmark, with-thinking setting): General category, with-thinking column. Image subset of SEE...
MM-Vet (v1)
Vision & Language
MM-Vet (v1) as evaluated on the LFM3-VL-2B card (vision benchmark, with-thinking setting): General category, with-thinking column. MM-Vet v1 (original); not ...
PerceptionBench
Vision & Language
PerceptionBench as evaluated on the LFM3-VL-2B card (vision benchmark, with-thinking setting): Perception category, with-thinking column. No inventory match.
HR-Bench (4K)
Vision & Language
HR-Bench (4K) as evaluated on the LFM3-VL-2B card (vision benchmark, with-thinking setting): Perception category, with-thinking column. High-resolution 4K su...
HR-Bench (8K)
Vision & Language
HR-Bench (8K) as evaluated on the LFM3-VL-2B card (vision benchmark, with-thinking setting): Perception category, with-thinking column. High-resolution 8K su...
ZoomBench (full + crop average)
Vision & Language
ZoomBench (full + crop average) as evaluated on the LFM3-VL-2B card (vision benchmark, with-thinking setting): Perception category, with-thinking column. Car...
CV-Bench
Vision & Language
CV-Bench as evaluated on the LFM3-VL-2B card (vision benchmark, with-thinking setting): Perception category, with-thinking column. Cambrian Vision-Centric (2...
RefCOCO-M
Vision & Language
RefCOCO-M as evaluated on the LFM3-VL-2B card (vision benchmark, with-thinking setting): Visual grounding category, with-thinking column. RefCOCO-M variant a...
ScreenSpot-v2 Desktop
Vision & Language
ScreenSpot-v2 Desktop as evaluated on the LFM3-VL-2B card (vision benchmark, with-thinking setting): GUI understanding category, with-thinking column. Screen...
ScreenSpot-v2 Mobile
Vision & Language
ScreenSpot-v2 Mobile as evaluated on the LFM3-VL-2B card (vision benchmark, with-thinking setting): GUI understanding category, with-thinking column. ScreenS...
ScreenSpot-v2 Web
Vision & Language
ScreenSpot-v2 Web as evaluated on the LFM3-VL-2B card (vision benchmark, with-thinking setting): GUI understanding category, with-thinking column. ScreenSpot...
MMVP
Vision & Language
MMVP, MultiModal Visual Patterns benchmark (vision patterns that trip up VLMs). Values reported as percentage. Source referenced on the LiquidAI/d1-2B model ...
VisualPuzzles
Vision & Language
VisualPuzzles, visual reasoning puzzle benchmark. Values reported as percentage. Source referenced on the LiquidAI/d1-2B model card.
VisualWebBench
Vision & Language
VisualWebBench, benchmark for understanding web pages/screenshots (GUI grounding and navigation). Values reported as percentage. Source referenced on the Liq...
VL-RewardBench
Vision & Language
VL-RewardBench, benchmark for reward-style preference judgments between vision-language answers. Values reported as percentage. Source referenced on the Liqu...
CharXiv (RQ) w/ python
Vision & Language
CharXiv reasoning questions with python tool; averaged over 4 runs (multimodal w/ python per Kimi K3.1 Pro card footnote).
ChartoGraphy w/ python
Vision & Language
ChartoGraphy with python tool, averaged over 5 runs.
BabyVision w/ python
Vision & Language
BabyVision with python tool, averaged over 4 runs.
ZeroBench_main w/ python (pass@5)
Vision & Language
Tools-augmented ZeroBench main set, pass@5, averaged over 5 runs.
BabyVision
Vision & Language
BabyVision - general visual reasoning benchmark. Reports Without CI and With CI (Consistency Inference) scores.