LLM Benchmarks — Scores, Methodology & Live Rankings
What each benchmark measures, how models score, and the current rankings
VideoMME (w sub.)
Video Understanding
VideoMME (with sub.) - comprehensive video understanding benchmark with subtitles.
VideoMME (w/o sub.)
Video Understanding
VideoMME (without sub.) - comprehensive video understanding benchmark without subtitles.
VideoMMMU
Video Understanding
VideoMMMU - multi-modal multi-discipline video understanding benchmark.
MVBench
Video Understanding
MVBench - comprehensive multi-modal video understanding benchmark.
MMVU
Video Understanding
MMVU - multi-modal video understanding benchmark evaluating comprehension across diverse video types.
IntPhys2
Video Understanding
IntPhys2 intuitive-physics video understanding benchmark, reported on the Muse Spark Open model card under Multimodal (xhigh reasoning effort).
VideoMMEv2
Video Understanding
VideoMME v2 multimodal video understanding benchmark, reported on the Muse Spark Open model card and in its HF evaluation-results metadata (dataset: MME-Benc...
MuirBench
Video Understanding
MuirBench as evaluated on the LFM3-VL-2B card (vision benchmark, with-thinking setting): General category, with-thinking column. Image/video difference under...
ActivityNet-QA (test)
Video Understanding
ActivityNet-QA (test) as evaluated on the LFM3-VL-2B card (vision benchmark, with-thinking setting): Video category, with-thinking column. ActivityNet-QA tes...
MotionBench (dev)
Video Understanding
MotionBench (dev) as evaluated on the LFM3-VL-2B card (vision benchmark, with-thinking setting): Video category, with-thinking column. MotionBench dev split;...