Multimodal Benchmark

OmniBench (overall)

OmniBench (overall) as evaluated on the LFM3-Omni-2B card: Omni table, 'Image + audio understanding' group. Image plus audio clip per question, scored with the official prompt and answer parser on all 1,142 questions. Printed as two rows: overall (46.32) and speech (48.25); proposed as two separate new benchmarks. No inventory match.

Category

Multimodal

Score type

percent

Scale

100%

higher is better

Models tested

1

What is OmniBench (overall)?

OmniBench (overall) is a benchmark for handling several input types together (images, documents, text). The official description says: "OmniBench (overall) as evaluated on the LFM3-Omni-2B card: Omni table, 'Image + audio understanding' group". Below we describe in simple words what benchmarks of this type generally examine.

What does it test?

OmniBench (overall) measures handling several input types together (images, documents, text). In detail, it checks:

  • questions that mix text with images or document pages
  • reading and extracting information from screenshots and scans
  • understanding layout, titles, logos and figures in real documents
  • staying accurate when the text content alone is not enough

How to read the score

The score is accuracy: the percentage of tasks answered or solved correctly. 100% means every task was solved perfectly; higher is better.

Official methodology note: OmniBench (overall) as evaluated on the LFM3-Omni-2B card: Omni table, 'Image + audio understanding' group. Image plus audio clip per question, scored with the official prompt and answer parser on all 1,142 questions. Printed as two rows: overall (46.32) and speech (48.25); proposed as two separate new benchmarks. No inventory match.

Frequently asked questions

What is the OmniBench (overall) benchmark?

OmniBench (overall) is a benchmark for handling several input types together (images, documents, text). The official description says: 'OmniBench (overall) as evaluated on the LFM3-Omni-2B card: Omni table, 'Image + audio understanding' group'. Below we describe in simple words what benchmarks of this type generally examine.

What does OmniBench (overall) test?

OmniBench (overall) mainly measures handling several input types together (images, documents, text). Concretely, it checks: questions that mix text with images or document pages; reading and extracting information from screenshots and scans; understanding layout, titles, logos and figures in real documents.

How is the OmniBench (overall) score calculated?

The score is accuracy: the percentage of tasks answered or solved correctly. 100% means every task was solved perfectly; higher is better. The declared maximum score of this benchmark is 100.0.

Where do I get OmniBench (overall) data and scores?

The official benchmark page/reference is linked on this page. Every score on Open LLM Radar is also available as open data: download the scores JSON (http://open-llm-radar-api:8000/api/v1/benchmarks/omnibench-overall/scores) or pull it directly from the Open LLM Radar API with any HTTP client.

Benchmark data & downloads

Where to get, inspect and reuse the data behind this benchmark.

API

Benchmark metadata (JSON)

This page's benchmark record from the Open LLM Radar API

 Download

All model scores (JSON download)

Full score table as JSON; paginate with limit/offset params

 Docs

Open LLM Radar API docs

Swagger UI to explore and reuse all radar API endpoints

Model scores 1 model tested

Reset
# Model Score Date Source Verified
1 LFM3-Omni-2B
LiquidAI
46.32%
— Report Verified

Best score first. Weights filter: open. The bar shows the relative score between the best and lowest tracked model on this benchmark — it is not a percentage of solved tasks. Showing 1 of 1 scored models.