LFM2.5-2.6B

LiquidAI

Parameters

2.7B

Architecture

LFM2 (Hybrid)

Released

04.08.2026

License

LFM Open License v1.0

Open Weights Commercial Use Multimodal BF16 LFM en ar zh fr de it ja ko pt es vi th id hi ru pl

Input Modalities

text

Output Modalities

text

Context (native)

131,072 tokens

Context (extended)

131,072 tokens

Openness Index Score 70.0/100

About

LFM2.5-2.6B is Liquid AI's post-trained agent model - part of the LFM2.5 family of hybrid models designed for on-device deployment. It builds on the LFM2 architecture with a 131,072-token context window and agentic post-training. Best-in-class agent: competitive with models 4x larger on tool use, instruction following and multi-step agentic tasks.

Architecturally it is a hybrid of 22 double-gated convolution blocks and 8 Grouped-Query Attention (GQA) full-attention layers (30 layers total, 2.69B parameters, RoPE base 10M, vocabulary 128,000). Pre-training used ~34 trillion tokens; a mid-training phase extended the context window to 128K; post-training turned the base model into an agent in four stages - supervised fine-tuning (two rounds), per-domain teacher specialization, multi-domain on-policy distillation, and agentic reinforcement learning that trains the model directly inside popular agentic harnesses (their tools, system prompts and interaction patterns).

It is text-only, speaks 16 languages (English, Arabic, Chinese, French, German, Italian, Japanese, Korean, Portuguese, Spanish, Vietnamese, Thai, Indonesian, Hindi, Russian, Polish), uses a ChatML-like chat template with Pythonic function calling, and runs efficiently on edge hardware: 220 tok/s on an Apple M5 Max and 113 tok/s on an AMD Ryzen CPU in under 2.5 GB of memory. A 328M speculative decoding drafter (LFM2.5-2.6B-DSpark) pairs with it for ~2.6x faster decoding with identical outputs.

Recommended for agentic workloads, tool use, data extraction, RAG and long-context workflows; not recommended for agentic coding and knowledge-heavy tasks. Released August 4, 2026 under the LFM Open License v1.0.

Training Data 34 trillion tokens pre-training, mid-training for 128K context extension, post-training with SFT, per-domain teacher specialization, on-policy distillation, agentic RL.

Benchmark Scores

Benchmark Score Date Standing
MMLU-Pro
knowledge
16.77%
—
#45/48
better than 6%
BFCL-V4
general_agent
73.22%
—
#14/27
better than 50%
MMLU-Redux
knowledge
34.45%
—
#25/30
better than 10%
SWE-bench Verified
coding_agent
6.42%
—
#57/60
better than 5%
Humanity's Last Exam
stem_reasoning
7.77%
—
#67/71
better than 6%
SWE-bench Pro
coding_agent
0.67%
—
#74/77
better than 4%
Terminal Bench 2.1
coding_agent
4.55%
—
#39/44
better than 12%
GPQA Diamond
stem_reasoning
27.21%
—
#72/80
better than 10%
BrowseComp-zh
general_agent
9.76%
—
#10/13
better than 25%
SuperGPQA
knowledge
26.20
—
#28/28
better than 0%

Architecture

Decoder Block ×30 input Embedding vocab 128K · d 2048 Full Attention Hybrid 32:8 ×8 Dense FFN SwiGLU · d 11K Final RMSNorm LM Head tied with embedding output
Attention
Hybrid Attention (32:8)
Layers
30
Hidden size
2048
Context
131K tokens
Parameters
2690M

Source: Hugging Face config.json · Lfm2ForCausalLM · exact layer pattern · model repo

Type: Hybrid dense: 22 double-gated short-conv blocks + 8 GQA full-attention layers (Lfm2ForCausalLM)
Attention: GQA (32 query / 8 KV heads) on full-attention layers; RoPE theta 10M; double-gated conv blocks (L cache 3)
Decoder: Dense decoder-only hybrid (conv + attention)
Speculative Drafter

LFM2.5-2.6B-DSpark (328M, ~2.6x faster decoding)

Training Pipeline

  1. 1
    pretraining

    Pre-training (~34T tokens)

    Pre-trained on ~34 trillion tokens on the LFM2 hybrid architecture.

  2. 2
    other

    Mid-training: 128K context extension

    Mid-training phase extending the context window to 128K (131,072 tokens).

  3. 3
    sft

    Supervised fine-tuning (two rounds)

    First post-training stage turning the base model toward agentic workloads.

  4. 4
    other

    Per-domain teacher specialization

    Teacher models specialized per domain.

  5. 5
    other

    Multi-domain on-policy distillation

    On-policy distillation from the specialized teachers into the student.

  6. 6
    rl

    Agentic reinforcement learning

    RL inside popular agentic harnesses: exposes the model to their tools, system prompts and interaction patterns for reliable cross-environment agent behavior.

Training & Evaluation Datasets

NameRoleSizeModalitiesCollection
AA-Omni-Public (Artificial Analysis) evaluation — —
IFBench / Multi-IF / IFStruct evaluation — —
AIME25 / LiveCodeBench v6 evaluation — —
BFCL v4 / ToolSandbox / Tau-cubed-Bench Banking evaluation — —
Claw-Eval / PinchBench / BrowseComp+ (OpenClaw) evaluation — —

Comments (0)

No comments yet

Be the first to share your thoughts!

What now?

You have read the full card for LFM2.5-2.6B — here is where to go next.