Qwen3-Coder-Next

Qwen

Parameters

0.1K total / 0.0K active

MoE: total / active

Architecture

Causal Language Model

Released

30.01.2026

License

Apache License 2.0

Open Weights Commercial Use Multimodal BF16 Qwen3 en zh

Input Modalities

text

Output Modalities

text

Context (native)

262,144 tokens

Context (extended)

262,144 tokens

Openness Index Score 100.0/100

About

Qwen3-Coder-Next (Qwen/Qwen3-Coder-Next) is Alibaba's open-weight language model designed specifically for coding agents and local development - a sparse Mixture-of-Experts with 80B total parameters and only 3B activated (79B non-embedding), delivering performance comparable to models with 10-20x more active parameters at high cost-effectiveness for agent deployment.

Its 48-layer hybrid layout repeats 12x (3x (Gated DeltaNet -> MoE) + 1x (Gated Attention -> MoE)): 36 linear-attention layers (Gated DeltaNet with 32 V / 16 QK heads, head dim 128) and 12 full-attention layers (Gated Attention with 16 Q / 2 KV heads, head dim 256, RoPE dim 64), with hidden size 2048. The MoE uses 512 experts with 10 activated per token plus 1 shared expert (expert intermediate dim 512). Context length is 262,144 tokens natively.

Qwen3-Coder-Next excels at long-horizon reasoning, complex tool usage and recovery from execution failures via an elaborate agentic training recipe, and integrates seamlessly with real-world IDE/CLI scaffolds (Claude Code, Qwen Code, Qoder, Kilo, Trae, Cline and more). Note: it supports non-thinking mode only - it does not generate <think> blocks, and enable_thinking=False is no longer required. Released January 30, 2026 under Apache 2.0.

Training Data Pretraining & Post-training

Benchmark Scores

Benchmark Score Date Standing
SWE-bench Verified
coding_agent
80.50%
03.02.2026
#38/60
better than 37%
SWE-bench Pro
coding_agent
49.39%
03.02.2026
#55/77
better than 29%
Terminal-Bench 2.0
coding_agent
11.75%
03.02.2026
#20/23
better than 14%
Aider
coding_agent
79.21%
03.02.2026
#2/4
better than 67%
SWE-bench Multilingual
coding_agent
68.40%
03.02.2026
#35/48
better than 28%

Hardware Requirements

Estimated VRAM per quantization at 4,096 tokens context — MoE: all experts must fit in VRAM, only 0.0K are active per token

Quantization Weights KV Cache Total VRAM On your hardware
FP16 — 16-bit 0.0 GB 0.0 GB 0.0 GB Which GPUs can run it? Calculate on your GPU
INT8 — 8-bit 0.0 GB 0.0 GB 0.0 GB Which GPUs can run it? Calculate on your GPU
INT4 — 4-bit 0.0 GB 0.0 GB 0.0 GB Which GPUs can run it? Calculate on your GPU
FP4 — 4-bit 0.0 GB 0.0 GB 0.0 GB Which GPUs can run it? Calculate on your GPU

Consumer GPUs that fit this model with a single card (INT4):

Architecture

Decoder Block ×48 input Embedding vocab 152K · d 2048 Full Attention Hybrid 16:2 · dₕ 256 ×12 Linear / Recurrent Hybrid 16:2 · dₕ 256 ×36 MoE FFN 512 experts · top-10 · dᴻ 512 Final Norm LM Head vocab 152K output
Attention
Hybrid Attention (16:2)
MoE
512 experts · top-10 per token
Layers
48
Hidden size
2048
Context
262K tokens
RoPE θ
5M
Parameters
80
Active params
3

Source: Hugging Face config.json · Qwen3NextForCausalLM · exact layer pattern · model repo

Type: Hybrid (Gated DeltaNet + Gated Attention MoE)
Attention: Gated Attention + Gated DeltaNet
Decoder: Causal LM
MoE: yes (512 experts)
Routing: Top-K + Shared Experts

Training Pipeline

  1. 1
    pretraining

    Pretraining

    Pretraining stage with large-scale text and code corpora

  2. 2
    other

    Post-training

    Post-training stage including elaborate training recipe for agentic capabilities, long-horizon reasoning, complex tool usage, and recovery from execution failures

Training & Evaluation Datasets

NameRoleSizeModalitiesCollection
Coding-agent training corpus (long-horizon agentic coding) finetune — —

Comments (0)

No comments yet

Be the first to share your thoughts!

What now?

You have read the full card for Qwen3-Coder-Next — here is where to go next.