GLM-5.2

Zhipu AI

Parameters

753.0B total / 40.0B active

MoE: total / active

Architecture

MoE with IndexShare sparse attention + MTP layer

Released

16.06.2026

License

MIT License

Open Weights Commercial Use Multimodal BF16, F32 GLM en zh

Input Modalities

text

Output Modalities

text

Context (native)

1,000,000 tokens

Context (extended)

1,000,000 tokens

Openness Index Score 100.0/100

About

GLM-5.2 (zai-org/GLM-5.2) is Z.ai's flagship model for long-horizon tasks - a large sparse Mixture-of-Experts LLM (~744-753B total parameters, ~40B active per token) that for the first time delivers long-horizon capability on a solid 1M-token context, released June 16, 2026 under the MIT License (no regional limits).

Its headline improvements over GLM-5.1: a stable 1M context that sustains long-horizon work; advanced coding with flexible thinking effort levels to balance performance and latency; and an improved architecture built around IndexShare - reusing the same sparse-attention indexer across every four attention layers (21 full + 57 shared indexers in the 78-layer stack, index top-k 2048 with 32 index heads of dim 128), which cuts per-token FLOPs by 2.9x at 1M context. The backbone (GlmMoeDsa) pairs DeepSeek-Sparse-Attention-style indexing with MLA-style compressed KV (kv-LoRA rank 512, 64 heads of dim 192), 3 dense + 75 sparse MoE layers, 256 routed experts + 1 shared with 8 routed per token (expert FFN 2048, sigmoid scoring, noaux-tc), hidden size 6144, vocab 155K, and an improved Multi-Token Prediction (MTP) layer for speculative decoding with up to 20% longer acceptance length.

GLM-5.2 leads open-weights models on the Artificial Analysis Intelligence Index (v4.1, 11 points above GLM-5.1), with strong agentic/coding results (SWE-Bench Pro, NL2Repo, DeepSWE, HLE-with-tools at up to 400K context).

Training Data Trained as part of GLM-5 series with long-horizon task focus

Benchmark Scores

Benchmark Score Date Standing
Humanity's Last Exam
stem_reasoning
72.73%
17.06.2026
#18/71
better than 76%
CritPt (no tools)
stem_reasoning
64.04%
17.06.2026
#5/21
better than 75%
AIME 26
stem_reasoning
100.00%
17.06.2026
#1/45
better than 98%
HMMT Nov 25
stem_reasoning
89.34%
17.06.2026
#5/20
better than 74%
HMMT Feb 26
stem_reasoning
93.26%
17.06.2026
#14/44
better than 70%
IMOAnswerBench
stem_reasoning
97.16%
17.06.2026
#4/30
better than 90%
GPQA Diamond
stem_reasoning
94.14%
17.06.2026
#21/80
better than 75%
SWE-bench Pro
coding_agent
69.23%
17.06.2026
#13/77
better than 84%
NL2Repo
coding_agent
59.38%
17.06.2026
#15/41
better than 65%
DeepSWE 1.1
coding_agent
59.90%
17.06.2026
#22/34
better than 36%

Hardware Requirements

Estimated VRAM per quantization at 4,096 tokens context — MoE: all experts must fit in VRAM, only 40.0B are active per token

Quantization Weights KV Cache Total VRAM On your hardware
FP16 — 16-bit 1506.0 GB 6.2 GB 1587.5 GB Which GPUs can run it? Calculate on your GPU
INT8 — 8-bit 753.0 GB 3.1 GB 793.8 GB Which GPUs can run it? Calculate on your GPU
INT4 — 4-bit 376.5 GB 1.6 GB 396.9 GB Which GPUs can run it? Calculate on your GPU
FP4 — 4-bit 376.5 GB 1.6 GB 396.9 GB Which GPUs can run it? Calculate on your GPU

Only datacenter GPUs — FP16 needs 1587.5 GB. For consumer hardware, choose the INT4 build with a multi-GPU setup.

Architecture

Decoder Block input Embedding vocab 155K · d 6144 Full Attention 64 heads · dₕ 192 ×78 MoE FFN 256 experts · top-8 · +1 shared · dᴻ 2048 MTP Head ×1 speculative layer Final Norm LM Head vocab 155K output
Attention
Sparse Attention
MoE
256 experts · top-8 per token
Layers
78
Hidden size
6144
Context
1M tokens
Parameters
753000M
Active params
40000M

Source: Hugging Face config.json · GlmMoeDsaForCausalLM · model repo

Type: decoder-only Transformer
Attention: IndexShare sparse attention (reuses indexer across every 4 sparse attention layers, 2.9x per-token FLOPs reduction at 1M context)
Decoder: autoregressive
MoE: yes (? experts)

Training Pipeline

  1. 1
    pretraining

    Pre-training (~28.5T tokens, GLM-5 series)

    GLM-5 series pre-training corpus (28.5T tokens, per zai-org/GLM-5 GitHub).

  2. 2
    rl

    Post-training for long-horizon tasks

    Post-trained as part of the GLM-5 series with long-horizon task focus (DB training_data_info); flexible thinking-effort levels.

Training & Evaluation Datasets

NameRoleSizeModalitiesCollection
GLM-5 series pre-training corpus (~28.5T tokens) pretraining — —

Comments (0)

No comments yet

Be the first to share your thoughts!

What now?

You have read the full card for GLM-5.2 — here is where to go next.