Parameters
20.9B total / 3.6B active
MoE: total / active
Architecture
Mixture-of-Experts (MoE) Transformer
Released
04.08.2025
License
Apache License 2.0
Input Modalities
Output Modalities
Context (native)
131,072 tokens
Context (extended)
131,072 tokens
About
gpt-oss-20b (openai/gpt-oss-20b) is OpenAI's smaller open-weight model, released August 4, 2025 under Apache 2.0 alongside gpt-oss-120b - a 20.91B-parameter Mixture-of-Experts transformer with 3.61B activated parameters per token, a 131,072-token context, and text-only input/output. Its MoE weights are post-trained with MXFP4 quantization, letting the model run within 16GB of memory; all reported evals use that same quantization.
It shares the 120b feature set: configurable reasoning effort (low, medium, high) tuned to latency needs, fully exposed chain-of-thought (for debugging and trust, not for end users), native agentic capabilities (function calling, web browsing, Python code execution, Structured Outputs), and full fine-tunability. It was trained on a text-only dataset of trillions of tokens focused on STEM, coding and general knowledge (knowledge cutoff June 2024), with harmful content filtered via CBRN pre-training filters from GPT-4o; training required ~10x fewer H100-hours than gpt-oss-120b. Model card paper: arXiv 2508.10925.
Training Data Trained on a text-only dataset with trillions of tokens, with a focus on STEM, coding, and general knowledge. Knowledge cutoff: June 2024. Pre-training data filtered for harmful content using CBRN pre-training filters from GPT-4o. Training required ~10x fewer H100-hours than gpt-oss-120b.
Benchmark Scores
| Benchmark | Score | Date |
|---|---|---|
|
AIME 2024 (with tools)
stem_reasoning
|
100.00%
|
05.08.2025 |
|
AIME 2025
stem_reasoning
|
92.27%
|
05.08.2025 |
|
AIME 2025 (with tools)
stem_reasoning
|
100.00%
|
05.08.2025 |
|
GPQA Diamond
stem_reasoning
|
56.89%
|
05.08.2025 |
|
GPQA Diamond (with tools)
stem_reasoning
|
100.00%
|
05.08.2025 |
|
Humanity's Last Exam
stem_reasoning
|
16.67%
|
05.08.2025 |
|
HLE (with tools)
stem_reasoning
|
17.30
|
05.08.2025 |
|
MMLU
knowledge
|
79.81%
|
05.08.2025 |
|
SWE-bench Verified
coding_agent
|
69.15%
|
05.08.2025 |
|
Tau-Bench Retail
general_agent
|
54.80
|
05.08.2025 |
|
Tau-Bench Airline
general_agent
|
38.00
|
05.08.2025 |
|
Aider Polyglot
coding_agent
|
34.20
|
05.08.2025 |
|
AIME 2024
stem_reasoning
|
92.10
|
05.08.2025 |
|
MMMLU
multilingual
|
36.24%
|
05.08.2025 |
|
HealthBench
general_capabilities
|
42.50
|
05.08.2025 |
|
HealthBench Hard
general_capabilities
|
10.80
|
05.08.2025 |
|
HealthBench Consensus
general_capabilities
|
82.60
|
05.08.2025 |
|
CodeForces
stem_reasoning
|
63.08%
|
05.08.2025 |
|
CodeForces (with tools)
stem_reasoning
|
100.00%
|
05.08.2025 |
Architecture
- Attention
- Hybrid Attention (64:8)
- MoE
- 32 experts · top-4 per token
- Layers
- 24
- Hidden size
- 2880
- Context
- 131K tokens
- RoPE θ
- 150K
- Parameters
- 20910M
- Active params
- 3610M
Source: Hugging Face config.json · GptOssForCausalLM · exact layer pattern · model repo
Training Pipeline
-
1
pretraining
Pretraining
-
2
sft
Post-Training: Distillation and SFT
-
3
rl
Reinforcement Learning for Reasoning and Tool Use
-
4
other
Safety Training: Deliberative Alignment
Training & Evaluation Datasets
| Name | Role | Size | Modalities | Collection |
|---|---|---|---|---|
| Text-only pre-training corpus (STEM, coding, general knowledge) | pretraining | — | — |
Linked Resources
gpt-oss-120b & gpt-oss-20b Model Card
https://arxiv.org/abs/2508.10925
OpenAI gpt-oss - Reference implementations and inference tools
https://github.com/openai/gpt-oss
OpenAI harmony - Harmony chat format implementation
https://github.com/openai/harmony
Introducing gpt-oss - OpenAI Blog
https://openai.com/index/introducing-gpt-oss/
Try gpt-oss
https://gpt-oss.com/
gpt-oss Collection on HuggingFace
https://huggingface.co/collections/openai/gpt-oss
Trend Analysis
24h Change
+0.1%
7d Change
+1.0%
Current
40,435
downloads
+1.1%
likes
+0.0%
downloads
+0.8%
downloads_all_time
+0.3%
Usage & Social Metrics
| Source | Metric | Value | Period | Recorded |
|---|---|---|---|---|
| ollama | downloads | 12,500,000 pulls | daily | 01.09.2026 |
| huggingface | downloads_all_time | 94,001,122 | daily | 01.09.2026 |
| huggingface | followers | 40,435 | daily | 01.09.2026 |
| huggingface | likes | 4,974 | daily | 01.09.2026 |
| huggingface | downloads | 6,519,052 | daily | 01.09.2026 |
| ollama | downloads | 12,400,000 pulls | daily | 31.08.2026 |
| huggingface | downloads_all_time | 93,740,312 | daily | 31.08.2026 |
| huggingface | followers | 40,378 | daily | 31.08.2026 |
| huggingface | likes | 4,973 | daily | 31.08.2026 |
| huggingface | downloads | 6,450,692 | daily | 31.08.2026 |
| ollama | downloads | 12,400,000 pulls | daily | 30.08.2026 |
| huggingface | downloads_all_time | 93,563,232 | daily | 30.08.2026 |
| huggingface | followers | 40,323 | daily | 30.08.2026 |
| huggingface | likes | 4,969 | daily | 30.08.2026 |
| huggingface | downloads | 6,520,972 | daily | 30.08.2026 |
| ollama | downloads | 12,400,000 pulls | daily | 29.08.2026 |
| huggingface | followers | 40,265 | daily | 29.08.2026 |
| huggingface | likes | 4,967 | daily | 29.08.2026 |
| huggingface | downloads | 6,434,202 | daily | 29.08.2026 |
| ollama | downloads | 12,300,000 pulls | daily | 28.08.2026 |
| huggingface | followers | 40,216 | daily | 28.08.2026 |
| huggingface | likes | 4,963 | daily | 28.08.2026 |
| huggingface | downloads | 6,346,634 | daily | 28.08.2026 |
| ollama | downloads | 12,300,000 pulls | daily | 27.08.2026 |
| huggingface | followers | 40,157 | daily | 27.08.2026 |
| huggingface | likes | 4,957 | daily | 27.08.2026 |
| huggingface | downloads | 6,702,545 | daily | 27.08.2026 |
| ollama | downloads | 12,200,000 pulls | daily | 26.08.2026 |
| huggingface | followers | 40,076 | daily | 26.08.2026 |
| huggingface | likes | 4,955 | daily | 26.08.2026 |
| huggingface | downloads | 6,950,594 | daily | 26.08.2026 |
| ollama | downloads | 12,200,000 pulls | daily | 25.08.2026 |
| huggingface | followers | 40,023 | daily | 25.08.2026 |
| huggingface | likes | 4,954 | daily | 25.08.2026 |
| huggingface | downloads | 7,056,476 | daily | 25.08.2026 |
| ollama | downloads | 12,200,000 pulls | daily | 24.08.2026 |
| huggingface | followers | 39,962 | daily | 24.08.2026 |
| huggingface | likes | 4,949 | daily | 24.08.2026 |
| huggingface | downloads | 7,036,240 | daily | 24.08.2026 |