ExploitGym (2h)
ExploitGym exploitation benchmark, single-run Pass@1 on 869 tasks under a 2-hour timeout budget (API inference time rescaled by per-model TPS from Artificial Analysis plus non-API overhead), evaluated in Claude Code 2.1.207 with max reasoning effort, no web tools, and a domain whitelist. Reported in the GLM-5.3 model card.
Category
Cybersecurity
Max Score
869.0
Score Type
count
Active
Yes
Model Scores
Scores for ExploitGym (2h)
| Model | Score | Date | Verified |
|---|---|---|---|
| GLM-5.3 |
45.05%
|
28.08.2026 | Verified |
| GLM-5.2 |
7.43%
|
28.08.2026 | Verified |
| Kimi K3 |
10.89%
|
28.08.2026 | Verified |
| Qwen3.8-2.4T-A95B |
14.00
|
28.08.2026 | Verified |
| Opus-4.8 |
32.67%
|
28.08.2026 | Verified |
| Fable-5 |
82.67%
|
28.08.2026 | Verified |
| GPT-5.6 Sol |
100.00%
|
28.08.2026 | Verified |