Fit for GeForce RTX 4060

8GB VRAM · NVIDIA · General · INT4

✓

Fits on 1 GPU

(12 models)
1
Spark-X2.5-4B
SparkLLM (XHToken) · 4.0B · INT4

Score

0.65

tok/s (est.)

87.7

Community tok/s

—

VRAM (est.)

2.3GB

License

Apache License 2.0

2
Gemma 3 12B PT
Google DeepMind · 12.0B · INT4

Score

0.64

tok/s (est.)

30.9

Community tok/s

—

VRAM (est.)

6.8GB

License

Gemma Terms of Use

3
Qwen3-Coder-Next
Qwen · 0.1K · MoE · INT4

Score

0.59

tok/s (est.)

1111.1

Community tok/s

—

VRAM (est.)

—GB

License

Apache License 2.0

4
MiniCPM5-2B
OpenBMB · 2.5B · INT4

Score

0.59

tok/s (est.)

133.2

Community tok/s

—

VRAM (est.)

1.4GB

License

Apache License 2.0

5
Gemma4-12B
Google · 11.9B · INT4

Score

0.49

tok/s (est.)

31.0

Community tok/s

—

VRAM (est.)

6.7GB

License

Apache License 2.0

6
Qwen3.5-4B
Qwen · 4.0B · INT4

Score

0.45

tok/s (est.)

87.7

Community tok/s

—

VRAM (est.)

2.3GB

License

Apache License 2.0

7
granite-4.2-3B
IBM · 3.0B · INT4

Score

0.42

tok/s (est.)

113.9

Community tok/s

—

VRAM (est.)

1.7GB

License

Apache License 2.0

8
Ornith-1.0-9B
DeepReinforce AI · 9.0B · INT4

Score

0.42

tok/s (est.)

40.8

Community tok/s

—

VRAM (est.)

5.1GB

License

MIT License

9
Clef-Flash
Cloudflare · 9.0B · INT4

Score

0.41

tok/s (est.)

40.8

Community tok/s

—

VRAM (est.)

5.1GB

License

Apache License 2.0

10
Spark-X2.5-1.7B
SparkLLM (XHToken) · 2.0B · INT4

Score

0.36

tok/s (est.)

162.6

Community tok/s

—

VRAM (est.)

1.1GB

License

Apache License 2.0

11
Nemotron-3-Nano-4B
NVIDIA · 4.0B · INT4

Score

0.26

tok/s (est.)

88.3

Community tok/s

—

VRAM (est.)

2.2GB

License

NVIDIA Nemotron Open Model License

12
LFM2.5-2.6B
LiquidAI · 2.7B · INT4

Score

0.25

tok/s (est.)

125.6

Community tok/s

—

VRAM (est.)

1.5GB

License

LFM Open License v1.0

⚠

Needs 6+ GPUs

(12 models)
1
NVIDIA-Nemotron-3.5-Bolt-74B-A9B-24GB
NVIDIA · 74.0B · int4 · 6× GPU

Score

11.37

tok/s (est.)

71.3

Community tok/s

—

VRAM/GPU (est.)

6.5GB

License

OpenMDW License Agreement v1.1

2
Muse-Spark-Open-816B-A42B
Meta Superintelligence Lab · 816.0B · int4 · 64× GPU

Score

0.91

tok/s (est.)

150.5

Community tok/s

—

VRAM/GPU (est.)

6.7GB

License

Muse Model License

3
DeepSeek-V4.1-Flash
DeepSeek · 763.0B · int4 · 60× GPU

Score

0.89

tok/s (est.)

309.2

Community tok/s

—

VRAM/GPU (est.)

6.7GB

License

MIT License

4
Qwen3.8-Flash-Next
Qwen Team (Alibaba) · 125.0B · int4 · 10× GPU

Score

0.87

tok/s (est.)

162.5

Community tok/s

—

VRAM/GPU (est.)

6.6GB

License

Qwen Community License 1.0

5
GLM-5.3-Flash
Zhipu AI · 320.0B · int4 · 25× GPU

Score

0.87

tok/s (est.)

138.8

Community tok/s

—

VRAM/GPU (est.)

6.7GB

License

MIT License

6
Kolibri-1
Aleph Alpha · 78.1B · int4 · 7× GPU

Score

0.85

tok/s (est.)

191.4

Community tok/s

—

VRAM/GPU (est.)

5.9GB

License

Apache License 2.0

7
Bonsai 2 27B — GGUF
Prism ML · 27.4B · int4 · 3× GPU

Score

0.85

tok/s (est.)

40.2

Community tok/s

—

VRAM/GPU (est.)

5.1GB

License

Apache License 2.0

8
Gemma 3 27B PT
Google DeepMind · 27.0B · int4 · 3× GPU

Score

0.84

tok/s (est.)

40.8

Community tok/s

—

VRAM/GPU (est.)

5.1GB

License

Gemma Terms of Use

9
Qwen3-Next-80B-A3B-Thinking
Qwen · 80.0B · int4 · 7× GPU

Score

0.82

tok/s (est.)

214.9

Community tok/s

—

VRAM/GPU (est.)

6.0GB

License

Apache License 2.0

10
Qwen3.5-122B-A10B
Qwen Team (Alibaba Cloud) · 122.0B · int4 · 10× GPU

Score

0.82

tok/s (est.)

103.6

Community tok/s

—

VRAM/GPU (est.)

6.4GB

License

Apache License 2.0

11
Xing4.0-29B-A4B
China Telecom AI · 31.2B · int4 · 3× GPU

Score

0.82

tok/s (est.)

79.5

Community tok/s

—

VRAM/GPU (est.)

5.5GB

License

Apache License 2.0

12
GPT-OSS-120B
OpenAI · 116.8B · int4 · 10× GPU

Score

0.78

tok/s (est.)

185.5

Community tok/s

—

VRAM/GPU (est.)

6.2GB

License

Apache License 2.0