GPU Models for LLM Inference — Specs, VRAM & Prices

VRAM

32 GB

Memory BW

1,792 GB/s

FP16

419.2 TFLOPS

MSRP

USD 1,999.00

VRAM

12 GB

Memory BW

912 GB/s

FP16

136 TFLOPS

MSRP

USD 1,199.00

VRAM

16 GB

Memory BW

736 GB/s

FP16

225.8 TFLOPS

MSRP

USD 999.00

VRAM

16 GB

Memory BW

672 GB/s

FP16

197.7 TFLOPS

MSRP

USD 799.00

VRAM

24 GB

Memory BW

936 GB/s

FP16

142 TFLOPS

MSRP

USD 1,499.00

VRAM

12 GB

Memory BW

504 GB/s

FP16

160.4 TFLOPS

MSRP

USD 799.00

VRAM

12 GB

Memory BW

672 GB/s

FP16

123.5 TFLOPS

MSRP

USD 549.00

VRAM

12 GB

Memory BW

912 GB/s

FP16

122 TFLOPS

MSRP

USD 799.00

VRAM

10 GB

Memory BW

760 GB/s

FP16

119 TFLOPS

MSRP

USD 699.00

VRAM

24 GB

Memory BW

1,008 GB/s

FP16

290.6 TFLOPS

MSRP

USD 1,835.00

VRAM

16 GB

Memory BW

288 GB/s

FP16

88 TFLOPS

MSRP

USD 499.00

VRAM

16 GB

Memory BW

960 GB/s

FP16

225.1 TFLOPS

MSRP

USD 999.00

VRAM

16 GB

Memory BW

896 GB/s

FP16

177.4 TFLOPS

MSRP

USD 749.00

VRAM

12 GB

Memory BW

504 GB/s

FP16

142 TFLOPS

MSRP

USD 599.00

VRAM

12 GB

Memory BW

360 GB/s

FP16

51.2 TFLOPS

MSRP

USD 329.00

VRAM

16 GB

Memory BW

716.8 GB/s

FP16

194.9 TFLOPS

MSRP

USD 1,199.00

VRAM

12 GB

Memory BW

432 GB/s

FP16

35.17 TFLOPS

MSRP

USD 449.00

VRAM

10 GB

Memory BW

320 GB/s

FP16

22.58 TFLOPS

MSRP

USD 479.00

VRAM

24 GB

Memory BW

960 GB/s

FP16

61.44 TFLOPS

MSRP

USD 999.00

VRAM

16 GB

Memory BW

512 GB/s

FP16

41.47 TFLOPS

MSRP

USD 649.00