Filters

-
-
-
Reset

GPU Models for LLM Inference — Specs, VRAM & Prices

Browse and compare GPU hardware for LLM inference

Inference Calculator

AMD Radeon RX 7700 XT

AMD · RDNA3

VRAM

12 GB

Memory BW

432 GB/s

FP16

35.17 TFLOPS

MSRP

USD 449.00

runs ~25 models (INT4) View Details

AMD Radeon RX 9060

AMD · RDNA4

VRAM

8 GB

Memory BW

320 GB/s

FP16

21.4 TFLOPS

MSRP

USD 279.00

runs ~25 models (INT4) View Details

AMD Radeon RX 6600

AMD · RDNA2

VRAM

8 GB

Memory BW

224 GB/s

FP16

17.86 TFLOPS

MSRP

USD 329.00

runs ~25 models (INT4) View Details

AMD Radeon RX 6700

AMD · RDNA2

VRAM

10 GB

Memory BW

320 GB/s

FP16

22.58 TFLOPS

MSRP

USD 479.00

runs ~25 models (INT4) View Details

AMD Radeon RX 7900 XTX

AMD · RDNA3

VRAM

24 GB

Memory BW

960 GB/s

FP16

61.44 TFLOPS

MSRP

USD 999.00

runs ~52 models (INT4) View Details

AMD Radeon RX 6400

AMD · RDNA2

VRAM

4 GB

Memory BW

128 GB/s

FP16

7.13 TFLOPS

MSRP

USD 159.00

runs ~19 models (INT4) View Details

AMD Radeon RX 6800 XT

AMD · RDNA2

VRAM

16 GB

Memory BW

512 GB/s

FP16

41.47 TFLOPS

MSRP

USD 649.00

runs ~28 models (INT4) View Details

AMD Radeon RX 9070 XT

AMD · RDNA4

VRAM

16 GB

Memory BW

640 GB/s

FP16

48.7 TFLOPS

MSRP

USD 599.00

runs ~28 models (INT4) View Details

AMD Radeon RX 7600

AMD · RDNA3

VRAM

8 GB

Memory BW

288 GB/s

FP16

21.75 TFLOPS

MSRP

USD 269.00

runs ~25 models (INT4) View Details

AMD Radeon RX 7900 GRE

AMD · RDNA3

VRAM

16 GB

Memory BW

576 GB/s

FP16

45.98 TFLOPS

MSRP

USD 549.00

runs ~28 models (INT4) View Details

AMD Radeon RX 9050

AMD · RDNA4

VRAM

8 GB

Memory BW

288 GB/s

FP16

10.6 TFLOPS

MSRP

USD 279.00

runs ~25 models (INT4) View Details

AMD Radeon RX 6900 XT

AMD · RDNA2

VRAM

16 GB

Memory BW

512 GB/s

FP16

46.08 TFLOPS

MSRP

USD 999.00

runs ~28 models (INT4) View Details

AMD Radeon RX 6600 XT

AMD · RDNA2

VRAM

8 GB

Memory BW

256 GB/s

FP16

21.21 TFLOPS

MSRP

USD 379.00

runs ~25 models (INT4) View Details

AMD Radeon RX 9060 XT 16GB

AMD · RDNA4

VRAM

16 GB

Memory BW

320 GB/s

FP16

25.6 TFLOPS

MSRP

USD 349.00

runs ~28 models (INT4) View Details

AMD Radeon RX 9070 GRE

AMD · RDNA4

VRAM

12 GB

Memory BW

432 GB/s

FP16

34.3 TFLOPS

MSRP

USD 549.00

runs ~25 models (INT4) View Details

AMD Radeon RX 9070

AMD · RDNA4

VRAM

16 GB

Memory BW

640 GB/s

FP16

36.1 TFLOPS

MSRP

USD 549.00

runs ~28 models (INT4) View Details

AMD Radeon RX 6750 XT

AMD · RDNA2

VRAM

12 GB

Memory BW

432 GB/s

FP16

26.62 TFLOPS

MSRP

USD 549.00

runs ~25 models (INT4) View Details

AMD Radeon RX 7800 XT

AMD · RDNA3

VRAM

16 GB

Memory BW

624 GB/s

FP16

37.32 TFLOPS

MSRP

USD 499.00

runs ~28 models (INT4) View Details

AMD Radeon RX 6700 XT

AMD · RDNA2

VRAM

12 GB

Memory BW

384 GB/s

FP16

26.43 TFLOPS

MSRP

USD 479.00

runs ~25 models (INT4) View Details

AMD Radeon RX 6800

AMD · RDNA2

VRAM

16 GB

Memory BW

512 GB/s

FP16

32.33 TFLOPS

MSRP

USD 579.00

runs ~28 models (INT4) View Details
Previous Page 1 of 2 Next