Filters

-
-
-
Reset

GPU Models for LLM Inference — Specs, VRAM & Prices

Browse and compare GPU hardware for LLM inference

Inference Calculator

Intel Arc A750

Intel · Alchemist

VRAM

8 GB

Memory BW

512 GB/s

FP16

117.5 TFLOPS

MSRP

USD 289.00

runs ~25 models (INT4) View Details

Intel Arc Graphics 140V

Intel · Xe2-LPG

VRAM

0 GB

Memory BW

136.5 GB/s

FP16

32 TFLOPS

MSRP

—

View Details

Intel Arc A310

Intel · Alchemist

VRAM

4 GB

Memory BW

124 GB/s

FP16

24.6 TFLOPS

MSRP

USD 99.00

runs ~19 models (INT4) View Details

Intel Arc A770 8GB

Intel · Alchemist

VRAM

8 GB

Memory BW

512 GB/s

FP16

137.6 TFLOPS

MSRP

USD 329.00

runs ~25 models (INT4) View Details

Intel Arc B580

Intel · Battlemage

VRAM

12 GB

Memory BW

456 GB/s

FP16

109.4 TFLOPS

MSRP

USD 249.00

runs ~25 models (INT4) View Details

Intel Arc B570

Intel · Battlemage

VRAM

10 GB

Memory BW

380 GB/s

FP16

92.2 TFLOPS

MSRP

USD 219.00

runs ~25 models (INT4) View Details

Intel Arc A770 16GB

Intel · Alchemist

VRAM

16 GB

Memory BW

560 GB/s

FP16

137.6 TFLOPS

MSRP

USD 349.00

runs ~28 models (INT4) View Details

Intel Arc A380

Intel · Alchemist

VRAM

6 GB

Memory BW

186 GB/s

FP16

32.8 TFLOPS

MSRP

USD 139.00

runs ~22 models (INT4) View Details

Intel Arc A580

Intel · Alchemist

VRAM

8 GB

Memory BW

512 GB/s

FP16

83.7 TFLOPS

MSRP

USD 179.00

runs ~25 models (INT4) View Details

Intel Iris Xe Graphics (96 EU)

Intel · Xe-LP

VRAM

0 GB

Memory BW

68 GB/s

FP16

— TFLOPS

MSRP

—

View Details