Filters

-
-
-
Reset

GPU Models for LLM Inference — Specs, VRAM & Prices

Browse and compare GPU hardware for LLM inference

Inference Calculator

GeForce RTX 5090

NVIDIA · Blackwell

VRAM

32 GB

Memory BW

1,792 GB/s

FP16

419.2 TFLOPS

MSRP

USD 1,999.00

runs ~53 models (INT4) View Details

Apple M2 Ultra

Apple · M2

VRAM

64 GB

Memory BW

800 GB/s

FP16

54.4 TFLOPS

MSRP

USD 3,999.00

runs ~57 models (INT4) View Details

Apple M2 Max

Apple · M2

VRAM

32 GB

Memory BW

400 GB/s

FP16

27.2 TFLOPS

MSRP

USD 1,999.00

runs ~53 models (INT4) View Details

Apple M4 Max

Apple · M4

VRAM

36 GB

Memory BW

546 GB/s

FP16

36.8 TFLOPS

MSRP

USD 1,999.00

runs ~53 models (INT4) View Details

Apple M3 Max

Apple · M3

VRAM

36 GB

Memory BW

400 GB/s

FP16

28.2 TFLOPS

MSRP

USD 3,199.00

runs ~53 models (INT4) View Details

Apple M1 Max

Apple · M1

VRAM

32 GB

Memory BW

400 GB/s

FP16

20.8 TFLOPS

MSRP

USD 1,999.00

runs ~53 models (INT4) View Details

Apple M1 Ultra

Apple · M1

VRAM

64 GB

Memory BW

800 GB/s

FP16

42 TFLOPS

MSRP

USD 3,999.00

runs ~57 models (INT4) View Details