Filters

-
-
-
Reset

GPU Models for LLM Inference — Specs, VRAM & Prices

Browse and compare GPU hardware for LLM inference

Inference Calculator

Apple M2 Ultra

Apple · M2

VRAM

64 GB

Memory BW

800 GB/s

FP16

54.4 TFLOPS

MSRP

USD 3,999.00

runs ~57 models (INT4) View Details

Apple M1 Ultra

Apple · M1

VRAM

64 GB

Memory BW

800 GB/s

FP16

42 TFLOPS

MSRP

USD 3,999.00

runs ~57 models (INT4) View Details