GPU Models for LLM Inference — Specs, VRAM & Prices
Browse and compare GPU hardware for LLM inference
Apple M1
Apple · M1
VRAM
8 GB
Memory BW
68.3 GB/s
FP16
5.2 TFLOPS
MSRP
USD 699.00
Apple M2 Ultra
Apple · M2
VRAM
64 GB
Memory BW
800 GB/s
FP16
54.4 TFLOPS
MSRP
USD 3,999.00
Apple M2 Max
Apple · M2
VRAM
32 GB
Memory BW
400 GB/s
FP16
27.2 TFLOPS
MSRP
USD 1,999.00
Apple M2 Pro
Apple · M2
VRAM
16 GB
Memory BW
200 GB/s
FP16
13.6 TFLOPS
MSRP
USD 1,299.00
Apple M1 Pro
Apple · M1
VRAM
16 GB
Memory BW
200 GB/s
FP16
10.6 TFLOPS
MSRP
USD 1,999.00
Apple M2
Apple · M2
VRAM
8 GB
Memory BW
100 GB/s
FP16
7.2 TFLOPS
MSRP
USD 599.00
Apple M4
Apple · M4
VRAM
16 GB
Memory BW
120 GB/s
FP16
7.6 TFLOPS
MSRP
USD 599.00
Apple M4 Pro
Apple · M4
VRAM
24 GB
Memory BW
273 GB/s
FP16
17 TFLOPS
MSRP
USD 1,399.00
Apple M4 Max
Apple · M4
VRAM
36 GB
Memory BW
546 GB/s
FP16
36.8 TFLOPS
MSRP
USD 1,999.00
Apple M3 Pro
Apple · M3
VRAM
18 GB
Memory BW
150 GB/s
FP16
14.8 TFLOPS
MSRP
USD 1,999.00
Apple M3 Max
Apple · M3
VRAM
36 GB
Memory BW
400 GB/s
FP16
28.2 TFLOPS
MSRP
USD 3,199.00
Apple M1 Max
Apple · M1
VRAM
32 GB
Memory BW
400 GB/s
FP16
20.8 TFLOPS
MSRP
USD 1,999.00
Apple M1 Ultra
Apple · M1
VRAM
64 GB
Memory BW
800 GB/s
FP16
42 TFLOPS
MSRP
USD 3,999.00
Apple M3
Apple · M3
VRAM
8 GB
Memory BW
100 GB/s
FP16
7 TFLOPS
MSRP
USD 1,099.00