GPU Models for LLM Inference — Specs, VRAM & Prices
Browse and compare GPU hardware for LLM inference
GeForce RTX 3050 6GB
NVIDIA · Ampere
VRAM
6 GB
Memory BW
168 GB/s
FP16
30.1 TFLOPS
MSRP
USD 169.00
GeForce RTX 5090
NVIDIA · Blackwell
VRAM
32 GB
Memory BW
1,792 GB/s
FP16
419.2 TFLOPS
MSRP
USD 1,999.00
GeForce RTX 3080 Ti
NVIDIA · Ampere
VRAM
12 GB
Memory BW
912 GB/s
FP16
136 TFLOPS
MSRP
USD 1,199.00
GeForce RTX 4060
NVIDIA · Ada Lovelace
VRAM
8 GB
Memory BW
272 GB/s
FP16
55.2 TFLOPS
MSRP
USD 299.00
GeForce RTX 3060 8GB
NVIDIA · Ampere
VRAM
8 GB
Memory BW
224 GB/s
FP16
51.2 TFLOPS
MSRP
USD 329.00
GeForce RTX 4080 Super
NVIDIA · Ada Lovelace
VRAM
16 GB
Memory BW
736 GB/s
FP16
225.8 TFLOPS
MSRP
USD 999.00
GeForce GTX 1660
NVIDIA · Turing
VRAM
6 GB
Memory BW
192 GB/s
FP16
— TFLOPS
MSRP
USD 219.00
GeForce RTX 3050 8GB
NVIDIA · Ampere
VRAM
8 GB
Memory BW
224 GB/s
FP16
36.4 TFLOPS
MSRP
USD 249.00
GeForce RTX 3060 Ti
NVIDIA · Ampere
VRAM
8 GB
Memory BW
448 GB/s
FP16
64.8 TFLOPS
MSRP
USD 399.00
GeForce RTX 4070 Ti Super
NVIDIA · Ada Lovelace
VRAM
16 GB
Memory BW
672 GB/s
FP16
197.7 TFLOPS
MSRP
USD 799.00
GeForce RTX 5060 Ti 8GB
NVIDIA · Blackwell
VRAM
8 GB
Memory BW
448 GB/s
FP16
94.9 TFLOPS
MSRP
USD 379.00
GeForce RTX 5060
NVIDIA · Blackwell
VRAM
8 GB
Memory BW
320 GB/s
FP16
76.8 TFLOPS
MSRP
USD 299.00
GeForce RTX 4060 Ti
NVIDIA · Ada Lovelace
VRAM
8 GB
Memory BW
288 GB/s
FP16
88 TFLOPS
MSRP
USD 399.00
GeForce RTX 3090
NVIDIA · Ampere
VRAM
24 GB
Memory BW
936 GB/s
FP16
142 TFLOPS
MSRP
USD 1,499.00
GeForce RTX 4070 Ti
NVIDIA · Ada Lovelace
VRAM
12 GB
Memory BW
504 GB/s
FP16
160.4 TFLOPS
MSRP
USD 799.00
GeForce RTX 5070
NVIDIA · Blackwell
VRAM
12 GB
Memory BW
672 GB/s
FP16
123.5 TFLOPS
MSRP
USD 549.00
GeForce GTX 1660 Ti
NVIDIA · Turing
VRAM
6 GB
Memory BW
288 GB/s
FP16
— TFLOPS
MSRP
USD 279.00
GeForce RTX 3080 12GB
NVIDIA · Ampere
VRAM
12 GB
Memory BW
912 GB/s
FP16
122 TFLOPS
MSRP
USD 799.00
GeForce RTX 3070 Ti
NVIDIA · Ampere
VRAM
8 GB
Memory BW
608 GB/s
FP16
87 TFLOPS
MSRP
USD 599.00
GeForce GTX 1660 Super
NVIDIA · Turing
VRAM
6 GB
Memory BW
336 GB/s
FP16
— TFLOPS
MSRP
USD 229.00