LocalAIPrices
← Back to comparison
NVIDIA

NVIDIA GeForce RTX 3080 10GB

Ampere · RTX 30 Series · Discontinued (used market)

We earn commissions from purchases made through links on this site. This doesn't affect our rankings or recommendations.
Prices updated 5 days ago
New price
Used avg (eBay 30d)
$/GB VRAM (best)
$32/GB
MSRP: $699

Specifications

VRAM10 GB
Memory typeGDDR6X
Bus width320-bit
Memory bandwidth760 GB/s
CUDA cores8,704
Tensor cores272
FP1659.6 TFLOPS
TDP320W
Power connector2×8-pin
Card length285 mm
Slot width2 slots
PCIeGen 4 x16
CUDA compute8.6
Max model (Q4)~16B parameters

Inference Benchmarks (Q4_K_M)

Llama 3.3 8B
72.0 tok/s
Qwen 3 32B
Llama 3.3 70B

llama.cpp, batch_size=1, ctx=4096, single GPU.

What Can You Run?

ModelQ4_K_MQ8_0FP16
Llama 3.3 8B8BExcellent~72 tok/sWon't fitWon't fit
Llama 3.3 70B70.6BWon't fitWon't fitWon't fit
Qwen 3 8B8.2BUsableWon't fitWon't fit
Qwen 3 32B32.8BWon't fitWon't fitWon't fit
DeepSeek R1 70B70.6BWon't fitWon't fitWon't fit
Mistral Nemo 12B12.2BUsableWon't fitWon't fit
Phi-4 14B14BWon't fitWon't fitWon't fit
Gemma 3 27B27.4BWon't fitWon't fitWon't fit
Codestral 25B25.3BWon't fitWon't fitWon't fit
Command R 35B35BWon't fitWon't fitWon't fit

Notes

10GB limits model size. Consider 3090 for larger models.