LocalAIPrices

GPU & Apple Silicon Price Comparison for AI Inference

Compare 23 GPUs and Apple Silicon configs by VRAM, price, inference speed, and power draw. New and used pricing.

Hardware
16 GB$299Amazon$19/GB560 GB/s225W40.0 tok/s
12 GB$249Amazon$21/GB456 GB/s150W35.0 tok/s
20 GB$749Amazon$480-36%$24/GB800 GB/s315W65.0 tok/s
24 GB$899Amazon$620-31%$26/GB960 GB/s355W80.0 tok/s28.0 tok/s
16 GB$449Amazon$28/GB288 GB/s165W42.0 tok/s10.0 tok/s
NVIDIARTX 3090
24 GB$725$30/GB936 GB/s350W98.0 tok/s35.0 tok/s
Mac Studio128 GB$3,999Apple$31/GB546 GB/s145W68.0 tok/s28.0 tok/s
Mac Studio192 GB$5,999Apple$31/GB819 GB/s200W85.0 tok/s38.0 tok/s
10 GB$320$32/GB760 GB/s320W72.0 tok/s
Mac Mini24 GB$799Apple$33/GB120 GB/s65W28.0 tok/s
24 GB$820$34/GB1,008 GB/s450W105.0 tok/s38.0 tok/s
16 GB$769Amazon$580-25%$36/GB672 GB/s285W85.0 tok/s24.0 tok/s
Mac Mini48 GB$1,799Apple$37/GB273 GB/s75W52.0 tok/s18.0 tok/s
NVIDIARTX A6000
48 GB$3,899Amazon$1,850-53%$39/GB768 GB/s300W82.0 tok/s30.0 tok/s
16 GB$979Amazon$780-20%$49/GB736 GB/s320W95.0 tok/s28.0 tok/s
NVIDIARTX 5070
12 GB$599Amazon$50/GB672 GB/s250W105.0 tok/s
16 GB$849Amazon$53/GB896 GB/s300W125.0 tok/s30.0 tok/s
NVIDIARTX 4090
24 GB$2,200Amazon$1,550-30%$65/GB1,008 GB/s450W128.0 tok/s42.0 tok/s
NVIDIARTX 5080
16 GB$1,099Amazon$69/GB960 GB/s360W140.0 tok/s35.0 tok/s
NVIDIARTX 5090
32 GB$2,199Amazon$69/GB1,792 GB/s575W185.0 tok/s62.0 tok/s
NVIDIAA100 80GB
80 GB$5,500$69/GB2,039 GB/s300W110.0 tok/s48.0 tok/s
48 GB$6,199Amazon$129/GB960 GB/s300W125.0 tok/s40.0 tok/s
NVIDIAH100 PCIe
80 GB3,350 GB/s350W180.0 tok/s75.0 tok/s
We earn commissions from purchases made through links on this site. This doesn't affect our rankings or recommendations.