A100 PCIe 80GB currently costs 3.5× the RTX 4090 24GB at the cheapest on-demand price we track ($1.19 vs $0.34/hr). Both numbers refresh hourly and link to their source.
| RTX 4090 24GB | A100 PCIe 80GB | |
|---|---|---|
| Cheapest on-demand $/hr | $0.34 (runpod) | $1.19 (runpod) |
| VRAM | 24 GB | 80 GB |
| Memory bandwidth | 1008 GB/s | 1935 GB/s |
| $ per GB VRAM per hour | $0.014 | $0.015 |
| Providers tracked | 1 | 2 |
Nameplate specs are vendor claims, not measured throughput. See each GPU's page for every offer, spot prices, and history. Other comparisons: H100 SXM 80GB vs H200 SXM 141GB · A100 SXM4 80GB vs H100 SXM 80GB · H100 SXM 80GB vs B200 180GB · RTX 4090 24GB vs RTX 5090 32GB · L40S 48GB vs A100 PCIe 80GB · H200 SXM 141GB vs B200 180GB · MI300X 192GB vs H100 SXM 80GB