A100 PCIe 80GB currently costs 5.2× the RTX 4090 24GB at the cheapest on-demand price we track ($2.09 vs $0.40/hr). Both numbers refresh continually and link to their source.
| RTX 4090 24GB | A100 PCIe 80GB | |
|---|---|---|
| Cheapest on-demand $/hr | $0.40 (vast) | $2.09 (runpod) |
| VRAM | 24 GB | 80 GB |
| Memory bandwidth | 1008 GB/s | 1935 GB/s |
| $ per GB VRAM per hour | $0.017 | $0.026 |
| Providers tracked | 2 | 2 |
Nameplate specs are vendor claims, not measured throughput. See each GPU's page for every offer, spot prices, and history. Other comparisons: H100 SXM 80GB vs H200 SXM 141GB · A100 SXM4 80GB vs H100 SXM 80GB · H100 SXM 80GB vs B200 180GB · RTX 4090 24GB vs RTX 5090 32GB · L40S 48GB vs A100 PCIe 80GB · H200 SXM 141GB vs B200 180GB