DEV Community· AskGPU·· 4 小時前AI 評分55
H100、A100 與 L40S：租用雲端 GPU 前要檢查甚麼
H100 vs A100 vs L40S: what to check before renting a cloud GPU
AI 導讀
AskGPU 整理租用雲端 GPU 前比較 H100、A100 和 L40S 的檢查清單，涵蓋 VRAM、互連、儲存、供應模式及計費方式。文章指出 L40S 沒有 NVLink，較適合推理及單 GPU 微調；Spot 可能在幾乎沒有預警下被收回。AskGPU 表示，其價格比較直接查閲供應商頁面並標註日期，而且不設付費排名。
正文
Renting a cloud GPU looks simple until the invoice arrives. Before you pick between an H100, an A100 and an L40S, run through this checklist.
1. VRAM first, FLOPS second
- H100: 80 GB (HBM3). A100: 40 GB or 80 GB variants. L40S: 48 GB (GDDR6).
- If the model plus KV cache does not fit, speed is irrelevant. Check which A100 variant a listing actually offers.
2. Interconnect
- Training across several GPUs needs NVLink or fast InfiniBand. Many cheap listings use PCIe only.
- The L40S has no NVLink, so it suits inference and single-GPU fine-tuning better than multi-GPU training.
3. Egress and storage
- Ask what moving your checkpoints and datasets out costs. Some providers charge per GB, others nothing.
- Persistent volumes are often billed even when the instance is stopped.
4. Spot vs on-demand
- Spot can be far cheaper but can be reclaimed with little warning. Only use it with frequent checkpointing.
- On-demand suits long jobs that cannot restart, and anything serving users.
5. Billing granularity
- Per-second, per-minute and per-hour billing differ a lot for short experiments. A 10-minute test billed as a full hour is a real cost.
- Check minimum commitments and idle-time charges.
6. Read the date on the price
GPU prices move often. Always note when a number was read from the provider's pricing page.
If you want a side-by-side view, AskGPU is an independent comparison of GPU cloud, AI API and hosting prices, each read from the provider's page and dated, with no paid rankings.
What else do you check before you rent? Tell me in the comments.
來源：DEV Community · dev.to