Toronto GPU cloud pricing comparison
Instances with the same GPU model and GPU count, side by side. Each cell is that cloud's cheapest instance for the configuration (Linux · official on-demand list price); the bundled vCPU and memory differ by cloud.
Lowest price per GPU configuration
- A100 × 8: AWS p4d.24xlarge $18,433.77/mo
- H100 × 1: Azure NC40ads_H100_v5 $6,270.70/mo
- H100 × 2: Azure NC80adis_H100_v5 $12,541.40/mo
- H100 × 8: AWS p5.48xlarge $46,206.08/mo
- L4 × 1: GCP g2-standard-4 $568.15/mo
- L4 × 4: GCP g2-standard-48 $3,216.55/mo
- L4 × 8: GCP g2-standard-96 $6,433.10/mo
- T4 × 1: AWS, Azure g4dn.xlarge · NC4as_T4_v3 $426.32/mo
- T4 × 4: AWS g4dn.12xlarge $3,170.39/mo
- V100 × 1: AWS, Azure p3.2xlarge · NC6s_v3 $2,457.18/mo
- V100 × 4: AWS, Azure p3.8xlarge · NC24s_v3 $9,828.72/mo
GPU configuration × cloud monthly price (USD)
| GPU configuration | AWS | Azure | GCP |
|---|---|---|---|
| A100 × 8 | Lowest$18,433.77/mop4d.24xlarge96 vCPU / 1152 GB | — | $32,592.56/moa2-ultragpu-8g96 vCPU / 1360 GB |
| H100 × 1 | — | Lowest$6,270.70/moNC40ads_H100_v540 vCPU / 320 GB | $8,891.00/moa3-highgpu-1g26 vCPU / 234 GB |
| H100 × 2 | — | Lowest$12,541.40/moNC80adis_H100_v580 vCPU / 640 GB | $17,782.00/moa3-highgpu-2g52 vCPU / 468 GB |
| H100 × 8 | Lowest$46,206.08/mop5.48xlarge192 vCPU / 2048 GB | $86,128.32/moND96isr_H100_v596 vCPU / 1900 GB | $71,127.99/moa3-highgpu-8g208 vCPU / 1872 GB |
| L4 × 1 | $652.33/mog6.xlarge4 vCPU / 16 GB | — | Lowest$568.15/mog2-standard-44 vCPU / 16 GB |
| L4 × 4 | $3,729.81/mog6.12xlarge48 vCPU / 192 GB | — | Lowest$3,216.55/mog2-standard-4848 vCPU / 192 GB |
| L4 × 8 | $10,821.13/mog6.48xlarge192 vCPU / 768 GB | — | Lowest$6,433.10/mog2-standard-9696 vCPU / 384 GB |
| T4 × 1 | Lowest$426.32/mog4dn.xlarge4 vCPU / 16 GB | Lowest$426.32/moNC4as_T4_v34 vCPU / 28 GB | — |
| T4 × 4 | Lowest$3,170.39/mog4dn.12xlarge48 vCPU / 192 GB | $3,518.60/moNC64as_T4_v364 vCPU / 440 GB | — |
| V100 × 1 | Lowest$2,457.18/mop3.2xlarge8 vCPU / 61 GB | Lowest$2,457.18/moNC6s_v36 vCPU / 112 GB | — |
| V100 × 4 | Lowest$9,828.72/mop3.8xlarge32 vCPU / 244 GB | Lowest$9,828.72/moNC24s_v324 vCPU / 448 GB | — |
Only configurations sold by two or more clouds are listed (a configuration sold by one cloud is not a comparison).
— = no price data for this region and size (not offered or not collected).
Monthly price = hourly price × each cloud's monthly hours (AWS, Azure, GCP 730 h).
Includes: server compute (instance) · Excludes: disk · backup/snapshot · network egress · tax/VAT · support plan · reserved/committed discounts · managed services.