| Accelerated computing GPUs and AWS ML chips |
| medium 1 vCPU | large 2 vCPU | xlarge 4 vCPU | 2xlarge 8 vCPU | 4xlarge 16 vCPU | 8xlarge 32 vCPU | 12xlarge 48 vCPU | 16xlarge 64 vCPU | 24xlarge 96 vCPU | 32xlarge 128 vCPU | 48xlarge 192 vCPU | metal whole host |
g7e Xeon Emerald Rapids · 96 GB per GPU Newest | | | | $3.6k | $4.2k | $5.6k | $8.8k ×2 | | $18k ×4 | | $35k ×8 | |
g6 EPYC Milan · 24 GB per GPU | | | $852 | $1.0k | $1.4k | $2.1k | $4.9k ×4 | $3.6k | $7.1k ×4 | | $14k ×8 | |
g6e EPYC Milan · 48 GB per GPU | | | $2.0k | $2.4k | $3.2k | $4.8k | $11k ×4 | $8.0k | $16k ×4 | | $32k ×8 | |
| | $214 | $251 | $503 | $1.0k | | | | | | | |
gr6 EPYC Milan · 24 GB per GPU | | | | | $1.6k | $2.6k | | | | | | |
| | | | | $1.1k | | | | | | | |
g5g Graviton2 · 16 GB per GPU | | | $414 | $548 | $816 | $1.4k | | $2.7k ×2 | | | | $2.7k ×2 |
p5en Xeon Sapphire Rapids · 17 GB per GPU | | | | | | | | | | | $58k ×8 | |
g5 EPYC Rome · 24 GB per GPU | | | $1.1k | $1.3k | $1.7k | $2.6k | $6.0k ×4 | $4.3k | $8.6k ×4 | | $17k ×8 | |
p5 EPYC Milan · 80 GB per GPU Newest | | | | | $6.3k | | | | | | $50k ×8 | |
g4dn Xeon Family · 16 GB per GPU | | | $518 | $741 | $1.2k | $2.1k | $3.9k ×4 | $4.3k | | | | $7.7k ×8 |
p4d Xeon Cascade Lake · 40 GB per GPU | | | | | | | | | $22k ×8 | | | |
p4de Xeon Cascade Lake · 80 GB per GPU | | | | | | | | | $27k ×8 | | | |
g4ad EPYC Rome · 8 GB per GPU | | | $373 | $533 | $854 | $1.7k ×2 | | $3.4k ×4 | | | | |
g3 Xeon Broadwell · 8 GB per GPU | | | | | $1.2k | $2.3k ×2 | | $4.6k ×4 | | | | |
g3s Xeon Broadwell · 8 GB per GPU | | | $759 | | | | | | | | | |
p3 Xeon Broadwell · 16 GB per GPU | | | | $3.1k | | $12k ×4 | | $24k ×8 | | | | |
p3dn Xeon Skylake · 32 GB per GPU | | | | | | | | | $31k ×8 | | | |
| | | $1.1k | | | $9.0k ×8 | | $18k ×16 | | | | |
| | | | | | | $3.9k | | | | $16k | |
inf2 EPYC Milan · 32 GB per GPU Newest | | | $830 | | | $2.2k | | | $7.1k ×6 | | $14k ×12 | |
| | | $225 | $357 | | | | | $4.7k ×16 | | | |
| | | | | | | | | $4.8k | | | |