| Accelerated computing GPUs and AWS ML chips |
| medium 1 vCPU | large 2 vCPU | xlarge 4 vCPU | 2xlarge 8 vCPU | 4xlarge 16 vCPU | 8xlarge 32 vCPU | 12xlarge 48 vCPU | 16xlarge 64 vCPU | 24xlarge 96 vCPU | 32xlarge 128 vCPU | 48xlarge 192 vCPU | metal whole host |
g7 Xeon Granite Rapids · 32 GB per GPU Newest | | | | $1.8k | $2.2k | $3.0k | $5.2k ×2 | | $10k ×4 | | $21k ×8 | |
g7e Xeon Emerald Rapids · 96 GB per GPU Newest | | | | $2.5k | $2.9k | $3.8k | $6.0k ×2 | | $12k ×4 | | $24k ×8 | |
p6-b200 Xeon Emerald Rapids · 179 GB per GPU | | | | | | | | | | | $83k ×8 | |
p6-b300 Xeon Emerald Rapids · 268 GB per GPU | | | | | | | | | | | $104k ×8 | |
g6 EPYC Milan · 24 GB per GPU | | | $588 | $714 | $966 | $1.5k | $3.4k ×4 | $2.5k | $4.9k ×4 | | $9.7k ×8 | |
g6e EPYC Milan · 48 GB per GPU | | | $1.4k | $1.6k | $2.2k | $3.3k | $7.7k ×4 | $5.5k | $11k ×4 | | $22k ×8 | |
| | $147 | $173 | $347 | $694 | | | | | | | |
gr6 EPYC Milan · 24 GB per GPU | | | | | $1.1k | $1.8k | | | | | | |
| | | | | $778 | | | | | | | |
g5g Graviton2 · 16 GB per GPU | | | $307 | $406 | $604 | $1.0k | | $2.0k ×2 | | | | $2.0k ×2 |
p5en Xeon Sapphire Rapids · 17 GB per GPU | | | | | | | | | | | $46k ×8 | |
g5 EPYC Rome · 24 GB per GPU | | | $734 | $885 | $1.2k | $1.8k | $4.1k ×4 | $3.0k | $5.9k ×4 | | $12k ×8 | |
p5 EPYC Milan · 80 GB per GPU Newest | | | | | $5.0k | | | | | | $40k ×8 | |
g4dn Xeon Family · 16 GB per GPU | | | $384 | $549 | $879 | $1.6k | $2.9k ×4 | $3.2k | | | | $5.7k ×8 |
p4d Xeon Cascade Lake · 40 GB per GPU | | | | | | | | | $16k ×8 | | | |
p4de Xeon Cascade Lake · 80 GB per GPU | | | | | | | | | $20k ×8 | | | |
g4ad EPYC Rome · 8 GB per GPU | | | $276 | $395 | $633 | $1.3k ×2 | | $2.5k ×4 | | | | |
g3 Xeon Broadwell · 8 GB per GPU | | | | | $832 | $1.7k ×2 | | $3.3k ×4 | | | | |
g3s Xeon Broadwell · 8 GB per GPU | | | $548 | | | | | | | | | |
p3 Xeon Broadwell · 16 GB per GPU | | | | $2.2k | | $8.9k ×4 | | $18k ×8 | | | | |
p3dn Xeon Skylake · 32 GB per GPU | | | | | | | | | $23k ×8 | | | |
| | | $657 | | | $5.3k ×8 | | $11k ×16 | | | | |
| | | | | | | $2.9k | | | | $12k | |
inf2 EPYC Milan · 32 GB per GPU Newest | | | $553 | | | $1.4k | | | $4.7k ×6 | | $9.5k ×12 | |
| | | | | | | | | $9.6k | | | |
| | | | $1.2k | $2.4k | | | $9.6k | | | | |
| | | $166 | $264 | | | | | $3.4k ×16 | | | |
trn1 Xeon Ice Lake · 32 GB per GPU | | | | $981 | | | | | | $16k ×16 | | |
trn1n Xeon Ice Lake · 32 GB per GPU | | | | | | | | | | $18k ×16 | | |
| | | | | | | | | $3.8k | | | |