| Accelerated computing GPUs and AWS ML chips |
| medium 1 vCPU | large 2 vCPU | xlarge 4 vCPU | 2xlarge 8 vCPU | 4xlarge 16 vCPU | 8xlarge 32 vCPU | 12xlarge 48 vCPU | 16xlarge 64 vCPU | 24xlarge 96 vCPU | 32xlarge 128 vCPU | 48xlarge 192 vCPU | metal whole host |
g7 Xeon Granite Rapids · 32 GB per GPU Newest | | | | $2.52 | $3.04 | $4.09 | $7.13 ×2 | | $14 ×4 | | $29 ×8 | |
g7e Xeon Emerald Rapids · 96 GB per GPU Newest | | | | $3.36 | $4.00 | $5.27 | $8.29 ×2 | | $17 ×4 | | $33 ×8 | |
p6-b200 Xeon Emerald Rapids · 179 GB per GPU | | | | | | | | | | | $114 ×8 | |
p6-b300 Xeon Emerald Rapids · 268 GB per GPU | | | | | | | | | | | $142 ×8 | |
g6 EPYC Milan · 24 GB per GPU | | | $0.805 | $0.978 | $1.32 | $2.01 | $4.60 ×4 | $3.40 | $6.68 ×4 | | $13 ×8 | |
g6e EPYC Milan · 48 GB per GPU | | | $1.86 | $2.24 | $3.00 | $4.53 | $10 ×4 | $7.58 | $15 ×4 | | $30 ×8 | |
| | $0.202 | $0.237 | $0.475 | $0.950 | | | | | | | |
gr6 EPYC Milan · 24 GB per GPU | | | | | $1.54 | $2.45 | | | | | | |
| | | | | $1.07 | | | | | | | |
g5g Graviton2 · 16 GB per GPU | | | $0.420 | $0.556 | $0.828 | $1.37 | | $2.74 ×2 | | | | $2.74 ×2 |
p5en Xeon Sapphire Rapids · 17 GB per GPU | | | | | | | | | | | $63 ×8 | |
g5 EPYC Rome · 24 GB per GPU | | | $1.01 | $1.21 | $1.62 | $2.45 | $5.67 ×4 | $4.10 | $8.14 ×4 | | $16 ×8 | |
p5 EPYC Milan · 80 GB per GPU Newest | | | | | $6.88 | | | | | | $55 ×8 | |
g4dn Xeon Family · 16 GB per GPU | | | $0.526 | $0.752 | $1.20 | $2.18 | $3.91 ×4 | $4.35 | | | | $7.82 ×8 |
p4d Xeon Cascade Lake · 40 GB per GPU | | | | | | | | | $22 ×8 | | | |
p4de Xeon Cascade Lake · 80 GB per GPU | | | | | | | | | $27 ×8 | | | |
g4ad EPYC Rome · 8 GB per GPU | | | $0.379 | $0.541 | $0.867 | $1.73 ×2 | | $3.47 ×4 | | | | |
g3 Xeon Broadwell · 8 GB per GPU | | | | | $1.14 | $2.28 ×2 | | $4.56 ×4 | | | | |
g3s Xeon Broadwell · 8 GB per GPU | | | $0.750 | | | | | | | | | |
p3 Xeon Broadwell · 16 GB per GPU | | | | $3.06 | | $12 ×4 | | $24 ×8 | | | | |
p3dn Xeon Skylake · 32 GB per GPU | | | | | | | | | $31 ×8 | | | |
| | | $0.900 | | | $7.20 ×8 | | $14 ×16 | | | | |
| | | | | | | $3.96 | | | | $16 | |
inf2 EPYC Milan · 32 GB per GPU Newest | | | $0.758 | | | $1.97 | | | $6.49 ×6 | | $13 ×12 | |
| | | | | | | | | $13 | | | |
| | | | $1.65 | $3.30 | | | $13 | | | | |
| | | $0.228 | $0.362 | | | | | $4.72 ×16 | | | |
trn1 Xeon Ice Lake · 32 GB per GPU | | | | $1.34 | | | | | | $22 ×16 | | |
trn1n Xeon Ice Lake · 32 GB per GPU | | | | | | | | | | $25 ×16 | | |
| | | | | | | | | $5.20 | | | |