A40 vs MI300X

Comparing the A40 and MI300X for cloud rental? The A40 is available from 0 providers starting at , while the MI300X starts at across 0 providers. Below is a live breakdown of pricing, VRAM, compute throughput, and where to rent each GPU.

A40

VRAM
48 GB
TFLOPS
150
Cheapest
See all A40 offers

MI300X

VRAM
192 GB
TFLOPS
1307
Cheapest
See all MI300X offers

A40 vs MI300X at a glance

Spec profile

A40MI300X
A40 vs MI300X spec comparison radar chartVRAMFP16BandwidthValueProviders

Each axis is scaled to the stronger GPU — the outer edge is better.

Value for money

Live pricing for both GPUs is needed to compute value-for-money metrics. See the provider tables below for current rates.

Specs are manufacturer peak FP16 Tensor figures; real-world throughput varies by workload, precision, and software stack.

A40 vs MI300X specs & pricing

SpecificationA40MI300X
Cheapest price
VRAM
48 GB
192 GB
FP16 TFLOPS
150
1307
Memory bandwidth
696 GB/s
5300 GB/s
Release year
2021
2024
Cloud providers

Which should you choose?

  • MI300X has more VRAM (192 GB), so it fits larger models and bigger batch sizes without sharding.
  • MI300X offers higher FP16 throughput, training and serving faster on compute-bound workloads.

Provider availability

Only A40
None
Both GPUs
None
Only MI300X
None

Frequently asked questions

How much VRAM do the A40 and MI300X have?

The A40 has 48 GB of VRAM and the MI300X has 192 GB. More VRAM lets you serve larger models and longer context windows on a single GPU.

Which is faster, the A40 or MI300X?

On paper the MI300X is faster, with 1307 FP16 TFLOPS versus 150. Real-world speed also depends on memory bandwidth and software stack.

Live prices come from public provider catalogs and can change quickly. How we collect prices.

Related GPU comparisons