Infrastructure atlas
AMD/CDNA 3
Instinct MI325X
A CDNA 3 refresh that increases the memory pool to 256 GB HBM3e for high-parameter inference and training.
GPUtraininginferencelarge modelsROCm

Precision & peak compute
| Precision | Published peak | Basis |
|---|---|---|
| FP8 matrix | 2.615 PFLOPS | Dense · per accelerator |
| FP8 matrix | 5.23 PFLOPS | Structured sparsity · per accelerator |
| FP16 / BF16 matrix | 1.307 PFLOPS | Dense · per accelerator |
| INT8 matrix | 2,615 TOPS | Dense · per accelerator |
Peak FLOPS and TOPS are theoretical hardware figures. Sparse and dense modes, chip and system totals, and form factors are not interchangeable.
AMD Instinct MI325X series page