Infrastructure atlas
AMD/CDNA 3

Instinct MI325X

A CDNA 3 refresh that increases the memory pool to 256 GB HBM3e for high-parameter inference and training.

GPUtraininginferencelarge modelsROCm
Instinct MI325X hardware

01 / Memory

256 GB HBM3e

Per accelerator

02 / Bandwidth

6 TB/s

Peak theoretical

03 / Platform

2 TB HBM3e

8-GPU platform

Precision & peak compute

PrecisionPublished peakBasis
FP8 matrix2.615 PFLOPSDense · per accelerator
FP8 matrix5.23 PFLOPSStructured sparsity · per accelerator
FP16 / BF16 matrix1.307 PFLOPSDense · per accelerator
INT8 matrix2,615 TOPSDense · per accelerator

Peak FLOPS and TOPS are theoretical hardware figures. Sparse and dense modes, chip and system totals, and form factors are not interchangeable.

AMD Instinct MI325X series page

Technical specification

Silicon & memory
Architecture
CDNA 3
Compute units
304
Memory
256 GB HBM3e
FP8 / FP16
2.6 PFLOPS / 1.3 PFLOPS
Bandwidth
6 TB/s
System & software
Form factor
OAM module
Platform
8 fully connected accelerators
Aggregate memory
Up to 2 TB HBM3e
Software
ROCm ecosystem