Infrastructure atlas
AMD/CDNA 3

Instinct MI300X

A memory-dense OAM accelerator with 192 GB HBM3 and ROCm as its primary software ecosystem.

GPUtraininginferenceHPCROCm
Instinct MI300X hardware

01 / Memory

192 GB HBM3

Per accelerator

02 / Bandwidth

5.3 TB/s

Peak theoretical

03 / Power

750 W

Maximum TBP

Precision & peak compute

PrecisionPublished peakBasis
FP8 matrix2.61 PFLOPSDense
FP8 matrix5.22 PFLOPSStructured sparsity
FP16 / BF16 matrix1.3 PFLOPSDense
INT8 matrix2,615 TOPSDense · per accelerator
FP32 matrix163.4 TFLOPSDense
FP64 matrix163.4 TFLOPSDense

Peak FLOPS and TOPS are theoretical hardware figures. Sparse and dense modes, chip and system totals, and form factors are not interchangeable.

AMD Instinct MI300X specifications

Technical specification

Silicon & memory
Architecture
CDNA 3
Process
TSMC 5 nm / 6 nm FinFET
Compute
304 CUs · 1,216 Matrix Cores
FP8
2.61 PFLOPS dense · 5.22 PFLOPS sparse
Memory
192 GB HBM3 · 8,192-bit
System & software
Form factor
OAM module
Scale-up
7 Infinity Fabric links
Host I/O
PCIe Gen 5 x16
Software
ROCm, HIP, RCCL, MIOpen