Infrastructure atlas
NVIDIA/CPU + GPU superchip
GH200 Grace Hopper
A coherent Grace CPU plus Hopper GPU package that exposes CPU memory as an extension of the GPU memory system.
ASICGraceHoppercoherent memoryNVLink

Precision & peak compute
| Precision | Published peak | Basis |
|---|---|---|
| FP8 Tensor | 3,958 TFLOPS | Hopper GPU · with sparsity |
| FP16 / BF16 Tensor | 1,979 TFLOPS | Hopper GPU · with sparsity |
Peak FLOPS and TOPS are theoretical hardware figures. Sparse and dense modes, chip and system totals, and form factors are not interchangeable.
NVIDIA Grace Hopper specifications