Instinct MI325X

AMDdatacenter
Overview
ArchitectureCDNA 3 (2024)
Launch date2024-10-10
Process nodeTSMC 5nm | 6nm FinFET
Transistor count153B
GPU target (gfx)gfx942
Memory
VRAM256 GB HBM3E
Memory bandwidth6,000 GB/s
Cache256 MB
ECCYes
Compute — vector
FP6481.7 TFLOPS
FP32163.4 TFLOPS
Compute — matrix / tensor
FP64163.4 TFLOPS
TF32653.7 TFLOPS
BF161,307.4 TFLOPS
FP16 (dense / sparse)1,307.4 / 2,614.9 TFLOPS
FP8 (dense / sparse)2,614.9 / 5,229.8 TFLOPS
INT8 (dense / sparse)2,600 / 5,220 TOPS
Cores & clocks
Compute Units304
Shader cores19,456
Matrix / Tensor cores1,216
Peak clock2,100 MHz
Board & system
TDP1000 W
Form factorOAM Module
CoolingPassive OAM
PCIePCIe 5.0 x16
InterconnectInfinity Fabric — 128 GB/s
Multi-instance supportSR-IOV

Compatible ROCm versions

6.0.06.0.26.1.06.1.16.1.26.1.56.2.06.2.16.2.26.2.46.3.06.3.16.3.26.3.36.4.06.4.16.4.26.4.37.0.07.0.17.0.27.1.07.1.17.2.07.2.17.2.27.2.37.2.47.14.010.0.0
Same CDNA3 compute die as MI300X (identical compute-unit/matrix-core counts and dense TFLOPS figures) — MI325X is a memory upgrade (192GB→256GB, HBM3→HBM3E, 5.3TB/s→6TB/s bandwidth) at a higher power envelope (1,000W vs. 750W). Source: AMD's official product/spec page (amd.com/en/products/accelerators/instinct/mi300/mi325x.html, "Expand All" spec accordion), pulled 2026-09-01. All compute-throughput fields (fp64/fp32/tf32/bf16/fp16/fp8/int8 and their Matrix/Sparse variants) mirror MI300X's file exactly — same sourcing caveats apply: fp16TFLOPS/fp8TFLOPS keep this collection's brochure-precision decimals (1,307.4/2,614.9, sparse 2,614.9/5,229.8) over the page's rounded PFLOP figures; fp64 vector (81.7) and matrix (163.4) genuinely differ 2x on this die; tf32TFLOPS (653.7, dense) has an unmodeled ~2x sparse variant; bf16TFLOPS is set equal to fp16TFLOPS per the page's identical PFLOP figures; int8TOPS/int8TOPSSparse (2,600/5,220 POPs) are page-native precision only. tdpWatts (1000) is labelled "Typical Board Power (TBP)" on the page but the value itself reads "1000W Peak". No msrpUSD — AMD doesn't publish Instinct list prices.

← All GPUs · Compare GPUs →