| Product SKU | MI300X-192GB |
|---|---|
| Name | AMD Instinct™ MI300X |
| Family | Instinct |
| Series | Instinct MI300 Series |
| Form Factor | Servers |
| Launch Date | 12/06/2023 |
| GPU Architecture | CDNA3 |
| Lithography | TSMC 5nm, 6nm FinFET |
| Stream Processors | 19,456 |
| Matrix Cores | 1216 |
| Compute Units | 304 |
| Peak Engine Clock | 2100 MHz |
| Peak Eight-bit Precision (FP8) Performance (E5M2, E4M3) | 2.61 PFLOPs |
| Peak Eight-bit Precision (FP8) Performance with Structured Sparsity (E5M2, E4M3) | 5.22 PFLOPs |
| Peak Half Precision (FP16) Performance | 1.3 PFLOPs |
| Peak Half Precision (FP16) Performance with Structured Sparsity | 2.61 PFLOPs |
| Peak Single Precision (TF32 Matrix) Performance | 653.7 TFLOPs |
| Peak Single Precision (TF32) Performance with Structured Sparsity | 1.3 PFLOPs |
| Peak Single Precision Matrix (FP32) Performance | 163.4 TFLOPs |
| Peak Single Precision (FP32) Performance | 163.4 TFLOPs |
| Peak Double Precision Matrix (FP64) Performance | 163.4 TFLOPs |
| Peak Double Precision (FP64) Performance | 81.7 TFLOPs |
| Peak INT8 Performance | 2.6 POPs |
| Peak INT8 Performance with Structured Sparsity | 5.22 POPs |
| Peak bfloat16 | 1.3 PFLOPs |
| Peak bfloat16 with Strutured Sparsity | 2.61 PFLOPs |
| Transistor Count | 153 Billion |
| External Power Connectors | 54V UBB |
| Typical Board Power (TBP) | 750W Peak |
| Last Level Cache (LLC) | 256 MB |
| Dedicated Memory Size | 192 GB |
| Dedicated Memory Type | HBM3 |
| Infinity Cache | Yes |
| Memory Interface | 8192-bit |
| Memory Clock | 5.2 GHz |
| Peak Memory Bandwidth | 5.3 TB/s |
| Memory ECC Support | Yes (Full-Chip) |
| GPU Form Factor | OAM Module |
| Bus Type | PCIe® 5.0 x16 |
| Infinity Fabric™ Links | 8 |
| Peak Infinity Fabric™ Link Bandwidth | 128 GB/s |
| Cooling | Passive OAM |
| Supported Technologies | AMD CDNA™ 3 Architecture , AMD ROCm™ – Ecosystem without Borders , AMD Infinity Architecture |
| RAS Support | Yes |
| Page Retirement | Yes |
| Page Avoidance | Yes |
| SR-IOV | Yes |
GPU Accelerators
AMD Instinct MI300X 192GB
The AMD Instinct MI300X 192GB is a data-center accelerator built on the CDNA3 architecture, with 192 GB HBM3 of memory and 5.3 TB/s of memory bandwidth. It combines 2.61 PFLOPs FP8 and 1.3 PFLOPs FP16 Tensor Core performance with a board power of 750 W peak in a Servers form factor.
Overview
The AMD Instinct MI300X 192GB is a data-center accelerator built on the CDNA3 architecture, with 192 GB HBM3 of memory and 5.3 TB/s of memory bandwidth. It combines 2.61 PFLOPs FP8 and 1.3 PFLOPs FP16 Tensor Core performance with a board power of 750 W peak in a Servers form factor. Interconnect: PCIe® 5.0 x16, 8 Infinity Fabric links.
Key Features
- Performance: FP8 Tensor Core: 2.61 PFLOPs, FP16 Tensor Core: 1.3 PFLOPs
- Memory: 192 GB HBM3 of memory, 5.3 TB/s bandwidth
- CDNA3 architecture, Servers form factor, 750 W peak board power
Applications
- Large language model training, fine-tuning and inference
- HPC and scientific simulation
- Data analytics and recommendation systems
- Virtualised and containerised AI infrastructure
Configuration, availability and lead time depend on the required quantity, server pairing and delivery destination. Send your requirement to receive a quotation.
