| Product SKU | H100-SXM5-80GB |
|---|---|
| FP64 | 34 teraFLOPS |
| FP64 Tensor Core | 67 teraFLOPS |
| FP32 | 67 teraFLOPS |
| TF32 Tensor Core * | 989 teraFLOPS |
| BFLOAT16 Tensor Core * | 1,979 teraFLOPS |
| FP16 Tensor Core * | 1,979 teraFLOPS |
| FP8 Tensor Core * | 3,958 teraFLOPS |
| INT8 Tensor Core * | 3,958 TOPS |
| GPU Memory | 80GB |
| GPU Memory Bandwidth | 3.35TB/s |
| Decoders | 7 NVDEC 7 JPEG |
| Max Thermal Design Power (TDP) | Up to 700W (configurable) |
| Multi-Instance GPUs | Up to 7 MIGS @ 10GB each |
| Form Factor | SXM |
| Interconnect | NVIDIA NVLink™: 900GB/s PCIe Gen5: 128GB/s |
| Server Options | NVIDIA HGX H100 Partner and NVIDIA- Certified Systems ™ with 4 or 8 GPUs NVIDIA DGX H100 with 8 GPUs |
| NVIDIA AI Enterprise | Add-on |
Data Center GPUs, GPU Accelerators
NVIDIA H100 SXM5 80GB
The NVIDIA H100 SXM5 80GB is a data-center GPU, with 80GB of memory and 3.35TB/s of memory bandwidth. It combines 3,958 teraFLOPS FP8 and 1,979 teraFLOPS FP16 Tensor Core performance with a board power of up to 700 W (configurable) in a SXM form factor.
Overview
The NVIDIA H100 SXM5 80GB is a data-center GPU, with 80GB of memory and 3.35TB/s of memory bandwidth. It combines 3,958 teraFLOPS FP8 and 1,979 teraFLOPS FP16 Tensor Core performance with a board power of up to 700 W (configurable) in a SXM form factor. Interconnect: NVIDIA NVLink™: 900GB/s PCIe Gen5: 128GB/s.
Key Features
- Performance: FP8 Tensor Core: 3,958 teraFLOPS, FP16 Tensor Core: 1,979 teraFLOPS
- Memory: 80GB of memory, 3.35TB/s bandwidth
- SXM form factor, up to 700 W (configurable) board power
Applications
- Large language model training, fine-tuning and inference
- HPC and scientific simulation
- Data analytics and recommendation systems
- Virtualised and containerised AI infrastructure
Configuration, availability and lead time depend on the required quantity, server pairing and delivery destination. Send your requirement to receive a quotation.
