| Product SKU | H100-NVL-94GB |
|---|---|
| FP64 | 30 teraFLOPs |
| FP64 Tensor Core | 60 teraFLOPs |
| FP32 | 60 teraFLOPs |
| TF32 Tensor Core * | 835 teraFLOPs |
| BFLOAT16 Tensor Core * | 1,671 teraFLOPS |
| FP16 Tensor Core * | 1,671 teraFLOPS |
| FP8 Tensor Core * | 3,341 teraFLOPS |
| INT8 Tensor Core * | 3,341 TOPS |
| GPU Memory | 94GB |
| GPU Memory Bandwidth | 3.9TB/s |
| Decoders | 7 NVDEC 7 JPEG |
| Max Thermal Design Power (TDP) | 350-400W (configurable) |
| Multi-Instance GPUs | Up to 7 MIGS @ 12GB each |
| Form Factor | PCIe dual-slot air-cooled |
| Interconnect | NVIDIA NVLink: 600GB/s PCIe Gen5: 128GB/s |
| Server Options | Partner and NVIDIA-Certified Systems with 1–8 GPUs |
| NVIDIA AI Enterprise | Included |
Data Center GPUs, GPU Accelerators
NVIDIA H100 NVL 94GB
The NVIDIA H100 NVL 94GB is a data-center GPU, with 94GB of memory and 3.9TB/s of memory bandwidth. It combines 3,341 teraFLOPS FP8 and 1,671 teraFLOPS FP16 Tensor Core performance with a board power of 350-400 W (configurable) in a PCIe dual-slot air-cooled form factor.
Overview
The NVIDIA H100 NVL 94GB is a data-center GPU, with 94GB of memory and 3.9TB/s of memory bandwidth. It combines 3,341 teraFLOPS FP8 and 1,671 teraFLOPS FP16 Tensor Core performance with a board power of 350-400 W (configurable) in a PCIe dual-slot air-cooled form factor. Interconnect: NVIDIA NVLink: 600GB/s PCIe Gen5: 128GB/s.
Key Features
- Performance: FP8 Tensor Core: 3,341 teraFLOPS, FP16 Tensor Core: 1,671 teraFLOPS
- Memory: 94GB of memory, 3.9TB/s bandwidth
- PCIe dual-slot air-cooled form factor, 350-400 W (configurable) board power
Applications
- Large language model training, fine-tuning and inference
- HPC and scientific simulation
- Data analytics and recommendation systems
- Virtualised and containerised AI infrastructure
Configuration, availability and lead time depend on the required quantity, server pairing and delivery destination. Send your requirement to receive a quotation.
