| Product SKU | L40S-48GB |
|---|---|
| FP32 | 91.6 teraFLOPS |
| TF32 Tensor Core | 366 teraFLOPS |
| FP16 | 733 teraFLOPS |
| FP8 | 1,466 teraFLOPS |
| RT Core Performance | 212 teraFLOPS |
| Max Power Consumption | 350W |
| GPU Architecture | NVIDIA Ada Lovelace architecture |
| GPU Memory | 48GB GDDR6 with ECC |
| Memory Bandwidth | 864GB/s |
| Interconnect Interface | PCIe Gen4 x16: 64GB/s bidirectional |
| NVIDIA Ada Lovelace Architecture-Based CUDA® Cores | 18,176 |
| NVIDIA Third-Generation RT Cores | 142 |
| NVIDIA Fourth-Generation Tensor Cores | 568 |
| RT Core Performance TFLOPS | 212 |
| FP32 TFLOPS | 91.6 |
| TF32 Tensor Core TFLOPS | 183 I 366 |
| BFLOAT16 Tensor Core TFLOPS | 362.05 I 733 |
| FP16 Tensor Core | 362.05 I 733 |
| FP8 Tensor Core | 733 I 1,466 |
| Peak INT8 Tensor TOPS Peak INT4 Tensor TOPS | 733 I 1,466* 733 I 1,466 |
| Form Factor | 4.4" (H) x 10.5" (L), dual slot |
| Display Ports | 4x DisplayPort 1.4a |
| Power Connector | 16-pin |
| Thermal | Passive |
| Virtual GPU (vGPU) Software Support | Yes |
| vGPU Profiles Supported | See virtual GPU licensing guide |
| NVENC I NVDEC | 3x l 3x (includes AV1 encode and decode) |
| Secure Boot With Root of Trust | Yes |
| NEBS Ready | Level 3 |
| Multi-Instance GPU (MIG) Support | No |
| NVIDIA® NVLink® Support | No |
Data Center GPUs, GPU Accelerators
NVIDIA L40S 48GB PCIe
The NVIDIA L40S 48GB PCIe is a data-center GPU built on the NVIDIA Ada Lovelace architecture, with 48GB GDDR6 with ECC memory and 864GB/s of memory bandwidth. It combines 1,466 FP8 and 733 FP16 Tensor Core performance with a board power of 350 W in a 4.4″ (H) x 10.5″ (L), dual slot form factor.
Overview
The NVIDIA L40S 48GB PCIe is a data-center GPU built on the NVIDIA Ada Lovelace architecture, with 48GB GDDR6 with ECC memory and 864GB/s of memory bandwidth. It combines 1,466 FP8 and 733 FP16 Tensor Core performance with a board power of 350 W in a 4.4″ (H) x 10.5″ (L), dual slot form factor. Interconnect: PCIe Gen4 x16: 64GB/s bidirectional.
Key Features
- Performance: FP8 Tensor Core: 1,466, FP16 Tensor Core: 733
- Memory: 48GB GDDR6 with ECC memory, 864GB/s bandwidth
- NVIDIA Ada Lovelace architecture, 4.4″ (H) x 10.5″ (L), dual slot form factor, 350 W board power
Applications
- Large language model training, fine-tuning and inference
- HPC and scientific simulation
- Data analytics and recommendation systems
- Virtualised and containerised AI infrastructure
Configuration, availability and lead time depend on the required quantity, server pairing and delivery destination. Send your requirement to receive a quotation.
