| Product SKU | L4-24GB |
|---|---|
| FP32 | 30.3 teraFLOPs |
| TF32 Tensor Core | 120 teraFLOPS |
| FP16 Tensor Core | 242 teraFLOPS |
| BFLOAT16 Tensor Core | 242 teraFLOPS |
| FP8 Tensor Core | 485 teraFLOPs |
| INT8 Tensor Core | 485 TOPs |
| GPU memory | 24GB |
| GPU memory bandwidth | 300GB/s |
| NVENC | NVDEC | JPEG decoders | 2, 4, 4 |
| Max thermal design power (TDP) | 72W |
| Form factor | 1-slot low-profile, PCIe |
| Interconnect | PCIe Gen4 x16 64GB/s |
| Server options | Partner and NVIDIA-Certified Systems with 1–8 GPUs |
Data Center GPUs, GPU Accelerators
NVIDIA L4 24GB PCIe
The NVIDIA L4 24GB PCIe is a data-center GPU, with 24GB of memory and 300GB/s of memory bandwidth. It combines 485 teraFLOPs FP8 and 242 teraFLOPS FP16 Tensor Core performance with a board power of 72 W in an L4 form factor.
Overview
The NVIDIA L4 24GB PCIe is a data-center GPU, with 24GB of memory and 300GB/s of memory bandwidth. It combines 485 teraFLOPs FP8 and 242 teraFLOPS FP16 Tensor Core performance with a board power of 72 W in an L4 form factor. Interconnect: PCIe Gen4 x16 64GB/s.
Key Features
- Performance: FP8 Tensor Core: 485 teraFLOPs, FP16 Tensor Core: 242 teraFLOPS
- Memory: 24GB of memory, 300GB/s bandwidth
- L4 form factor, 72 W board power
Applications
- Large language model training, fine-tuning and inference
- HPC and scientific simulation
- Data analytics and recommendation systems
- Virtualised and containerised AI infrastructure
Configuration, availability and lead time depend on the required quantity, server pairing and delivery destination. Send your requirement to receive a quotation.
