,

NVIDIA L4 24GB PCIe

The NVIDIA L4 24GB PCIe is a data-center GPU, with 24GB of memory and 300GB/s of memory bandwidth. It combines 485 teraFLOPs FP8 and 242 teraFLOPS FP16 Tensor Core performance with a board power of 72 W in an L4 form factor.

SKU: L4-24GB Categories: , Brand:
Product SKU

L4-24GB

FP32

30.3 teraFLOPs

TF32 Tensor Core

120 teraFLOPS

FP16 Tensor Core

242 teraFLOPS

BFLOAT16 Tensor Core

242 teraFLOPS

FP8 Tensor Core

485 teraFLOPs

INT8 Tensor Core

485 TOPs

GPU memory

24GB

GPU memory bandwidth

300GB/s

NVENC | NVDEC | JPEG decoders

2, 4, 4

Max thermal design power (TDP)

72W

Form factor

1-slot low-profile, PCIe

Interconnect

PCIe Gen4 x16 64GB/s

Server options

Partner and NVIDIA-Certified Systems with 1–8 GPUs

Overview

The NVIDIA L4 24GB PCIe is a compact, low-profile data-center GPU for AI inference, video and graphics, drawing only 72 W in a single-slot form factor. It is fitted with 24 GB of memory at 300 GB/s and a media engine of 2x NVENC, 4x NVDEC and 4x JPEG decoders, making it a common choice for dense, power-constrained inference and video servers.

At a glance

  • GPU memory: 24 GB at 300 GB/s
  • Performance: FP32 30.3 TFLOPS; TF32 Tensor Core 120 TFLOPS; FP16/BF16 Tensor Core 242 TFLOPS; FP8 Tensor Core 485 TFLOPS; INT8 485 TOPS
  • Media: 2x NVENC, 4x NVDEC, 4x JPEG decoders
  • Max TDP: 72 W; form factor: 1-slot low-profile, PCIe
  • Interconnect: PCIe Gen4 x16 (64 GB/s)
  • Server options: partner and NVIDIA-certified systems with 1–8 GPUs

When to choose the L4

The L4 is the fit where many low-power GPUs must be packed into a standard server: AI inference, video transcoding and analytics, and virtual desktop or graphics acceleration, at 72 W and a single low-profile slot. Its 24 GB of memory and strong decoder count make it efficient for video-heavy workloads.

Platform & compatibility

The L4 is a single-slot, low-profile PCIe Gen4 x16 card with a 72 W TDP and no auxiliary power requirement, deployable in partner and NVIDIA-certified systems with 1–8 GPUs.

FAQ

How much memory does it have? 24 GB at 300 GB/s.

How much power does it draw? 72 W maximum, in a single low-profile slot.

Is it good for video? Yes — 2x NVENC, 4x NVDEC and 4x JPEG decoders.

Related

Configuration, availability and lead time depend on the required quantity, server pairing and delivery destination. Send your requirement to receive a quotation.

Scroll to Top