// The Most Powerful Universal GPU


Experience breakthrough multi-workload performance with the NVIDIA L40S GPU. Combining powerful AI compute with best-in-class graphics and media acceleration, the L40S GPU is built to power the next generation of data center workloads—from generative AI and large language model (LLM) inference and training to 3D graphics, rendering, and video.

// For every workload

Powered by the NVIDIA Ada Lovelace Architecture

Generative AI is fueling transformative change, unlocking a new frontier of opportunities for enterprises across every industry. To transform with AI, enterprises need more compute resources, greater scale, and a broad set of capabilities to meet the demands of an ever-increasing set of diverse and complex workloads.

The NVIDIA L40S GPU is the most powerful universal GPU for the data center, delivering end-to-end acceleration for the next generation of AI-enabled applications—from generative AI and model training and inference to 3D graphics, rendering, and video applications.

Accelerate Next-Generation Workloads

  • Generative AI
  • Large language model (LLM) training and inference
  • NVIDIA Omniverse Enterprise
  • Rendering and 3D graphics
  • Streaming and video content

GPU Memory


Single-Precision Performance


AI Tensor Performance (FP8)

// Specification

Technical specifications

Technical Specifications
GPU Architecture NVIDIA Ada Lovelace Architecture
GPU Memory 48GB GDDR6 with ECC
Memory Bandwidth 864GB/s
Interconnect Interface PCIe Gen4 x16: 64GB/s bidirectional
NVIDIA Ada Lovelace Architecture-Based CUDA Cores18,176
NVIDIA Third-Generation RT Cores142
NVIDIA Fourth-Generation Tensor Cores568
RT Core Performance TFLOPS209
FP32 TFLOPS 91.6
TF32 Tensor Core TFLOPS 183 I 366*
BFLOAT16 Tensor Core TFLOPS 362.05 I 733*
FP16 Tensor Core 362.05 I 733*
FP8 Tensor Core 733 I 1 466*
Peak INT8 Tensor TOPS 733 I 1 466*
Peak INT4 Tensor TOPS 733 I 1 466*
Form Factor 4.4" (H) x 10.5" (L), dual slot
Display Ports 4x DisplayPort 1.4a
Max Power Consumption 350W
Power Connector 16-pin
Thermal Passive
Virtual GPU (vGPU) Software Support Yes
vGPU Profiles SupportedSee the virtual GPU licensing guide
NVENC | NVDEC 3x l 3x (includes AV1 encode and decode)
Secure Boot With Root of Trust Yes
NEBS Ready Level 3
MIG Support No
NVIDIA NVLink Support No
* With sparsity
// Performance


// Still not sure what is the best GPU for you? We are ready to assist you.