NVIDIA L40S
NVIDIA L40S
Experience breakthrough multi-workload performance with the NVIDIA L40S GPU. Combining powerful AI compute with best-in-class graphics and media acceleration, the L40S GPU is built to power the next generation of data center workloads—from generative AI and large language model (LLM) inference and training to 3D graphics, rendering, and video.
Powered by the NVIDIA Ada Lovelace Architecture
Generative AI is fueling transformative change, unlocking a new frontier of opportunities for enterprises across every industry. To transform with AI, enterprises need more compute resources, greater scale, and a broad set of capabilities to meet the demands of an ever-increasing set of diverse and complex workloads.
The NVIDIA L40S GPU is the most powerful universal GPU for the data center, delivering end-to-end acceleration for the next generation of AI-enabled applications—from generative AI and model training and inference to 3D graphics, rendering, and video applications.
Accelerate Next-Generation Workloads
Generative AI
Large language model (LLM) training and inference
NVIDIA Omniverse Enterprise
Rendering and 3D graphics
Streaming and video content
Technical specifications
| Technical Specifications | |
|---|---|
| GPU Architecture | NVIDIA Ada Lovelace Architecture |
| GPU Memory | 48GB GDDR6 with ECC |
| Memory Bandwidth | 864GB/s |
| Interconnect Interface | PCIe Gen4 x16: 64GB/s bidirectional |
| NVIDIA Ada Lovelace Architecture-Based CUDA Cores | 18,176 |
| NVIDIA Third-Generation RT Cores | 142 |
| NVIDIA Fourth-Generation Tensor Cores | 568 |
| RT Core Performance TFLOPS | 209 |
| FP32 TFLOPS | 91.6 |
| TF32 Tensor Core TFLOPS | 183 I 366* |
| BFLOAT16 Tensor Core TFLOPS | 362.05 I 733* |
| FP16 Tensor Core | 362.05 I 733* |
| FP8 Tensor Core | 733 I 1 466* |
| Peak INT8 Tensor TOPS | 733 I 1 466* |
| Peak INT4 Tensor TOPS | 733 I 1 466* |
| Form Factor | 4.4" (H) x 10.5" (L), dual slot |
| Display Ports | 4x DisplayPort 1.4a |
| Max Power Consumption | 350W |
| Power Connector | 16-pin |
| Thermal | Passive |
| Virtual GPU (vGPU) Software Support | Yes |
| vGPU Profiles Supported | See the virtual GPU licensing guide |
| NVENC | NVDEC | 3x l 3x (includes AV1 encode and decode) |
| Secure Boot With Root of Trust | Yes |
| NEBS Ready | Level 3 |
| MIG Support | No |
| NVIDIA NVLink Support | No |
Benchmarks
// Still not sure what is the best GPU for you? We are ready to assist you.
