We raised a Series A! Read a post from our CEO, Zhen Lu: 1M devs and the cloud we're building next.

Rent NVIDIA L40 GPUs from $0.82/hr

High-performance data center GPU with 48 GB GDDR6 memory and Ada Lovelace architecture, designed for AI inference, 3D rendering, and virtualization workloads with 300W power consumption in a dual-slot form factor.

L40

Powering the next generation of AI & high-performance computing.

Engineered for large-scale AI training, deep learning, and high-performance workloads, delivering unprecedented compute power and efficiency.

NVIDIA Ada Lovelace Architecture

Revolutionary neural graphics architecture delivering unprecedented visual computing performance with advanced AI capabilities.

Fourth-Generation Tensor Cores

Enhanced AI acceleration delivering over 1 petaFLOP of inference performance for deep learning workloads.

48GB GDDR6 Memory

Industry-leading memory capacity enables handling of large AI models and complex 3D scenes.

Third-Generation RT Cores

Advanced ray tracing acceleration with 2X faster real-time performance for photorealistic rendering workflows.

Why rent the L40 instead of buying?

Data center AI performance at a strong price point

The L40's Ada Lovelace architecture combines fourth-generation Tensor Cores with third-generation RT Cores — making it uniquely capable of both AI compute and professional rendering in a single GPU. It delivers 5× higher image generative AI inference performance versus the previous generation, making it a top choice for diffusion model pipelines, LLM fine-tuning, and visualization workloads.

Pay only for what you use

Purchasing an L40 costs upwards of $7,000–$10,000 per card. Runpod's on-demand pricing lets you access the same hardware with no capital commitment, no maintenance overhead, no depreciation.

Deploy in seconds, scale or switch when you're ready

Provision an L40 instance in seconds. Scale up for training runs, scale down for development, or switch to a higher-tier GPU without changing providers. Runpod handles the infrastructure so your team focuses on the work.

Key specs at a glance.

Performance benchmarks that push AI, ML, and HPC workloads further.

Memory Bandwidth

864

GB/s

FP16 Tensor Performance

181

TFLOPS

PCIe Gen4 ×16 Bandwidth

63

GB/s

Popular use cases.

Designed for demanding workloads
—learn if this GPU fits your needs.

Inference workload illustration

Inference

Serve inference for image, text, and audio generation at any scale.

Fine-tuning workload illustration

Fine-tuning

Train custom models on
your specific datasets.

AI agents workload illustration

Agents

Build intelligent agent-based systems and workflows.

Compute-heavy workload illustration

Compute-heavy tasks

Run compute-heavy workloads like rendering and simulations.

Ready for your most
demanding workloads.

Essential technical specifications to help you choose the right GPU for your workload.

Specification
Details
Great for...
Memory Bandwidth
864 GB/s
Feeding massive multimodal and high-resolution image and LLM inference workloads without memory stalls.
FP16 Tensor Performance
181 TFLOPS
Accelerating mixed-precision transformer and convolution operations in generative AI and graphics workloads.
PCIe Gen4 ×16 Bandwidth
63 GB/s
Enabling high-speed GPU-to-GPU and host-to-device transfers when NVLink isn't available, ensuring smooth multi-GPU scaling for training and inference.
Specification Details Great for...
Architecture NVIDIA Ada Lovelace (AD102) AI workloads requiring the latest generation of Tensor Core and RT Core acceleration in a single card
CUDA Cores 18,176 High-parallelism tasks including image generation, video AI, and large-batch inference
Tensor Cores 568 (4th generation) FP8-accelerated inference and mixed-precision transformer training for generative AI workloads
RT Cores 142 (3rd generation) Real-time ray tracing for visualization, VR/AR, virtual production, and photorealistic rendering pipelines
GPU Memory 48 GB GDDR6 ECC Loading large model weights and running simultaneous fine-tuning and inference workloads without swapping
Memory Bus Width 384-bit Sustained high bandwidth for large-context LLM inference and real-time rendering
Base / Boost Clock 735 / 2,490 MHz Sustained throughput for long training runs and peak responsiveness for latency-sensitive inference
FP32 Performance 90.5 TFLOPS Standard-precision training, fine-tuning, and scientific compute workloads
RT Core Performance 209 TFLOPS Photorealistic rendering, virtual production, and 3D visualization pipelines
TDP 300W Predictable power budgeting for multi-GPU rack deployments
MIG Support Not supported
NVLink Not supported
Form Factor FHFL, dual-slot Deploying in standard data center server infrastructure
"The Runpod team has clearly prioritized the developer experience to create an elegant solution that enables individuals to rapidly develop custom AI apps or integrations while also paving the way for organizations to truly deliver on the promise of AI."

Amjad Masad

"Runpod is the only place I can deploy high-end GPU models instantly—no sales calls, no rate limits, no nonsense."

Daniel Chang

“The main value proposition for us was the flexibility Runpod offered. We were able to scale up effortlessly to meet the demand at launch.”

Josh Payne

“Runpod helped us scale the part of our platform that drives creation. That’s what fuels the rest—image generation, sharing, remixing. It starts with training.”

Matty Shimura

Powerful GPUs. Globally available.
Reliability you can trust.

30+ GPUs, 31 regions, instant scale. Fine-tune or go full Skynet—we’ve got you.

Community Cloud
$0.69/hr
Secure Cloud
$0.82/hr
Unique GPU Models
Community Cloud
25
Secure Cloud
19
Global Regions
Community Cloud
17
Secure Cloud
14
Network Storage
Community Cloud
Secure Cloud
Enterprise-Grade Reliability
Community Cloud
Secure Cloud
Savings Plans
Community Cloud
Secure Cloud
24/7 Support
Community Cloud
Secure Cloud
Delightful Dev Experience
Community Cloud
Secure Cloud

Questions? Answers.

What are the current hourly rates for renting an L40 on Runpod?

Rates vary by availability. For the most current pricing, see the Runpod pricing page.

What's the difference between the L40 and L40S?

The L40 and L40S are distinct GPUs with different specs. The L40 has a 300W TDP and is optimized for mixed AI compute and professional graphics workloads. The L40S has a 350W TDP, higher AI tensor throughput, and is better suited to pure inference at scale. See the Runpod pricing page to compare current availability and rates for both.

Is the L40 good for generative AI workloads like image generation?


The L40 was specifically designed with image generative AI in mind, delivering 5× higher inference performance vs the previous generation. Its combination of fourth-generation Tensor Cores and third-generation RT Cores makes it particularly effective for Stable Diffusion, ControlNet, and similar pipelines.

Does the L40 support MIG or NVLink?


The L40 does not support Multi-Instance GPU (MIG) partitioning or NVLink. Multi-GPU communication is handled via PCIe. If MIG or high-bandwidth GPU-to-GPU interconnect is required for your workload, the A100 or H100 SXM are better fits.

When does renting an L40 make more sense than buying?


Renting is the better choice for project-based workloads, teams without capital for hardware, organizations scaling AI development, and anyone testing configurations before committing. Buying makes sense only with sustained, predictable full-utilization over a long horizon. For current rates to inform your decision, see the Runpod pricing page.

10,100,100,100

Requests since launch & 1M+ developers worldwide

Build what’s next.

Build, train, and scale AI workloads on Runpod with cloud GPUs, Serverless, and Clusters.