Powering the next generation of AI & high-performance computing.
Engineered for large-scale AI training, deep learning, and high-performance workloads, delivering unprecedented compute power and efficiency.
NVIDIA Ada Lovelace Architecture
Next-generation consumer architecture delivering exceptional AI performance with improved power efficiency and advanced compute capabilities.
Fourth-Generation Tensor Cores
Enhanced AI acceleration with 512 Tensor Cores providing significant performance gains for machine learning workloads.
24GB GDDR6X Memory
Massive memory capacity with 1,008GB/s bandwidth enables training and inference on large AI models.
Third-Generation RT Cores
Advanced ray tracing acceleration with 128 RT Cores ideal for AI rendering applications and computer vision tasks.
Performance
Key specs at a glance.
Performance benchmarks that push AI, ML, and HPC workloads further.
Memory Bandwidth
1008
GB/s
FP16 Tensor Performance
165.2
TFLOPS
PCIe Gen5 ×16 Bandwidth
63
GB/s
Use Cases
Popular use cases.
Designed for demanding workloads
—learn if this GPU fits your needs.
Technical Specs
Ready for your most demanding workloads.
Essential technical specifications to help you choose the right GPU for your workload.
Specification
Details
Great for...
Memory Bandwidth
1008
GB/s
Feeding large image batches and high-resolution textures into VRAM without stalls for rendering, LLM inference, and real-time simulations.
Memory Bandwidth
1008
GB/s
Feeding large image batches and high-resolution textures into VRAM without stalls for rendering, LLM inference, and real-time simulations.
FP16 Tensor Performance
165.2
TFLOPS
Speeding mixed-precision transformer training and inference, boosting token throughput in generative AI and deep learning workloads.
FP16 Tensor Performance
165.2
TFLOPS
Speeding mixed-precision transformer training and inference, boosting token throughput in generative AI and deep learning workloads.
PCIe Gen5 ×16 Bandwidth
63
GB/s
Enabling high-speed GPU-to-GPU and host-to-device transfers when NVLink isn’t available, ensuring smooth multi-GPU scaling for large models.
PCIe Gen5 ×16 Bandwidth
63
GB/s
Enabling high-speed GPU-to-GPU and host-to-device transfers when NVLink isn’t available, ensuring smooth multi-GPU scaling for large models.
"The Runpod team has clearly prioritized the developer experience to create an elegant solution that enables individuals to rapidly develop custom AI apps or integrations while also paving the way for organizations to truly deliver on the promise of AI."
Amjad Masad
AI Apps
"Runpod is the only place I can deploy high-end GPU models instantly—no sales calls, no rate limits, no nonsense."
Daniel Chang
Research
“The main value proposition for us was the flexibility Runpod offered. We were able to scale up effortlessly to meet the demand at launch.”
Josh Payne
LLM Inference
“Runpod helped us scale the part of our platform that drives creation. That’s what fuels the rest—image generation, sharing, remixing. It starts with training.”
Matty Shimura
Model Training
Comparison
Powerful GPUs. Globally available. Reliability you can trust.
30+ GPUs, 31 regions, instant scale. Fine-tune or go full Skynet—we’ve got you.
Community Cloud
$
0.34
/hr
N/A
Secure Cloud
$
0.69
/hr
Unique GPU Models
25
19
Unique GPU Models
Secure Cloud
19
Community Cloud
25
Global Regions
17
14
Global Regions
Secure Cloud
14
Community Cloud
17
Network Storage
Network Storage
Secure Cloud
✔️
Community Cloud
✖️
Enterprise-Grade Reliability
Enterprise-Grade Reliability
Secure Cloud
✔️
Community Cloud
✖️
Savings Plans
Savings Plans
Secure Cloud
✔️
Community Cloud
✖️
24/7 Support
24/7 Support
Secure Cloud
✔️
Community Cloud
✔️
Delightful Dev Experience
Delightful Dev Experience
Secure Cloud
✔️
Community Cloud
✔️
