Hot starts, batch inference, and what's next for Runpod Serverless. Webinar June 25.

Cloud GPUs

Rent NVIDIA B300 GPUs from $7.39/hr

Next-generation data center GPU based on NVIDIA Blackwell Ultra architecture with 288 GB HBM3e memory, delivering 1.5x FP4 performance and 2x attention performance over the B200 for AI reasoning and real-time inference workloads.

B300

Powering the next generation of AI & high-performance computing.

Engineered for large-scale AI training, deep learning, and high-performance workloads, delivering unprecedented compute power and efficiency.

NVIDIA Blackwell Ultra Architecture

Next-generation architecture delivering 1.5x FP4 performance and 2x attention performance compared to Blackwell B200, designed for the era of AI reasoning.

Enhanced Transformer Engine

Advanced Tensor Core technology with FP4 precision support for maximum inference throughput on reasoning models and large-scale LLMs.

288 GB HBM3e Memory

Massive memory capacity enables training and inference on the largest frontier AI models without memory constraints or model sharding.

Fifth-Generation NVLink

1.8 TB/s GPU-to-GPU interconnect allows seamless scaling across multiple GPUs for distributed AI workloads at enterprise scale.

Performance

Key specs at a glance.

Performance benchmarks that push AI, ML, and HPC workloads further.

Memory Bandwidth

7.75

TB/s

FP8 Tensor Performance

9

PFLOPS

NVLink Bandwidth

1.8

TB/s

Use Cases

Popular use cases.

Designed for demanding workloads
—learn if this GPU fits your needs.

Inference workload illustration

Inference

Serve inference for image, text, and audio generation at any scale.

Inference
Fine-tuning workload illustration

Fine-tuning

Train custom models on
your specific datasets.

Fine-tuning
AI agents workload illustration

Agents

Build intelligent agent-based systems and workflows.

Agents
Compute-heavy workload illustration

Compute-heavy tasks

Run compute-heavy workloads like rendering and simulations.

Compute-heavy tasks

Technical Specs

Ready for your most
demanding workloads.

Essential technical specifications to help you choose the right GPU for your workload.

Specification
Details
Great for...
Memory Bandwidth
7.75 TB/s
Delivering large model weights and high-throughput datasets into GPU memory without stalls for AI reasoning and real-time LLM inference at scale.
FP8 Tensor Performance
9 PFLOPS
Accelerating mixed-precision transformer training and inference, with 1.5x FP4 throughput improvement over the previous Blackwell generation.
NVLink Bandwidth
1.8 TB/s
Enabling fast GPU-to-GPU communication for large-scale multi-GPU distributed AI workloads and model parallelism without PCIe bottlenecks.
AI Apps
Research
LLM Inference
Model Training
"The Runpod team has clearly prioritized the developer experience to create an elegant solution that enables individuals to rapidly develop custom AI apps or integrations while also paving the way for organizations to truly deliver on the promise of AI."

Amjad Masad

"Runpod is the only place I can deploy high-end GPU models instantly—no sales calls, no rate limits, no nonsense."

Daniel Chang

“The main value proposition for us was the flexibility Runpod offered. We were able to scale up effortlessly to meet the demand at launch.”

Josh Payne

“Runpod helped us scale the part of our platform that drives creation. That’s what fuels the rest—image generation, sharing, remixing. It starts with training.”

Matty Shimura

Comparison

Powerful GPUs. Globally available.
Reliability you can trust.

30+ GPUs, 31 regions, instant scale. Fine-tune or go full Skynet—we’ve got you.

Community Cloud
$7.39/hr
Secure Cloud
$7.39/hr
Unique GPU Models
Community Cloud
25
Secure Cloud
19
Global Regions
Community Cloud
17
Secure Cloud
14
Network Storage
Community Cloud
Secure Cloud
Enterprise-Grade Reliability
Community Cloud
Secure Cloud
Savings Plans
Community Cloud
Secure Cloud
24/7 Support
Community Cloud
Secure Cloud
Delightful Dev Experience
Community Cloud
Secure Cloud

10,100,100,100

Requests since launch & 400k developers worldwide

Build what’s next.

Build, train, and scale AI workloads on Runpod with cloud GPUs, Serverless, and Clusters.