News icon

Kimi K3 is now available on Runpod

ReportFall 2026

State of AI Compute

Insights from the latest data around AI deployment, infrastructure demand, and model scaling trends.

Cover of the Fall 2026 State of AI Compute report

Get the full report

What’s inside

VRAM tier by workload type

0%10%20%30%40%50%38.424.736.9FINE-TUNING37.133.829.1SERVING ONLY31.544.124.4INFERENCE35.440.324.3TRAINING49.834.515.7BATCH PROCESSING<24 GB25-48 GB80 GB+

Usage share among top audio models

0%20%40%60%80%NOVDECJANFEBMARAPRMAYJUNJULWHISPER62.7%OTHER TTS26.0%PYANNOTE10.3%QWEN AUDIO7.4%

Doubling the fleets by early December

1.0X1.2X1.5X1.8X2.0X2.2X2.5X2.8XH200 SXM2.5X TODAY’S FLEETB2002.1X TODAY’S FLEETH100 SXM1.5X TODAY’S FLEETRTX PRO 60001.3X TODAY’S FLEET