News icon

We raised a Series A! Read a post from our CEO, Zhen Lu: 1M devs and the cloud we're building next.

Runpod AI Infrastructure Blog

Runpod product updates, AI infrastructure guides, GPU tutorials, and deployment patterns for developers building with cloud GPUs.

Thank you! Your submission has been received!
Oops! Something went wrong while submitting the form.
Purple glow background
16k Context LLM Models Now Available On Runpod
Brendan McKeag
July 19, 2023

16k Context LLM Models Now Available On Runpod

Runpod now supports Panchovix's 16k-token context models, allowing for much deeper context retention in long-form generation. These models require higher.

Product Updates
All
How to Use 65B+ Language Models on Runpod
Brendan McKeag
July 10, 2023

How to Use 65B+ Language Models on Runpod

Large language models like Guanaco 65B can run on Runpod with the right optimizations. Learn how to handle quantization, memory, and GPU sizing.

AI Infrastructure
All
Worker | Local API Server Introduced with runpod-python 0.10.0
Justin Merrell
July 1, 2023

Worker | Local API Server Introduced with runpod-python 0.10.0

Starting with runpod-python 0.10.0, you can launch a local API server for testing your worker handler using --rp_serve_api. This feature improves the.

Product Updates
All
VS Code Server | Local-Quality Development Experience
Justin Merrell
June 30, 2023

VS Code Server | Local-Quality Development Experience

Use the VS Code Server template on Runpod to connect your local VS Code editor to a GPU-powered development pod, offering a seamless remote dev experience.

Product Updates
All
VS Code Server on Runpod: Local-Quality Remote Development
Justin Merrell
June 30, 2023

VS Code Server on Runpod: Local-Quality Remote Development

Unlock seamless coding with the VS Code Server template on Runpod. Learn how to connect, code, and iterate remotely with local-like speed and responsiveness.

AI Infrastructure
All
Poddy mascot displayed as a retro TV with static, indicating no results found
We couldn't find anything. Try a different search.

Build what’s next.

Build, train, and scale AI workloads on Runpod with cloud GPUs, Serverless, and Clusters.

Star field background