Brendan McKeag

DeepSeek R1 remains one of the top open-source models. This post shows how you can run it efficiently on just 480GB of VRAM without sacrificing performance.

RunPod now supports Axolotl out of the box—making it easier than ever to fine-tune large language models without complex setup.

Wondering when to use RunPod’s built-in proxy system for pod access? This guide breaks down its use cases, limitations, and when direct connection is a better choice.

Deploy large language models like LLaMA or Mixtral on RunPod Serverless with strong privacy controls and no infrastructure headaches. Here’s how.

Nemotron 70B is NVIDIA’s latest open model and it’s climbing the leaderboards. But how does it perform in the real world—and can it solve your toughest inference challenges?

Stability.ai’s SD3.5 is here—with new models built for speed and quality. Learn what’s changed, what’s improved, and how to run it on Runpod.

GGUF quantizations make large language models faster and more efficient. This guide walks you through using KoboldCPP to load, run, and manage quantized LLMs on Runpod.