Brendan McKeag

Meta’s Llama 4 models, Scout and Maverick, are the next evolution in open LLMs. This post explores their strengths, performance, and deployment on Runpod.

Runpod now supports Axolotl out of the box, making it easier than ever to fine-tune large language models without complex setup.

Open-source AI is booming, and 2024 delivered an incredible wave of new LLMs and generative video models. Here's a quick roundup of the most exciting.

Runpod’s new REST API lets you manage GPU workloads programmatically, launch, scale, and monitor pods without ever touching the dashboard.

We’ve upgraded Runpod CPU pods with Docker runtime and network volume support, giving you more flexibility, better storage options, and smoother dev workflows.

DeepSeek R1 remains one of the top open-source models. This post shows how you can run it efficiently on just 480GB of VRAM without sacrificing performance.

This follow-up to our “Hello World” tutorial walks through streaming output from a Runpod Serverless endpoint using WebSocket and base64 files.