Brendan McKeagSeptember 20, 2024Introducing Better Forge: Spin Up Stable Diffusion Pods FasterBetter Forge is a new Runpod template that lets you launch Stable Diffusion pods in less time and with less hassle. Here's how it improves your workflow.AI InfrastructureAll
Brendan McKeagSeptember 18, 2024Run Very Large LLMs Securely with Runpod ServerlessDeploy large language models like LLaMA or Mixtral on Runpod Serverless with strong privacy controls and no infrastructure headaches. Here’s how.AI InfrastructureAll
Brendan McKeagSeptember 13, 2024Evaluate Multiple LLMs Simultaneously Using Ollama on RunpodUse Ollama to compare multiple LLMs side-by-side on a single GPU pod, perfect for fast, realistic model evaluation with shared prompts.AI WorkloadsAll
Brendan McKeagAugust 15, 2024Supercharge Your LLMs with SGLang: Boost Performance and CustomizationDiscover how to boost your LLM inference performance and customize responses using SGLang, an innovative framework for structured LLM workflows.AI WorkloadsAll
Brendan McKeagJuly 25, 2024Mastering Serverless Scaling on Runpod: Optimize Performance and Reduce CostsLearn how to optimize your serverless GPU deployment on Runpod to balance latency, performance, and cost. From active and flex workers to Flashboot and.AI InfrastructureAll
Brendan McKeagJune 6, 2024Run Larger LLMs on Runpod Serverless Than Ever Before – Llama-3 70B (and beyond!)Runpod Serverless now supports multi-GPU workers, enabling full-precision deployment of large models like Llama-3 70B. With optimized VLLM support.Product UpdatesAll
Brendan McKeagMay 28, 2024Introducing Serverless CPU: High-Performance VMs Without GPUsOur new Serverless CPU offering lets you launch high-performance containers without GPUs, perfect for lighter workloads, dev tasks, and automation.Product UpdatesAll