Blog

Runpod Blog

Our team’s insights on building better and scaling smarter.
All
Thank you! Your submission has been received!
Oops! Something went wrong while submitting the form.
How to Install SillyTavern in a Runpod Instance

How to Install SillyTavern in a Runpod Instance

This guide walks through setting up SillyTavern—a powerful, customizable roleplay frontend—on a Runpod instance. It covers port exposure, GitHub installation, whitelist config, and connecting to models like Oobabooga or KoboldAI.
Read article
Learn AI
How to Install SillyTavern in a RunPod Instance

How to Install SillyTavern in a RunPod Instance

Want to upgrade from basic chat UIs? SillyTavern offers a more interactive interface for AI conversations. Here’s how to install it on your own RunPod instance.
Read article
Learn AI
16k Context LLM Models Now Available On Runpod

16k Context LLM Models Now Available On Runpod

Runpod now supports Panchovix’s 16k-token context models, allowing for much deeper context retention in long-form generation. These models require higher VRAM and may trade off some performance, but are ideal for extended sessions like roleplay or complex Q&A.
Read article
Product Updates
Runpod Partners With Defined.ai To Democratize and Accelerate AI Development

Runpod Partners With Defined.ai To Democratize and Accelerate AI Development

Runpod announces a partnership with Defined.ai to offer ethically sourced speech and text datasets to AI developers, starting with a pilot program to fine-tune LLMs and accelerate NLP research.
Read article
Product Updates
How to Create an Effective TavernAI Character

How to Create an Effective TavernAI Character

Roleplay is one of AI's fastest-growing use cases. This guide walks you through building compelling, consistent TavernAI characters for immersive interactions.
Read article
Learn AI
How to Use 65B+ Language Models on Runpod

How to Use 65B+ Language Models on Runpod

Large language models like Guanaco 65B can run on Runpod with the right optimizations. Learn how to handle quantization, memory, and GPU sizing.
Read article
AI Infrastructure
SuperHot 8k Token Context Models Are Here For Text Generation

SuperHot 8k Token Context Models Are Here For Text Generation

New 8k context models from TheBloke—like WizardLM, Vicuna, and Manticore—allow longer, more immersive text generation in Oobabooga. With more room for character memory and story progression, these models enhance AI storytelling.
Read article
Hardware & Trends

Build what’s next.

The most cost-effective platform for building, training, and scaling machine learning models—ready when you are.