News icon

Kimi K3 is now available on Runpod

Brendan McKeag

Use alpha_value To Blast Through Context Limits in LLaMa-2 Models
Brendan McKeag
October 10, 2023

Use alpha_value To Blast Through Context Limits in LLaMa-2 Models

Learn how to extend the context length of LLaMa-2 models beyond their defaults using alpha_value and NTK-aware RoPE scaling, all without sacrificing coherency.

AI Workloads
All
GPU-Powered AI Transformation Fireside Chat
Brendan McKeag
October 8, 2023

GPU-Powered AI Transformation Fireside Chat

Join Runpod CEO Zhen Lu and Data Science Dojo CEO Raja Iqbal on October 11 for a live fireside chat about GPU-powered AI transformation and the future of.

All
How to Manage Funding Your Runpod Account
Brendan McKeag
October 1, 2023

How to Manage Funding Your Runpod Account

This guide breaks down everything you need to know about billing on Runpod, how credits are applied, what gets charged, and how to set up automatic or.

Cost Optimization
All
Runpod and RandomSeed Bring Stable Diffusion API Access
Brendan McKeag
September 22, 2023

Runpod and RandomSeed Bring Stable Diffusion API Access

Runpod partners with RandomSeed to power easy-to-use API access for Stable Diffusion through AUTOMATIC1111, making generative art more accessible to developers.

Product Updates
All
What You'll Need to Run Falcon 180B In a Pod
Brendan McKeag
September 7, 2023

What You'll Need to Run Falcon 180B In a Pod

Falcon-180B is the largest open-source LLM to date, requiring 400GB of VRAM to run unquantized. This post explores how to deploy it on Runpod with A100s.

AI Infrastructure
All
Poddy mascot displayed as a retro TV with static, indicating no results found
We couldn't find anything. Try a different search.
Purple glow background

Build what’s next.

Build, train, and scale AI workloads on Runpod with cloud GPUs, Serverless, and Clusters.

Star field background