Announcing Runpod Flash

Brendan McKeag

Stable Diffusion 3.5: What’s New in the Latest Generation
Brendan McKeag
October 24, 2024

Stable Diffusion 3.5: What’s New in the Latest Generation

Stability.ai’s SD3.5 is here—with new models built for speed and quality. Learn what’s changed, what’s improved, and how to run it on Runpod.

Product Updates
All
Why NVidia's Llama 3.1 Nemotron 70B Might Be the Most Reasonable LLM Yet
Brendan McKeag
October 18, 2024

Why NVidia's Llama 3.1 Nemotron 70B Might Be the Most Reasonable LLM Yet

NVidia’s Llama 3.1 Nemotron 70B is outperforming larger and closed models on key reasoning tasks. In this post, Brendan tests it against a long-unsolved challenge: consistent, in-character roleplay with zero internal monologue or user coercion—and finds it finally up to the task.

AI Workloads
All
NVIDIA's Llama 3.1 Nemotron 70B: Can It Solve Your LLM Bottlenecks?
Brendan McKeag
October 18, 2024

NVIDIA's Llama 3.1 Nemotron 70B: Can It Solve Your LLM Bottlenecks?

Nemotron 70B is NVIDIA’s latest open model and it’s climbing the leaderboards. But how does it perform in the real world—and can it solve your toughest inference challenges?

All
How to Code Stable Diffusion Directly in Python on Runpod
Brendan McKeag
October 14, 2024

How to Code Stable Diffusion Directly in Python on Runpod

Skip the front ends—learn how to use Jupyter Notebook on Runpod to run Stable Diffusion directly in Python. Great for devs who want full control.

AI Workloads
All
Why LLMs Can't Spell 'Strawberry' And Other Odd Use Cases
Brendan McKeag
October 1, 2024

Why LLMs Can't Spell 'Strawberry' And Other Odd Use Cases

Large language models can write poetry and solve logic puzzles—but fail at tasks like counting letters or doing math. Here’s why, and what it tells us about their design.

Learn AI
All
Run GGUF Quantized Models Easily with KoboldCPP on Runpod
Brendan McKeag
September 25, 2024

Run GGUF Quantized Models Easily with KoboldCPP on Runpod

Lower VRAM usage and improve inference speed using GGUF quantized models in KoboldCPP with just a few environment variables.

AI Workloads
All
Poddy mascot displayed as a retro TV with static, indicating no results found
We couldn't find anything. Try a different search.

Build what’s next.

The most cost-effective platform for building, training, and scaling machine learning models—ready when you are.