Hot starts, batch inference, and what's next for Runpod Serverless. Webinar June 25.

Kohya LoRA on Runpod

SECourses breaks down how to use LoRA with Kohya on Runpod in a beginner-friendly tutorial. Learn how to apply lightweight LoRA files to existing models.

Kohya LoRA on Runpod

Our good friend SECourses has made some amazing videos showcasing how to run various genative art projects on Runpod. His latest video, titled "Kohya LoRA on Runpod", is a great introduction on how to get into using the powerful technique of LoRA (Low Rank Adaptation). Here's the paper if you're into that kind of stuff: https://arxiv.org/abs/2106.09685.

LoRA is a very valuable technique because it allows one to create a relatively lightweight file to apply on top of existing models that augment the output. This is similar to the concept of textual inversion, but can achieve some very impressive results without having to resort to generating an entirely new model. A full model can be anywhere from 2-8GB, but a LoRA file is usually less than 100MB! The Kohya project has been very popular for investigating LoRA, but it is fairly difficult to install correctly on some machines. This excellent SECourses video walks through the installation step-by-step.

We hope you enjoy and make sure to share anything cool you make in our discord channel!

Author profile: Zhen Lu

Related articles

View All
Deploy When Available is now GA

Deploy When Available is now GA

Queue for any GPU spec, even one that's fully rented out, and we'll deploy it the moment capacity opens up. No more refreshing the console or running a sniping tool.

All
The Chips Got Faster. The Stack Didn't.

The Chips Got Faster. The Stack Didn't.

Explore why faster chips have shifted the bottleneck to AI infrastructure, and what that means for teams running production workloads.

All

Build what’s next.

Build, train, and scale AI workloads on Runpod with cloud GPUs, Serverless, and Clusters.