News icon

Kimi K3 is now available on Runpod

Kohya LoRA on Runpod

SECourses breaks down how to use LoRA with Kohya on Runpod in a beginner-friendly tutorial. Learn how to apply lightweight LoRA files to existing models.

Kohya LoRA on Runpod

Our good friend SECourses has made some amazing videos showcasing how to run various genative art projects on Runpod. His latest video, titled "Kohya LoRA on Runpod", is a great introduction on how to get into using the powerful technique of LoRA (Low Rank Adaptation). Here's the paper if you're into that kind of stuff: https://arxiv.org/abs/2106.09685.

LoRA is a very valuable technique because it allows one to create a relatively lightweight file to apply on top of existing models that augment the output. This is similar to the concept of textual inversion, but can achieve some very impressive results without having to resort to generating an entirely new model. A full model can be anywhere from 2-8GB, but a LoRA file is usually less than 100MB! The Kohya project has been very popular for investigating LoRA, but it is fairly difficult to install correctly on some machines. This excellent SECourses video walks through the installation step-by-step.

We hope you enjoy and make sure to share anything cool you make in our discord channel!

Author profile: Zhen Lu

Related articles

View All

Build what’s next.

Build, train, and scale AI workloads on Runpod with cloud GPUs, Serverless, and Clusters.

Star field background