LoRA training

Training a LoRA with Kohya

These instructions should work on the computers in WH.02.110

Preparing for training

Step 1: Collect the images you want to use for training

Step 2: Create the folder structure
Create a folder on the desktop and name it (your name, or name of your project).
Download this zip file, and unzip it in the folder you just created. The zip will create the basic file structure, and a configuration file.

Inside the img folder, there needs to be another folder. The name of this folder has to be <REPEATS><underscore><TRIGGERWORD><space><CLASS>

Step 3: Create captions

Training your LoRA

If you didn't already launch the kohya software

Make sure you select the LoRA tab

Load the configuration file that you downloaded earlier. We are going to leave it mostly at the default settings, but there are a few things we need to adjust.

Change the model name to the name you want it to have.

Check if the paths are correct, and adjust if neccesary.

Adjust the prompts for the samples that will be generated during training.

Hit the training button, and wait for the first samples to appear.

Using your LoRA in Stable Diffusion WebUI

Select the model that looks most promising to you, and copy it to the right folder in Stable Diffusion WebUI

In the WebUI check the LoRA tab, and refresh it to see your model. Clicking on it will add your LoRA to the prompt.

You can use your LoRA in combination with different compatible checkpoint models.

You can also combine different models.

Try changing the weight of the model.

Tray changing cfg scale