¶ LoRA
An Introduction
LoRA stands for Low-Rank Adaptation. A LoRA is a Stable Diffusion model that can be used with other models to change the look of your artworks. Let's start by looking at my favorite LoRA, xl_more_art-full_v1. This LoRA simply makes art look “better”.
Here's an artwork without the LoRA. Three birds in the style of artists Wifredo Lam and Charley Harper. It looks intriguing and creative, but also disjointed.
Prompt:
3 beautiful birds, standing on the branch of bare tree in winter, (close up:1.4), (Wilfredo Lam, Charley Harper:1.4)
And here is the same prompt but WITH the LoRA. The birds are more well defined and have added dimension and detail.
Prompt:
3 beautiful birds, standing on the branch of bare tree in winter, (close up:1.4), (Wilfredo Lam, Charley Harper:1.4), <LoRA:xl_more_art-full_v1:0.8>
¶ Syntax
Let's take a closer look at that LoRA.
<LoRA:xl_more_art-full_v1:0.8>
The angle brackets <> colon : and proper spelling of the LoRA are all necessary to make it work properly. If you try to run a LoRA without the proper syntax, the AI won't recognize it.
Fortunately, MonAI makes it easy to add LoRAs. Just go to the Advanced Options, scroll down to the LoRA section, and Tap on the LoRA you want to add.
Once selected, a number will appear at the right of the LoRA along with a built-in slider. The number indicates the strength of the LoRA.
You can also tap on the number to bring up the slider.
Here is the same artwork with the LoRA set at 0.4 instead of 0.8:
Prompt:
3 beautiful birds, standing on the branch of bare tree in winter, (close up:1.4), (Wilfredo Lam, Charley Harper:1.4), <LoRA:xl_more_art-full_v1:0.4>
¶ Can you combine LoRAs?
Yes.
¶ Can every LoRA be used with every AI model?
No. LoRAs made for SD 1.5 models can only be used for SD 1.5 models and LoRAs made for SDXL can only be used for SDXL models. When a LoRA is grayed out, that's why. Try changing to a different model if you want to try a grayed out LoRA.
¶ What is a Trigger Word?
Some LoRAs require a trigger word in the prompt to activate it. For example, the Dissolve LoRA requires the word “dissolve” to be included in the prompt. You can also increase the effect by adding a prompt weighting to the trigger word.
As you can see, there was no dissolve effect at all when using the LoRA without the trigger word. Not all LoRAs have trigger words.
¶ How do I know if a trigger word is needed?
We've made it easier to use LoRAs with MonAI by adding this new trigger word menu. Just tap the trigger word or words you want to use.
The words will be added to the prompt, following the LoRA.
If you deselect the LoRA, the trigger words will go away too.
¶ How do I know what each LoRA does
Check out the LoRA page for a chart with information for each LoRA.
.