LyCORIS-GEM

An experimental LoCon trained on outputs from my MIX-GEM-T2_2 model (and a few other MIX-GEM outputs to make up the gap). I spent a lot of time finetuning that model to my ideal aesthetic and I'd rather try to retrieve the style directly from the model than try to remix on a new SDXL base from scratch. Outputs are not very clean and this LoCon has a lot of issues. I will likely have to regenerate the dataset a couple of times with cleaner outputs. Likely there will be a lot of versions of hits LoCon, this will be an iterative process with a lot of rebakes.

Insights gleaned from prototyping:

Prodigy is worse than AdamW8bit at training style LoCons on PonyXL, even at a higher learning rate it retains a lot less than AdamW8bit. But it also destroys the base model's posing a lot faster, whereas the prodigy tends to keep a lot better with the original posing.

LoCons are better at training for styles than LoRAs.