A LoRA (Hadamard Product) based on 2396 Girls Band Party cards, recognizing 34 characters to varying degrees.A multi-character experiment that turned out better than expected on the first try. Capable of generating multiple subjects, although the consistency still isn't quite there. Decent at hair but often messes up eye colors with multiple subjects.<h2>Usage</h2>This Hadamard Product LoRA requires installing <a target="_blank" rel="ugc" href="https://github.com/KohakuBlueleaf/a1111-sd-webui-locon">an extra extension</a> to be used in the Web UI.The style itself doesn't have a trigger word. For the characters, below are the character tags and respective top 20 related tags.<pre><code>Lisa Imai,
brown hair, long hair, bangs, smile, jewelry, blush, earrings, looking at viewer, green eyes, 1girl, solo, open mouth, dress, frills, instrument, long sleeves, hair ornament, flower, holding, ponytail

Ran Mitake,
black hair, short hair, multicolored hair, bangs, red hair, streaked hair, purple eyes, 1girl, solo, looking at viewer, blush, holding, jewelry, bob cut, smile, instrument, open mouth, shirt, shorts, guitar

Aya Maruyama,
pink hair, pink eyes, bangs, smile, blush, open mouth, looking at viewer, 1girl, solo, frills, bow, jewelry, long hair, dress, ribbon, twintails, skirt, :d, holding, hair ornament

Misaki Okusawa,
open mouth, smile, :d, solo, + +, 1girl, :3, hat, bow, bangs, black hair, long sleeves, hair ornament, blush, sparkle, multiple girls, blue eyes, looking at viewer, long hair, hairclip

Eve Wakamiya,
blue eyes, smile, white hair, bangs, open mouth, blush, long hair, looking at viewer, 1girl, solo, braid, jewelry, twin braids, frills, holding, :d, dress, long sleeves, ribbon, hair ornament

Kasumi Toyama,
brown hair, smile, purple eyes, blush, hair ornament, star, open mouth, looking at viewer, 1girl, bangs, solo, hair bun, star hair ornament, holding, :d, cone hair bun, jewelry, skirt, instrument, frills

Chisato Shirasagi,
blonde hair, long hair, bangs, purple eyes, smile, blush, 1girl, solo, open mouth, looking at viewer, dress, jewelry, frills, holding, long sleeves, earrings, half updo, bow, flower, ribbon

Arisa Ichigaya,
blush, long hair, bangs, blonde hair, hair ornament, brown eyes, open mouth, twintails, smile, 1girl, solo, looking at viewer, yellow eyes, x hair ornament, ribbon, jewelry, frills, star, skirt, holding

Hina Hikawa,
smile, aqua hair, green eyes, short hair, open mouth, braid, looking at viewer, bow, 1girl, solo, blush, jewelry, bangs, holding, :d, hair bow, sparkle, shirt, side braids, earrings

Sayo Hikawa,
green eyes, long hair, aqua hair, bangs, jewelry, holding, 1girl, solo, looking at viewer, blush, hair ornament, flower, smile, dress, long sleeves, instrument, sparkle, earrings, guitar, open mouth

Yukina Minato,
long hair, yellow eyes, bangs, grey hair, 1girl, solo, open mouth, looking at viewer, flower, jewelry, hair ornament, smile, dress, rose, blush, frills, skirt, long sleeves, holding, earrings

Kokoro Tsurumaki,
blonde hair, yellow eyes, bangs, smile, long hair, blush, open mouth, looking at viewer, 1girl, solo, :d, frills, bow, hat, sparkle, holding, striped, short sleeves, shirt, jewelry

Kaoru Seta,
purple hair, smile, red eyes, long hair, solo, 1girl, open mouth, jewelry, looking at viewer, sparkle, pants, ponytail, hat, bangs, earrings, long sleeves, holding, striped, shirt, instrument

Rinko Shirokane,
black hair, long hair, purple eyes, bangs, 1girl, solo, blush, smile, dress, looking at viewer, flower, frills, jewelry, open mouth, long sleeves, hair ornament, ribbon, instrument, rose, earrings

Ako Udagawa,
purple hair, bangs, smile, red eyes, open mouth, blush, 1girl, twintails, solo, looking at viewer, long hair, frills, jewelry, flower, holding, :d, dress, hair ornament, skirt, rose

Tsugumi Hazawa,
brown hair, short hair, brown eyes, open mouth, smile, blush, 1girl, solo, skirt, looking at viewer, :d, jewelry, long sleeves, instrument, shirt, holding, bangs, multiple girls, hat, indoors

Himari Uehara,
green eyes, pink hair, blush, bangs, smile, open mouth, twintails, 1girl, looking at viewer, solo, jewelry, skirt, low twintails, :d, long hair, sparkle, shirt, holding, breasts, long sleeves

Kanon Matsubara,
purple eyes, blue hair, bangs, open mouth, long hair, smile, blush, 1girl, solo, looking at viewer, holding, :d, light blue hair, one side up, ribbon, jewelry, dress, hair ornament, frills, bow

Maya Yamato,
brown hair, open mouth, short hair, smile, green eyes, 1girl, solo, blush, looking at viewer, bangs, holding, :d, hair ornament, jewelry, skirt, frills, shirt, glasses, gloves, indoors

Hagumi Kitazawa,
short hair, orange hair, smile, 1girl, open mouth, solo, looking at viewer, blush, jewelry, shorts, thighhighs, hat, hair ornament, instrument, shirt, guitar, skirt, bow, one eye closed, earrings

Tomoe Udagawa,
red hair, long hair, smile, blue eyes, 1girl, solo, bangs, jewelry, looking at viewer, open mouth, earrings, blush, shirt, holding, jacket, skirt, long sleeves, multiple girls, drumsticks, aqua eyes

Tae Hanazono,
long hair, green eyes, smile, black hair, bangs, open mouth, blush, 1girl, looking at viewer, solo, holding, :d, brown hair, instrument, hair ornament, jewelry, guitar, electric guitar, frills, shirt

Moca Aoba,
short hair, grey hair, bangs, smile, blush, looking at viewer, 1girl, blue eyes, solo, holding, open mouth, instrument, jewelry, guitar, long sleeves, skirt, jacket, shirt, shorts, multiple girls

Rimi Ushigome,
black hair, short hair, blush, smile, open mouth, bangs, looking at viewer, 1girl, skirt, solo, red eyes, brown eyes, hair ornament, jewelry, bow, frills, holding, instrument, star, :d

Saaya Yamabuki,
brown hair, blue eyes, smile, bangs, blush, ribbon, open mouth, ponytail, looking at viewer, 1girl, long hair, solo, holding, sidelocks, jewelry, :d, hair ornament, star, bow, sparkle

Mashiro Kurata,
blue eyes, open mouth, blush, bangs, smile, 1girl, jewelry, skirt, solo, looking at viewer, short hair, hair between eyes, white hair, earrings, frills, shirt, long hair, long sleeves, dress, hair ornament

Rui Yashio,
short hair, black hair, hair between eyes, 1girl, solo, looking at viewer, jewelry, bangs, holding, dress, purple eyes, long sleeves, breasts, parted lips, earrings, indoors, frills, dutch angle, smile, brown eyes

LAYER,
black hair, long hair, solo, smile, 1girl, blue eyes, jewelry, looking at viewer, open mouth, pants, gloves, brown hair, earrings, instrument, guitar, long sleeves, holding, shirt, dutch angle, jacket

Nanami Hiromachi,
pink eyes, smile, bangs, open mouth, blush, pink hair, 1girl, solo, jewelry, hair ornament, long hair, dress, ribbon, :d, frills, earrings, looking at viewer, blonde hair, hat, long sleeves

Touko Kirigaya,
blonde hair, long hair, smile, blush, bangs, brown eyes, 1girl, jewelry, solo, looking at viewer, holding, open mouth, earrings, shirt, instrument, frills, dutch angle, guitar, hat, gloves

LOCK,
green eyes, smile, looking at viewer, bangs, long hair, open mouth, 1girl, solo, jewelry, blue hair, blush, hair ornament, skirt, holding, :d, earrings, long sleeves, dress, instrument, multiple girls

MASKING,
blonde hair, short hair, yellow eyes, jewelry, solo, smile, 1girl, earrings, looking at viewer, pants, midriff, gloves, open mouth, breasts, long sleeves, jacket, shirt, necklace, brown eyes, bangs

Tsukushi Futaba,
black hair, blush, long hair, bangs, 1girl, looking at viewer, twintails, smile, solo, open mouth, brown eyes, dress, jewelry, holding, hair ornament, long sleeves, earrings, frills, skirt, shirt

PAREO,
bangs, long hair, smile, pink hair, blunt bangs, multicolored hair, blush, open mouth, twintails, two-tone hair, looking at viewer, 1girl, solo, long sleeves, jewelry, :d, skirt, jacket, pink eyes, hair ornament</code></pre>When prompting for multiple characters, it's recommended to use the following format:<pre><code>MainChar/OtherChar1/OtherChar2, other tags ...</code></pre><h2>Training info</h2>Dataset:<ul><li>2396 Cards collected from <a target="_blank" rel="ugc" href="https://bandori.party/cards/">Bandori Party</a></li></ul>Tags generated with <a target="_blank" rel="ugc" href="https://huggingface.co/SmilingWolf/wd-v1-4-convnextv2-tagger-v2">SmilingWolf/wd-v1-4-convnextv2-tagger-v2</a> with a threshold of 0.35. No balancing and tag cleaning.The data source also provides info about which other characters are also present in the card art ("cameos"). However, this info is not precise enough, as cards often have two images featuring different characters. Generated tags were used to determine if the cameo characters' names should be included in the caption.The caption template is <code>MainChar/OtherChar1/OtherChar2..., other tags shuffled</code>. Although slashes were used as the character separator, using commas instead doesn't seem to noticeably degrade performance.Trained for 40 epochs but it is not clear if that many were required. The 10-epoch checkpoint is already usable. All checkpoints can be found on the <a target="_blank" rel="ugc" href="https://huggingface.co/gustproof/sd-models/tree/main/garupa/checkpoints">hf repo</a>.Training cost: ~13 T4 hoursData distribution:<pre><code> character cards cameos
1 Lisa Imai 92 39
2 Ran Mitake 91 49
3 Aya Maruyama 89 37
4 Misaki Okusawa 89 25
5 Eve Wakamiya 88 24
6 Kasumi Toyama 88 41
7 Chisato Shirasagi 86 49
8 Arisa Ichigaya 85 35
9 Hina Hikawa 85 42
10 Sayo Hikawa 85 33
11 Yukina Minato 85 23
12 Kokoro Tsurumaki 84 26
13 Kaoru Seta 83 46
14 Rinko Shirokane 83 31
15 Ako Udagawa 82 36
16 Tsugumi Hazawa 82 24
17 Himari Uehara 81 42
18 Kanon Matsubara 80 26
19 Maya Yamato 80 30
20 Hagumi Kitazawa 78 37
21 Tomoe Udagawa 78 43
22 Tae Hanazono 76 38
23 Moca Aoba 75 37
24 Rimi Ushigome 75 29
25 Saaya Yamabuki 75 21
26 Mashiro Kurata 42 20
27 Rui Yashio 38 10
28 LAYER 36 12
29 Nanami Hiromachi 36 13
30 Touko Kirigaya 35 21
31 LOCK 34 17
32 MASKING 34 14
33 Tsukushi Futaba 34 17
34 PAREO 32 5</code></pre>Training config:<pre><code>[model_arguments]
v2 = false
v_parameterization = false
pretrained_model_name_or_path = "animefull-final-pruned.ckpt"

[additional_network_arguments]
no_metadata = false
network_module = "lycoris.kohya"
network_dim = 16
network_alpha = 1
network_args = [ "conv_dim=0", "algo=loha",]
network_train_unet_only = false
network_train_text_encoder_only = false
cache_latents = false

[optimizer_arguments]
optimizer_type = "AdamW"
learning_rate = 0.001
max_grad_norm = 1.0
lr_scheduler = "cosine"
lr_warmup_steps = 100

[dataset_arguments]
debug_dataset = false
# batch size: 4 x 2
# resolution: 640

[training_arguments]
output_name = "garupa"
save_precision = "fp16"
save_every_n_epochs = 1
max_token_length = 225
mem_eff_attn = false
xformers = true
max_train_epochs = 40
max_data_loader_n_workers = 1
persistent_data_loader_workers = false
gradient_checkpointing = false
gradient_accumulation_steps = 1
mixed_precision = "fp16"
clip_skip = 2
log_prefix = "garupa"
lowram = true

[sample_prompt_arguments]

[saving_arguments]
save_model_as = "safetensors"</code></pre>

Files with SHA256: 5514468a09abd18c2ce4d0c9a349e8d72ee3eddcc1f2bd120045010af437d8f2