A LoRA (Hadamard Product) based on 2396 Girls Band Party cards, recognizing 34 characters to varying degrees.

A multi-character experiment that turned out better than expected on the first try. Capable of generating multiple subjects, although the consistency still isn't quite there. Decent at hair but often messes up eye colors with multiple subjects.

Usage

This Hadamard Product LoRA requires installing an extra extension to be used in the Web UI.

The style itself doesn't have a trigger word. For the characters, below are the character tags and respective top 20 related tags.

Lisa Imai,
brown hair, long hair, bangs, smile, jewelry, blush, earrings, looking at viewer, green eyes, 1girl, solo, open mouth, dress, frills, instrument, long sleeves, hair ornament, flower, holding, ponytail

Ran Mitake,
black hair, short hair, multicolored hair, bangs, red hair, streaked hair, purple eyes, 1girl, solo, looking at viewer, blush, holding, jewelry, bob cut, smile, instrument, open mouth, shirt, shorts, guitar

Aya Maruyama,
pink hair, pink eyes, bangs, smile, blush, open mouth, looking at viewer, 1girl, solo, frills, bow, jewelry, long hair, dress, ribbon, twintails, skirt, :d, holding, hair ornament

Misaki Okusawa,
open mouth, smile, :d, solo, + +, 1girl, :3, hat, bow, bangs, black hair, long sleeves, hair ornament, blush, sparkle, multiple girls, blue eyes, looking at viewer, long hair, hairclip

Eve Wakamiya,
blue eyes, smile, white hair, bangs, open mouth, blush, long hair, looking at viewer, 1girl, solo, braid, jewelry, twin braids, frills, holding, :d, dress, long sleeves, ribbon, hair ornament

Kasumi Toyama,
brown hair, smile, purple eyes, blush, hair ornament, star, open mouth, looking at viewer, 1girl, bangs, solo, hair bun, star hair ornament, holding, :d, cone hair bun, jewelry, skirt, instrument, frills

Chisato Shirasagi,
blonde hair, long hair, bangs, purple eyes, smile, blush, 1girl, solo, open mouth, looking at viewer, dress, jewelry, frills, holding, long sleeves, earrings, half updo, bow, flower, ribbon

Arisa Ichigaya,
blush, long hair, bangs, blonde hair, hair ornament, brown eyes, open mouth, twintails, smile, 1girl, solo, looking at viewer, yellow eyes, x hair ornament, ribbon, jewelry, frills, star, skirt, holding

Hina Hikawa,
smile, aqua hair, green eyes, short hair, open mouth, braid, looking at viewer, bow, 1girl, solo, blush, jewelry, bangs, holding, :d, hair bow, sparkle, shirt, side braids, earrings

Sayo Hikawa,
green eyes, long hair, aqua hair, bangs, jewelry, holding, 1girl, solo, looking at viewer, blush, hair ornament, flower, smile, dress, long sleeves, instrument, sparkle, earrings, guitar, open mouth

Yukina Minato,
long hair, yellow eyes, bangs, grey hair, 1girl, solo, open mouth, looking at viewer, flower, jewelry, hair ornament, smile, dress, rose, blush, frills, skirt, long sleeves, holding, earrings

Kokoro Tsurumaki,
blonde hair, yellow eyes, bangs, smile, long hair, blush, open mouth, looking at viewer, 1girl, solo, :d, frills, bow, hat, sparkle, holding, striped, short sleeves, shirt, jewelry

Kaoru Seta,
purple hair, smile, red eyes, long hair, solo, 1girl, open mouth, jewelry, looking at viewer, sparkle, pants, ponytail, hat, bangs, earrings, long sleeves, holding, striped, shirt, instrument

Rinko Shirokane,
black hair, long hair, purple eyes, bangs, 1girl, solo, blush, smile, dress, looking at viewer, flower, frills, jewelry, open mouth, long sleeves, hair ornament, ribbon, instrument, rose, earrings

Ako Udagawa,
purple hair, bangs, smile, red eyes, open mouth, blush, 1girl, twintails, solo, looking at viewer, long hair, frills, jewelry, flower, holding, :d, dress, hair ornament, skirt, rose

Tsugumi Hazawa,
brown hair, short hair, brown eyes, open mouth, smile, blush, 1girl, solo, skirt, looking at viewer, :d, jewelry, long sleeves, instrument, shirt, holding, bangs, multiple girls, hat, indoors

Himari Uehara,
green eyes, pink hair, blush, bangs, smile, open mouth, twintails, 1girl, looking at viewer, solo, jewelry, skirt, low twintails, :d, long hair, sparkle, shirt, holding, breasts, long sleeves

Kanon Matsubara,
purple eyes, blue hair, bangs, open mouth, long hair, smile, blush, 1girl, solo, looking at viewer, holding, :d, light blue hair, one side up, ribbon, jewelry, dress, hair ornament, frills, bow

Maya Yamato,
brown hair, open mouth, short hair, smile, green eyes, 1girl, solo, blush, looking at viewer, bangs, holding, :d, hair ornament, jewelry, skirt, frills, shirt, glasses, gloves, indoors

Hagumi Kitazawa,
short hair, orange hair, smile, 1girl, open mouth, solo, looking at viewer, blush, jewelry, shorts, thighhighs, hat, hair ornament, instrument, shirt, guitar, skirt, bow, one eye closed, earrings

Tomoe Udagawa,
red hair, long hair, smile, blue eyes, 1girl, solo, bangs, jewelry, looking at viewer, open mouth, earrings, blush, shirt, holding, jacket, skirt, long sleeves, multiple girls, drumsticks, aqua eyes

Tae Hanazono,
long hair, green eyes, smile, black hair, bangs, open mouth, blush, 1girl, looking at viewer, solo, holding, :d, brown hair, instrument, hair ornament, jewelry, guitar, electric guitar, frills, shirt

Moca Aoba,
short hair, grey hair, bangs, smile, blush, looking at viewer, 1girl, blue eyes, solo, holding, open mouth, instrument, jewelry, guitar, long sleeves, skirt, jacket, shirt, shorts, multiple girls

Rimi Ushigome,
black hair, short hair, blush, smile, open mouth, bangs, looking at viewer, 1girl, skirt, solo, red eyes, brown eyes, hair ornament, jewelry, bow, frills, holding, instrument, star, :d

Saaya Yamabuki,
brown hair, blue eyes, smile, bangs, blush, ribbon, open mouth, ponytail, looking at viewer, 1girl, long hair, solo, holding, sidelocks, jewelry, :d, hair ornament, star, bow, sparkle

Mashiro Kurata,
blue eyes, open mouth, blush, bangs, smile, 1girl, jewelry, skirt, solo, looking at viewer, short hair, hair between eyes, white hair, earrings, frills, shirt, long hair, long sleeves, dress, hair ornament

Rui Yashio,
short hair, black hair, hair between eyes, 1girl, solo, looking at viewer, jewelry, bangs, holding, dress, purple eyes, long sleeves, breasts, parted lips, earrings, indoors, frills, dutch angle, smile, brown eyes

LAYER,
black hair, long hair, solo, smile, 1girl, blue eyes, jewelry, looking at viewer, open mouth, pants, gloves, brown hair, earrings, instrument, guitar, long sleeves, holding, shirt, dutch angle, jacket

Nanami Hiromachi,
pink eyes, smile, bangs, open mouth, blush, pink hair, 1girl, solo, jewelry, hair ornament, long hair, dress, ribbon, :d, frills, earrings, looking at viewer, blonde hair, hat, long sleeves

Touko Kirigaya,
blonde hair, long hair, smile, blush, bangs, brown eyes, 1girl, jewelry, solo, looking at viewer, holding, open mouth, earrings, shirt, instrument, frills, dutch angle, guitar, hat, gloves

LOCK,
green eyes, smile, looking at viewer, bangs, long hair, open mouth, 1girl, solo, jewelry, blue hair, blush, hair ornament, skirt, holding, :d, earrings, long sleeves, dress, instrument, multiple girls

MASKING,
blonde hair, short hair, yellow eyes, jewelry, solo, smile, 1girl, earrings, looking at viewer, pants, midriff, gloves, open mouth, breasts, long sleeves, jacket, shirt, necklace, brown eyes, bangs

Tsukushi Futaba,
black hair, blush, long hair, bangs, 1girl, looking at viewer, twintails, smile, solo, open mouth, brown eyes, dress, jewelry, holding, hair ornament, long sleeves, earrings, frills, skirt, shirt

PAREO,
bangs, long hair, smile, pink hair, blunt bangs, multicolored hair, blush, open mouth, twintails, two-tone hair, looking at viewer, 1girl, solo, long sleeves, jewelry, :d, skirt, jacket, pink eyes, hair ornament

When prompting for multiple characters, it's recommended to use the following format:

MainChar/OtherChar1/OtherChar2, other tags ...

Training info

Dataset:

• 2396 Cards collected from Bandori Party

Tags generated with SmilingWolf/wd-v1-4-convnextv2-tagger-v2 with a threshold of 0.35. No balancing and tag cleaning.

The data source also provides info about which other characters are also present in the card art ("cameos"). However, this info is not precise enough, as cards often have two images featuring different characters. Generated tags were used to determine if the cameo characters' names should be included in the caption.

The caption template is MainChar/OtherChar1/OtherChar2..., other tags shuffled. Although slashes were used as the character separator, using commas instead doesn't seem to noticeably degrade performance.

Trained for 40 epochs but it is not clear if that many were required. The 10-epoch checkpoint is already usable. All checkpoints can be found on the hf repo.

Training cost: ~13 T4 hours

Data distribution:

            character  cards  cameos
1           Lisa Imai     92      39
2          Ran Mitake     91      49
3        Aya Maruyama     89      37
4      Misaki Okusawa     89      25
5        Eve Wakamiya     88      24
6       Kasumi Toyama     88      41
7   Chisato Shirasagi     86      49
8      Arisa Ichigaya     85      35
9         Hina Hikawa     85      42
10        Sayo Hikawa     85      33
11      Yukina Minato     85      23
12   Kokoro Tsurumaki     84      26
13         Kaoru Seta     83      46
14    Rinko Shirokane     83      31
15        Ako Udagawa     82      36
16     Tsugumi Hazawa     82      24
17      Himari Uehara     81      42
18    Kanon Matsubara     80      26
19        Maya Yamato     80      30
20    Hagumi Kitazawa     78      37
21      Tomoe Udagawa     78      43
22       Tae Hanazono     76      38
23          Moca Aoba     75      37
24      Rimi Ushigome     75      29
25     Saaya Yamabuki     75      21
26     Mashiro Kurata     42      20
27         Rui Yashio     38      10
28              LAYER     36      12
29   Nanami Hiromachi     36      13
30     Touko Kirigaya     35      21
31               LOCK     34      17
32            MASKING     34      14
33    Tsukushi Futaba     34      17
34              PAREO     32       5

Training config:

[model_arguments]
v2 = false
v_parameterization = false
pretrained_model_name_or_path = "animefull-final-pruned.ckpt"

[additional_network_arguments]
no_metadata = false
network_module = "lycoris.kohya"
network_dim = 16
network_alpha = 1
network_args = [ "conv_dim=0", "algo=loha",]
network_train_unet_only = false
network_train_text_encoder_only = false
cache_latents = false

[optimizer_arguments]
optimizer_type = "AdamW"
learning_rate = 0.001
max_grad_norm = 1.0
lr_scheduler = "cosine"
lr_warmup_steps = 100

[dataset_arguments]
debug_dataset = false
# batch size: 4 x 2
# resolution: 640

[training_arguments]
output_name = "garupa"
save_precision = "fp16"
save_every_n_epochs = 1
max_token_length = 225
mem_eff_attn = false
xformers = true
max_train_epochs = 40
max_data_loader_n_workers = 1
persistent_data_loader_workers = false
gradient_checkpointing = false
gradient_accumulation_steps = 1
mixed_precision = "fp16"
clip_skip = 2
log_prefix = "garupa"
lowram = true

[sample_prompt_arguments]

[saving_arguments]
save_model_as = "safetensors"