This is a collection of conversions that I've done to Illustrious models to the fp8_e5m2.
It was a test to see if I could generate images using torch.compile, but most of them it wasn't possible and the image was coming all messed up.
Be free to test it.
You will need to include both SDXL Clips ( Clip G and Clip L ) and VAE
If you download a _ALL version, it means that is a full model, so no need to laod VAE and CLIP
This is specially useful for people that want to save space since a lot of models use the same SFXL Clips and VAE, ant this way you don't have full models with same elements.
List of base models:
Animagine - https://civarchive.com/models/260267
Bismuth Illustrious Mix - https://civarchive.com/models/1359028
Bubble hentai - https://civarchive.com/models/1164420
CherryMIX_XL - https://civarchive.com/models/1079112
CyberRealistic - https://civarchive.com/models/1125067
Hassaku - https://civarchive.com/models/140272
Holly Mix - https://civarchive.com/models/959490
iLustMix - https://civarchive.com/models/1110783
Illustrij - https://civarchive.com/models/1025051
Nova Anime - https://civarchive.com/models/376130
Nova Furry - https://civarchive.com/models/503815
Nova Orange - https://civarchive.com/models/967405
Nova Reality DMD2 - https://civarchive.com/models/453428?modelVersionId=2439777
One Obsession - https://civarchive.com/models/1318945
One obsession Branch - https://civarchive.com/models/1368727
PerfectDeliberate - https://civarchive.com/models/24350
Prefect illustrious - https://civarchive.com/models/1224788
RealPhotoIL - https://civarchive.com/models/2041366
SmoothMix - https://civarchive.com/models/1695253
SmoothMix Ultimate - https://civarchive.com/models/2311905
Unholy Desire Mix - https://civarchive.com/models/1307857
WAI-illustrious-SDXL - https://civarchive.com/models/827184
Description
FAQ
Comments (11)
It will be amazing if you can make a FP8 conversion of Illustrij V19 model, it's very popular and it blends realism with cartoon -anime textures so well! https://civitai.com/models/1025051/illustrij
It is available now
@Santodan amazing bro!! i know you do your conversions in comfy ui but i am still trying to figure how to extract the VAE and clip from the full versions and including them into the quantized ones to make the "ALL" versions like you do. mean while: thanks!!
@freddyhung I used this workflow to do it
The only change I did was to have the clip and vae in the first one so it extract everything and then I mute what I don't want.
I'm also using the VAE recommended in this model https://civitai.com/models/2311905?modelVersionId=2601318
To be honest, I'm the clip also from this model
BTW, v20 is available in hugginface since I only noticed afterwards that you wanted v19, so I did both of them
@Santodan Is there a way to convert a controlnet model for sdxl to fp8? i tried converting the diffusion_pytorch_model_promax.safetensors and the converted file doesnt work on my controlnet workflow. Any ideas?
@Santodan the "ALL" model with the VAE and clip baked in and the model without the clip and VAE are inverted, the one labeled as "ALL" is smaller in size than the other one.
@freddyhung no, it seems to be correct. you can do the test of using the _ALL with the checkpoint loader and it will work, the other one will face an error.
I don't know why this is happening, but I use different code for the _ALL and for the fp8 version only.
@Santodan Have you tried converting Pony Models to FP8? personally i think quality drops out very sharply on FP8 Pony models, idk why but illustrious models seem to "hold on" better after quantization.
@freddyhung no, I've never entered in pony, not sure why, but I kinda dislike the look of pony.
@freddyhung I've had another user in hugginface with the same doubt and he noticed something that I didn't before. It seems that all the models have the VAE and clip baked in, the difference is that the _ALL have them all in fp8, while the non all only converted the unet.
I've now edited my script to do this change and will update all the models during the next days or weeks, since civitai upload is kinda slow.
I've done a test and the fp8 node is below 3Gb.
Im also starting to include the original clips and vae in hugginface