Project: GGUF presents SNOFS (Sex, Nudes, and Other Fun Stuff) Flux 2 Klein 9b Distilled
Please visit the core model page for ongoing discussions and feedback. Please support the authors there!
Brought to you by the Project: GGUF Tools
The goal of Project: GGUF is to make image generation easier on gamer/consumer hardware. We are currently focusing on Flux 2 Klein models, and have successfully converted and run many 9b models at Q5_K_M on a 3070ti Mobile (laptop) with 8gb VRAM and 32gb RAM, also Q8_0 4b models! That's both converted AND used the models on the hardware.
This is a GGUF version of the model to run on lower end hardware, that's it - nothing more. I take no credit for the model or the hard work others have put into the training or curation.
If you are the author of an original model I have uploaded and want it taken down, please get in touch! Would love to see ongoing support for the low-end hardware :)
Description
FAQ
Comments (4)
where is the Q8
Let me run Q8 conversions! These were just my Q5_K_M Quants I am able to run. Should be up in an hour or 2, depending on my upload
Great checkpoint! I've been using this one for almost two months now, instead of the official version. Thank you for your work.
Thanks for the feedback! If you are up for it, you can convert any BF16 into a GGUF - scripts are linked. I am not using Flux 2 as often right now, so I am not keeping with the versions.
Though, this one was my FAVE when doing Flux 2 gens.