CivArchive
    Preview undefined
    Preview undefined
    Preview undefined
    Preview undefined
    Preview undefined
    Preview undefined
    Preview undefined

    The Flux based successor to FluffyRock is currently in training. Early checkpoints are showing a lot of promis in the realm of uncensored, full natural language model.

    Chroma

    [ e233-terminal-snr-vpred-e206 is the last of the original vpred training line. I've put it here for "completeness". There are a handful of newer checkpoints of this vpred model with some different (I forget what was changed in the training). I will try to upload e257-terminal-snr-vpred-e11 later if Civitai with corporate. ]

    [ There are some newer FR models, specifically the "minsnr" lines, but they are somewhat "deepfried" and I wouldn't recommend them for general use, Lodestone has suggested using it for merging instead. As always, all of these are in the HF repo if you want to try them. ]

    Official-enough Civitai upload of some of the common/popular/newer FluffyRock models. This is mostly being done to allow other posts and models to be able to properly reference the original models.

    FluffyRock is a furry focused model with a very wide understanding of concepts and styles with the ability to sample at up to 1088x1088. There are multiple model branches being trained in parallel due to the many different experiments being conducted, each branch will produce outputs that are at least a little different from other branches.

    There are multiple different model branches using different methods.

    A chart of the branches and what is different between them will be added once it has been updated.

    The info here is incomplete. This will be improved eventually.

    Personally, the vpred model line is getting really good. Does require additional setup to make work, see below.

    Any recent epoch of terminal-snr are quite mature by this point and I'm not seeing a whole lot of change between each checkpoint beyond gradually improved concept understanding of lower volume tags.

    This is often a subjective preference, use whichever you like best. Or mix with other models. Do whatever you want. :V

    Prompting:

    Use e621 tags, without underscores, comma separated, any order.

    Artist tags use "by name" format without "(artist)" on the tags that normally have them.

    Pre-3m models do not understand meta tags. Post-3m may understand meta tags, I have not explicitly tested yet.

    Base SD1.5 natural language understanding has been mostly lobotomized. Several projects are currently running to recreate natural language understanding similar to base SD but more specific to furry art. Those checkpoints are too undercooked so far for general use, but you can find them in the Discord thread and on HF for testing.

    Most examples shown here have minimal to no neg prompting.

    Note that additional setup is required to use any of the FluffyRock vpred models:

    Use the provided config file.

    You will need to use cfg rescale.

    For A1111 (and possibly the Vlad fork), use CFG_Rescale_webui extension. Or pull the cfg rescale PR from A1111 (unless it has since been merged upstream). Hopefully in the future this becomes a stock feature in A1111.

    There is a method to to do this on Comfy UI, but I need to go verify that and add that info here.

    About the Civitai upload:

    More versions will be added over time. Leave comment if you need a particular checkpoint uploaded here. Newer models will be uploaded here as I have the time to upload and make sample images. Original Hugging Face repo will always be most current.

    I'm the one uploading these models here because of our small casual team, I had the most bandwidth to spare and time to maintain it. Lodestone Rock trained these models. Many others have also helped with various things.

    Due to limitations on Civitai (version string length is rather short) and how the site works (downloads do not use the original uploaded filename), the filenames for the checkpoints are different from the originals on HuggingFace. I've attempted to keep them unique between the different training branches while still close enough to the original to be able to identify them. The full original filenames for each checkpoint are listed under the "About this model" in the side panel.

    Quick breakdown on each model line here.

    1088-megares: Trained on highres dataset up to 1088px.

    Considered finished at e27 as it had plateaued and efforts moved to other lines.

    1088-megares-offset-noise: Same as above, but with additional epochs with offset noise. Helps increase dynamic lighting range of dark and light parts of images, ie. darker darks can be possible.

    Considered finished at e27 as it had plateaued and efforts moved to other lines.

    1088-megares-offset-noise-3M: Same as above with larger >3 million image dataset. Able to understand more concepts.

    I believe no additional checkpoints are being trained in favor of giving more time to other lines.

    1088-megares-terminal-snr: Similar goal to offset noise, but technically different method. Rescales the noise schedule to enforce zero terminal SNR. This blends in to additional changes done in the vpred fork below.

    1088-megares-terminal-snr-vpred: Forked from 1088-megares-terminal-snr at epoch 20-21.

    This is an experimental model that uses v-prediction to fix Stable Diffusions 1.5 poor noise scheduling and sample steps. It does this in four different ways.

    • By rescaling the noise schedule to enforce zero terminal SNR.

    • Training the model with v-prediction

    • Changing the sampler to always start from the last timestep

    • Rescaling classifier-free guidance to prevent over-exposure (config rescale)

    These modifications are based upon the paper "Common Diffusion Noise Schedules and Sample Steps are Flawed".

    Experimentation with the model has showed a variety of possible improvements, including but not excluded to.

    • Improved understanding of prompts

    • More accurate colours

    • Significantly enhanced contrast

    Note that additional setup is required to use any of the FluffyRock vpred models:

    Requires config file and cfg rescale. For A1111 (and possibly the Vlad fork), use CFG_Rescale_webui extension or pull the cfg rescale PR from A1111 (unless it has since been merged upstream).

    e6laion: Another experiment.

    Is not a fork and separate from all other lines.

    Trained on a dataset of e6, laion, and booru. It is relearning things that base SD1.5 had. Also uses vpred. Much experimental and does not have many epochs yet. Is not uploaded here yet. Can be download from the HuggingFace repo. Results can be unstable.

    PolyFur: Newer project, somewhat similar to e6laion but with the additional dataset being human curated and has a similar goal to reintroduce natural language prompting but with a focus on improved aesthetic.

    Is not a fork and separate from all other lines.

    Is showing improvements each epoch and might get a release here around early August. Also uses vpred. Can be downloaded now from the HuggingFace Repo.

    SDXLVAE: An experimental fork of 1088-megares-offset-noise-3M that uses the SDXL VAE.

    Autocomplete:

    Tag Autocomplete File - this is currently only covering the pre-3M dataset. I am working on building a new one, but there's 35k conflicting tags I have to manually verify and correct.

    Two Epoch Numbers?

    First number is continuous from the start of training.

    Second number is from when that specific line was forked.

    Example: fluffyrock-576-704-832-960-1088-lion-low-lr-e101-terminal-snr-vpred-e74

    101st checkpoint from the start of the 1088 multires.This is the total epochs.

    74th checkpoint since terminal-snr was forked and the number of epochs done on tsnr. (vpred was most likely forked off at e20-e21.)

    Troubleshooting:

    Output looks bad:

    Do not sample at 512x512. Use 768 or greater. Going past 1088 may result in the typical SD1.x highres anomalies. High-res-fix and other similar methods work well to easily achive 2k+ resolutions.

    Prompt some art styles. Use some "by [e6 artist tag without underscores]". For better results, prompt several. Use of A1111's prompt-editing feature works really well for creating unique styles.

    The concept of some tags, while known to the known, had either too few samples or too much of samples had heavy bias. Training a custom LoRA for the concept is usually a good way to get a concept to preference.

    VPred troubleshooting:

    Output just noise/cloud: Missing config file.

    Output too dark: Turn up cfg rescale. Usually 0.7-0.9 seems to work best.

    Some samplers may not work as cfg rescale support is not complete as of yet. See discord thread for latest discussion on this.

    Training LoRAs:

    Previously, e27 was more recommended as the model to train against as the results would be more portable to the other FR model branches at the time. This is outdated.

    LoRA's trained on any recent line of FR have had decent portablity between other model lines in my personal experience. But training against the model you plan to sample is going to likely have the best results.

    Noise-offset models may require training with noise offset >0 to have good results, though these LoRAs may not work well on other models that do not use noise offset. Start with 0 and check results. The offset-noise models are pretty outdated now and you likely want to consider a newer model line.

    Terminal-SNR (non-vpred) models require nothing special.

    vpred requires training with v_parameterization enabled. kohya_ss will complain about using that on v1, ignore that, nobody expected people would train SD1.5 with v-prediction.

    LoRAs trained on non-vpred FR models will likely work.

    Ask in the Discord for help.

    Tag Autocomplete File

    Hugging Face Repo Contains every version of every model line. Full git clone of the repo will require >1.5TB disk space, you have been warned.

    FluffyRock Discord Server

    Furry Diffusion Discord Server and the FR thread there

    LodestoneRock's Patreon Help support them with the cost of training.

    License: WTFPL

    wtfpl-badge-1

    Due to Civitai's on-site gen being broken (for at least these models), I've had to set the commercial use to an incorrect value to disable the annoying "Create" button. You can use the models on gen service, we don't care, but it would be cool if it actually works. :V

    Apparently it works now except with vpred models.

    Description

    fluffyrock-1088-megares-terminal-snr-vpred

    fluffyrock-576-704-832-960-1088-lion-low-lr-e184-terminal-snr-vpred-e157

    FAQ

    Comments (16)

    D00derinoSep 11, 2023
    CivitAI

    Is there a review or comparison somewhere of the different branches, as well as the way they changed through iterations?

    Or are the most recent epochs in the most recent branches always so clearly superior there's not much of a point to that?

    ____NULL____Sep 11, 2023

    they post all of their model checkpoints for every single epoch on huggingface.co I only see them upload on here every so often; to which I would assume the model posted here is better than the prior.

    WithoutOrdinary
    Author
    Sep 11, 2023

    Civitai has been having a ton of issues the last couple months and I haven't been able to upload new checkpoints as often as I have wanted. This single last one took over 3 hours of trying to get up and over an hour to upload.

    The HF repo has all of them if you want to compare, but it will take around 4TB to clone the whole repo, or 1.5TB for just the current model lines.

    No one model line is "best" since art is subjective and there are a lot of parameters in play. The original vpred model is likely the most knowlegable since it has had the most training. PolyFur and e6laion (not uploaded on Civitai yet) have a different aesthetic and style than the others due to additional (and different from each other) datasets, which also increases their training time per full pass.

    I'm hoping to get e6laion up soon, Civitai reliability mostly being the limiting factor. I'm checking with the rest of the team about posting PolyFur here. Both will be separate posts though since they are quite different from others I've smashed in to this current post.

    UnpopularNobodyNov 11, 2023· 9 reactions
    CivitAI

    Following up on a previous comment from a few months back. I'm still having a lot of trouble getting this model to work properly as the instructions for the config file and CFG rescale are incredibly vague, there is nothing specifying where either of these are supposed to go. For the record, I am trying to get this to work with EasyDiffusion.

    WithoutOrdinary
    Author
    Dec 10, 2023· 1 reaction

    I have never heard of EasyDiffusion before, I have no idea how to use it or if it can work. The linked extensions are specifically for the A1111 WebUI.

    Sorry I don't check comments too often. Civitai's website runs extremely poorly lately and its actively painful to use till the fix some of these sever performance bugs.

    BizzAINov 21, 2023· 5 reactions
    CivitAI

    the amount of dedication your putting towards this is awesome nice work :D

    deygdrixe221Nov 22, 2023· 3 reactions
    CivitAI

    Much appreciation to the author for the model. I hope you don't mind, I'm using the base in my merge, as the generation requires less work with promts and is well compatible with authors. I don't think we should stop at e621 alone. It would be very nice if the dataset also included images of rule 34 and gelbooru. The model is out of competition for me now. The quality level is even higher than the top 10 on Civitai! In the future I will train all my LORAs on the basis of this particular model!

    MobbunNov 27, 2023

    A furry+anime model is maybe something that can happen down the line(I've seen the author mention it, but they're working on other stuff). E6laion already exists, but that's furry+anime+LAION dataset. The LAION dataset is base SD. It fights the knowledge of the first 2. I wouldn't hold out hope for a rule34 model. The tagging on that website is atrocious. You'd have to train a good autotagger and run it through the dataset. Problem is that there isn't one that's good enough that's public and can handle NSFW.

    WithoutOrdinary
    Author
    Dec 10, 2023

    I do have some E6laion checkpoints uploaded on Civitai. Further training on E6laion has stopped though, I believe due to not quite having the desired outcome and is one of the things being worked on.

    CuauhtemocI5MALNov 27, 2023· 17 reactions
    CivitAI

    Will be there a XL version of this?

    I'm asking this because E621 Rising XL exists but it cannot be used in online services, and I would like to see a furry themed XL model that actually operates with e621 tags and can be used in online services, thing that according with my point of view don't happen with Furry Art Fantasy XL Mix.

    inflatebotDec 9, 2023

    From what I've seen, it's in the works, but the trainer Lodestone is using for it needs fixing first. I also really want one because the coolest stuff I've seen has been coming from the XL side of things

    WithoutOrdinary
    Author
    Dec 10, 2023· 2 reactions

    Yeah, Lode is still working on training scripts. Fluffyrock uses different methods for training than what base SD uses. There is also work going on with the datasets to improve those. No training on XL has started yet, so there is no ETA, but there should be a XL version eventually, unless some new and better type of SD comes out before then. :V

    sdfsdfsdf234Dec 29, 2023

    @WithoutOrdinary Any update on the XL version?

    RedRascalNov 27, 2023· 2 reactions
    CivitAI

    Does Fluffyrock support artist tags that aren't in the excel spreadsheet?

    WithoutOrdinary
    Author
    Dec 10, 2023

    Check the 3.5M autocomplete tag list linked in the resources section and the notes on what is excluded there.

    Without know specifically what artist, general answer is maybe. Its possible the sample rate is too low to do much of anything, or the bulk of their content falls under the excluded tags and results in the first thing.

    inflatebotDec 30, 2023· 1 reaction

    In general, the best response to questions like this is "give it a go".

    Checkpoint
    SD 1.5

    Details

    Downloads
    5,744
    Platform
    CivitAI
    Platform Status
    Available
    Created
    9/11/2023
    Updated
    5/4/2026
    Deleted
    -

    Files

    Available On (1 platform)

    Same model published on other platforms. May have additional downloads or version variants.