<img src="https://image.civitai.com/xG1nkqKTMzGDvpLrqFT7WA/d4b9430c-f0a7-4a36-bdb4-faedf2b53aa9/original=true/d4b9430c-f0a7-4a36-bdb4-faedf2b53aa9.jpeg" />## I. IntroductionMageTrail is a Danbooru/E621 proof of concept Full-Finetune of Microsoft's MageFlow 4B T2I model, now 2.8B custom architecture, using a diversity maximized condensed 41k images dataset as a way to tune booru concept and tags based prompting + Illustration capabilities into the model without having to tune with the full booru dataset.(which would have cost 50k+ dollars, no thanks).Starting from V0.25 onward, the model is now a completely new architecture due to being trimmed down to 2.8 billion parameters. This help the model become near SDXL/Anima range of availability for all users, with faster gen time and lower vram usage for finetuning/LoRA training. The trimming was done by <a target="_blank" rel="ugc" href="https://huggingface.co/Bluvoll/MageTrail-Shared-AdaLN-SVD">Bluvoll/MageTrail-Shared-AdaLN-SVD.</a>Please scroll down to the generation recommendation section to download the required custom node.The model is now also supported for easy consumer LoRA training/Finetuning through <a target="_blank" rel="ugc" href="https://github.com/bluvoll/mage-flow-trainer">bluvoll/mage-flow-trainer: A trainer for Mage-Flow with SDNQ support.</a>My second attempt at fine-tuning an image model on larger scale, this finetune aim to prove to the open source community on MageFlow 4B having good potential as an architecture for further finetuning.~ V0.1 to V0.3 have spent 593 dollars and has ultimately shown the model potential in quickly learning and adapting booru concept and tags to its knowledge base, but has outgrown its limited 41k dataset, V0.4 is a 20 dollar 100 artist test run to validate the model ability to learn artist style and adapt to the new Flux2VAE, which it achieve outstandingly when considering the budget used.~ The architecture behind MageFlow 4B shows good promise for further investment:* Being 15-20% faster than NVIDIA Cosmos2/Anima on inference despite being 2 billion parameters larger* From V0.3 onwards, new discovery have prove the model is completely compatible with Flux2VAE (the current best open source VAE available) in training with some code changes, meaning the architecture is now COMPLETELY a Flux2VAE arch, without needing any money to do a realignment tune to new vae.* Having a decent Qwen 3 VL 4B Text Encoder* 256-2048 pixels resolution native support* Being fairly quick to learn and adapt to new knowledge without any knowledge forgettingFuture goal for the project:***BIG GOAL***: Due to <a target="_blank" rel="ugc" href="https://huggingface.co/Muinez/mage-flow-ft">Muinez/mage-flow-ft </a>, I now completely believe in MageFlow being the next best small scale arch to replace Anima in the Illustration sphrere, the model has shown to have the ability to learn concepts/characters/styles efficiently while being a superior architecture. I pledge to finetune a Anima successor if given 25k-100k dollars of funding from the open source community/any generous patrons.SMALL GOAL: Gather funding of 1000-5000~ dollars to finetune 10k-100k artist styles into the model (200k-3 million images finetune, planned V0.4-V1) and help further with convergence/aesthetic improvement if the aforementioned big goal above hasn't been reached.Any donation will help with achieving this goal, you can do so through:Crypto (Prefered, cause Kofi/Paypal money transfer time is ass and they take a big cut)0x6a4bc748cd0bb9ced9a360eb0eb79f4f106614f8 (USDT - BEP20 Network)12PPVYUeS1MerNp38Tpns5qXR6cmhu9tws (Bitcoin - BTC Network)0x6a4bc748cd0bb9ced9a360eb0eb79f4f106614f8 (Ethereum - ERC20 Network)FitfJAsxLUBuSgDJJaHgBXJpt1sMm5FzF1Tvf1SHW5Up (Solana - SOL network)Please handle your money carefully and make sure the address you're sending to is correct.Please contact me through discord (user: <span style="background-color:oklab(0.26239 0.00252313 -0.00890189);color:oklab(0.988078 0.0000451207 0.0000197291);font-family:&quot;gg sans&quot;, &quot;Noto Sans&quot;, &quot;Helvetica Neue&quot;, Helvetica, Arial, sans-serif;font-size:14px">talannnn) if you're donating with crypto, to make sure it goes through and you're not losing money.Ko-fi<a target="_blank" rel="ugc" href="https://ko-fi.com/talanartvn**">https://ko-fi.com/talanartvn</a>## II. Model DetailsBase model: <a target="_blank" rel="ugc" href="https://huggingface.co/mage-flow-community/Mage-Flow">Microsoft's MageFlow 4B T2I</a>Modified Base model: <a target="_blank" rel="ugc" href="https://huggingface.co/Bluvoll/MageTrail-Shared-AdaLN-SVD">MageTrail-Shared-AdaLN-SVD</a>Method: Full-FinetuneTrainer:<a target="_blank" rel="ugc" href="https://github.com/RicemanT/diffusion-pipe-mageflow-ft">RicemanT/diffusion-pipe-mageflow-ft</a>(From V0.4 onwards)<a target="_blank" rel="ugc" href="https://github.com/RicemanT/mage-flow-trainer">RicemanT/mage-flow-trainer: A trainer for Mage-Flow with SDNQ support.</a>Hardware: H100 HBM3 80GB, rented with Banodoco sponsor and donation from the communityTotal training time: 64 (v0.1) + 92 (v0.2) + 269 (V0.3) of H100 hoursTotal samples seen: 8.1~ million (v0.1-v0.3)Training resolutions : 1024²## Training run## Version 0.1 (initial 20 epoch run → extended 10 epoch run)Budget: 130~ dollars (25-30 lost due to experiments and mistakes)Full config: <a target="_blank" rel="ugc" href="https://github.com/RicemanT/model-training-configs/blob/main/diffusion-pipe/MageFlow/configs/V0.1/mage_flow_BooruEssenceFFT.toml">Training</a> and <a target="_blank" rel="ugc" href="https://github.com/RicemanT/model-training-configs/blob/main/diffusion-pipe/MageFlow/configs/V0.1/mage_flow_BooruEssenceDataset.toml">Dataset</a>- Learning rate: 7e-6- LR scheduler: Warmup -&gt; Constant -&gt; REX to 0e-7- Precision: Full BF16- Optimizer: AdamW8bit with Kahan summation (to offset BF16 precision roundoff)- Weight decay: 0.02- Timestep sampling: Logit-Normal, shift 6, sigmoid scale 1.0## Version 0.2 (70 epoch continuation)Budget: 143~ dollarsFull config: Same as v0.1, just with changed lr due to only using x4 gpu instead of x8- Learning rate: 5e-6- LR scheduler: Warmup -&gt; Constant -&gt; REX to 0e-7- Precision: Full BF16- Optimizer: AdamW8bit with Kahan summation (to offset BF16 precision roundoff)- Weight decay: 0.02- Timestep sampling: Logit-Normal, shift 6, sigmoid scale 1.0### Version 0.3 (100 epoch final continuation)Budget: 350~ dollarsFull config: Same as v0.2, but on x1 cheap H100 to save cost- Learning rate: 5e-6- LR scheduler: Warmup -&gt; Constant -&gt; REX to 0e-7- Precision: Full BF16- Optimizer: AdamW8bit with Kahan summation and fixed weight decay feature (it was actually broken before, really bad oversight from me)- Weight decay: 0.02- Timestep sampling: Logit-Normal, shift 6, sigmoid scale 1.0### Version 0.4 (6k images 100 artist tune for testing purposes)Budget: 30~ dollars (10 lost due to mistakes and training program bug)Full config:<a target="_blank" rel="ugc" href="https://huggingface.co/RicemanT/MageTrail/blob/main/V0.4/mageflow-5k-lr2e5-512.toml">V0.4/mageflow-5k-lr2e5-512.toml</a><a target="_blank" rel="ugc" href="https://huggingface.co/RicemanT/MageTrail/blob/main/V0.4/mageflow-5k-lr2e5-1024.toml">V0.4/mageflow-5k-lr2e5-1024.toml</a>## Additional training features- Tag dropout: 10%- Caption dropout: 5%- Mixed captions at 25/25/25/25 ratio (tags only, NL only, tags-nl, nl-tags)- Tag shuffle- Caption shuffle- Artist trigger attribution system## III. Recommended Settings<img src="https://image.civitai.com/xG1nkqKTMzGDvpLrqFT7WA/25cdd862-ddda-4954-9f18-1aec42673906/original=true/25cdd862-ddda-4954-9f18-1aec42673906.jpeg" />From V0.25 onwards, the model require downloading the <a target="_blank" rel="ugc" href="https://github.com/bluvoll/ComfyUI-MageFlow-Compressed">bluvoll/ComfyUI-MageFlow-Compressed custom node. </a>The model is not supported in any other UI currently. These are the settings used for the sample images above (ComfyUI):- Shift: 5.0 (or ComfyUI default)- Steps: 50 (or 30 for faster gen speed)- CFG: 8 (or 5 for faster gen speed with step 30 above)- Sampler: <code>er_sde</code> or <code>euler</code>- Scheduler: <code>simple</code> or <code>beta</code>These are just my usual settings and workflow — feel free to experiment.From V0.4 onwards, the model now include usage of quality tags, you usually want to add them at the end of the tag section of prompt, they are:masterpiece, best quality, very aesthetic, aestheticArtist Trigger: This model use the Drawn by artistname trigger, if you want to use the model built-in artist tag, please always put one at the start of your prompt. (Currently V0.4 support 100 artist, please download to see, <a target="_blank" rel="ugc" href="https://huggingface.co/RicemanT/MageTrail/blob/main/V0.4/MageTrail-V0.4-artists.csv">MageTrail-V0.4-artists.csv</a>).Tagging System: This model support both danbooru and e621 tag prompting, although currently due to the model being severely undertrained alot of tags and concept are not working properly yet. Tags only and NL only prompt both work, but the model perform better with mixed prompting and clearer/slightly longer prompt.Example prompt: Drawn by nyatcha, m200 (girls' frontline), 1girl, :t, backpack, bag, binoculars, building, city, crane (machine), crossed bangs, crossed legs, feet out of frame, grey jacket, headset, holding, holding binoculars, jacket, long sleeves, messy hair, pout, short hair, sidelocks, sitting, solo, star (symbol). Set in a panoramic, dense futuristic cityscape during dusk, M200 from Girls' Frontline sits perched near an elevated railing on the right side of the frame with her legs crossed. She has short, messy grey hair with crossed bangs and sidelocks, wearing an olive-grey communication headset over her ears. She is dressed in a bulky, layered dark grey military jacket with long sleeves and carries a tactical backpack with mechanical gear protruding over her shoulder, resting both hands in front of her while holding a pair of compact black binoculars. The bustling urban backdrop features towering, dark multi-story architecture filled with glowing square windows, exposed steel framing, rooftop antennas, and a large red construction crane against a hazy, overexposed bright sky. Cars with gleaming roofs pass below the railing amidst the muted industrial color palette of beige, black, and amber lighting.## IV. Dataset<a target="_blank" rel="ugc" href="https://huggingface.co/datasets/RicemanT/booru-essence-2026">Booru-Essence-2026-41k images</a>Originally created by Lodestone Rock, the dataset was updated to 2026 tag standard and captioned with SOTA API captioners, see dataset repo for details.Model training, Dataset and Captioning tooling lives in the <code>utils</code> folder](<a target="_blank" rel="ugc" href="https://github.com/RicemanT/model-training-configs/tree/main/diffusion-pipe/MageFlow/utils">https://github.com/RicemanT/model-training-configs/tree/main/diffusion-pipe/MageFlow/utils</a>) of the training repo.---## VI. Notes from the Training DiaryFull training diary: <a target="_blank" rel="ugc" href="https://github.com/RicemanT/model-training-configs/blob/main/diffusion-pipe/MageFlow/notes/MageTrail-diary.md">MageTrail-diary</a>---## VII. LicenseThis model is a Derivative of Microsoft's MageFlow and is distributed under the same [MIT License](<a target="_blank" rel="ugc" href="https://choosealicense.com/licenses/mit/)**">https://choosealicense.com/licenses/mit/)</a> as the base model, with no additional restrictions.---## VIII. AcknowledgmentsBeeg thanks to:- [Banodoco](<a target="_blank" rel="ugc" href="https://www.banodoco.ai/">https://www.banodoco.ai/</a>) and [their Discord](<a target="_blank" rel="ugc" href="https://discord.gg/yzwcNaSEz">https://discord.gg/yzwcNaSEz</a>) — Their 88.77 dollar initial grant and future made this project possible, the biggest thanks to them- [Lodestone Rock](<a target="_blank" rel="ugc" href="https://huggingface.co/lodestones">https://huggingface.co/lodestones</a>) — Creator of the original version of the dataset that this model is trained on- [Motimalu](<a target="_blank" rel="ugc" href="https://civarchive.com/user/motimalu">https://civarchive.com/user/motimalu</a>) — Inspiration behind finetuning practices and configs- [Bluvoll](<a target="_blank" rel="ugc" href="https://github.com/bluvoll/diffusion-pipe">https://github.com/bluvoll/diffusion-pipe</a>) — diffusion-pipe fork derived from to use for training, and general training advice- [Anzhc](<a target="_blank" rel="ugc" href="https://huggingface.co/Anzhc">https://huggingface.co/Anzhc</a>) — general training advice- [Nruaif](<a target="_blank" rel="ugc" href="https://huggingface.co/Shio-Koube">https://huggingface.co/Shio-Koube</a>) — diffusion-pipe fork derived from to use for training, and general dataset handling/training advice- [Astromahdi](<a target="_blank" rel="ugc" href="https://gpu.garden/">https://gpu.garden/</a>) — jupyter workspace where I processed and store the dataset- [Heato-Red](<a target="_blank" rel="ugc" href="https://www.reddit.com/user/heato-red/">https://www.reddit.com/user/heato-red/</a>) — Designer of model page logo- [animetimm/DeepGHS](<a target="_blank" rel="ugc" href="https://huggingface.co/animetimm/convnextv2_huge.dbv4-full">https://huggingface.co/animetimm/convnextv2_huge.dbv4-full</a>) — Danbooru tagging model- [RedRocket](<a target="_blank" rel="ugc" href="https://huggingface.co/RedRocket/Hydra">https://huggingface.co/RedRocket/Hydra</a>) — E621 tagging model

MageTrail 2.8B (Danbooru/E621 Finetune) Based on MageFlow

Small 6k image 100 artist finetune to test the model capabilities on learning multi styles. This version is also the first one to be trained on Bluvoll MageFlow trainer, which now support training the model to adapt completely to FLUX2VAE!!!!! poggers, i can kinda see the crispness even in this severely undertrained state, hopefully i can push it further with V0.5.

Files with SHA256: 085535e6499d30083bcbc2060c112dc41ec8710f79831dea5f7ac5f897c3cd00