<h1 id="what-is-this">What is this?</h1><p>A tool for using JSON with Anima. This model does not require JSON, however it does provide added beneficial control WITH JSON while simultaneously being capable at many new plain English prompting capacities that were quite weak or non-existent before.</p><p>The trigger word is NOT the exact token "JSON", it's literal json in string form.</p><h1 id="prompt-directly">Prompt Directly</h1><p>Use <span style="color:rgb(250, 176, 5)">JSON </span>&gt; <span style="color:rgb(250, 176, 5)">ENGLISH &gt; </span><span style="color:rgb(230, 73, 128)">BOORU</span>.</p><p>You will get the best yield in this order. You can swap booru for english if you get hallucinations.</p><p>The model was trained with both english and booru json, so the processing should be okay.</p><h2 id="90k-brent-e1+e2-1.0">90k Brent E1+E2 1.0</h2><p>Temporary version, will be replaced with the full 1.0 train. All epochs available on huggingface.</p><p><a target="_blank" rel="ugc" href="https://huggingface.co/AbstractPhil/anima-90k">https://huggingface.co/AbstractPhil/anima-90k</a></p><p>This is only the VLM half, that only ran for about 1 epoch. The plan is 2 epochs VLM and 1 epoch animetimm. That should be enough. The final version will be uploaded tonight.</p><p>Have fun.</p><h2 id="epoch-2-release">Epoch 2 Release</h2><p>The version is stronger and more capable while still containing the majority of the original model. More robust and capable than v1 and better at plain English.</p><h2 id="epoch-3-time-stage">Epoch 3 Time Stage</h2><p>Epoch 3 is roughly 375,000 samples, which will be the full subject bucketing system imposed only on the animetimm system. This has shown the most robust capacity with this model, while still learning the plain English associations necessary to use more Qwen than before.</p><p>This will take roughly 74 hours, so by next weekend I'll have everything worked out for a full comfyui release.</p><h2 id="10k-brent-v0.5">10k Brent V0.5</h2><pre><code>{
"subjects": [
{
"name": "subjects name here",
"attributes": ["attributes", "go", "here however you want to divide them"],
"actions": ["actions go here", "in english or broken sequences"],
},
],
"setting": "supports settings",
}

Down here reinforce the system with plain english like this, explain the system and situation.

1girl, here, do, the, booru, tags, like how, you, would,</code></pre><p>Probably doesn't need to be perfect, can likely jank it and it will not care if the json is valid.</p><p>Add up to 8 subjects, bounding boxes not supported yet, semantic offset is partially working, and associative offset is partially functional.</p><p>Attributes hallucinate without reinforcement with the booru tags, for now.</p><p>Will bias QWEN more heavily the higher the strength is for this version.</p><h3 id="strengths">Strengths</h3><p>Handles low step or high step models fairly well. Reduce strength for low steps and you'll still get some use of the json.</p><h3 id="weaknesses">Weaknesses</h3><p>Attributes hallucinate. Actions hallucinate. Names are pretty good.</p><h2 id="1k-brent-(preview)">1k Brent (Preview)</h2><p>Similar format as the V0.5.</p><p>Booru tags MORE critical. Different biases</p><h3 id="weaknesses">Weaknesses</h3><p>Strong, but will bias a different array of images. More rigid and smaller array.</p><p>Text has problems, increase strength to the negative if you have large problems.</p><p></p><h1 id="brent-10k-v0.5-release">Brent 10k V0.5 Release</h1><p>Fully revamped trainer; a forked diffusion-pipe with a considerably faster parquet processing pipeline.</p><p><a target="_blank" rel="ugc" href="https://github.com/AbstractEyes/diffusion-pipe/tree/feat/parquet-hf-dataset-backend">https://github.com/AbstractEyes/diffusion-pipe/tree/feat/parquet-hf-dataset-backend</a></p><p>Instead of the anima trainer.</p><p><a target="_blank" rel="ugc" href="https://huggingface.co/datasets/AbstractPhil/diffusion-pretrain-set-ft1">https://huggingface.co/datasets/AbstractPhil/diffusion-pretrain-set-ft1</a></p><p>10,000 images instead of 1000.</p><p>I ran too many epochs, however the balanced train will allow the model to operate on lower strength. The next run will be considerably more images, a higher diversity in images, a better character controller, a higher complexity yield for json capacity, and a much larger complexity with json prompts.</p><h2 id="subject-bucketing-upgrade">Subject Bucketing upgrade</h2><p>The bucketing system handles roaring fast speeds and a shared grab-bag capacity for buckets which both reduces prep time and still produces more images than the model can ingest on 4 gpus. The parquet processing pipeline processes images considerably faster and still handles AR bucketing at lightning speed, all because of the random grab-bag processing capacity of the parquet system.</p><h2 id="improved-cache">Improved Cache</h2><p>The original caching system is quite improved now, converted to parquet processing that easily capped the 4 a40 gpus with 100% processing.</p><h2 id="more-data">More Data</h2><p>A much larger train of 10,000 dual-prompted images. Repeats are based on both buckets and their subject selectiveness frequency.</p><h2 id="suggested-use">Suggested Use</h2><p>I suggest reduced strength which will still promote the lora's strength without introducing the QWEN biases as strongly.</p><p>I've included trigger prompt assistance for using the built in subject format.</p><h1 id="brent-1k-(preview)-release">Brent 1k (PREVIEW) Release</h1><p><a target="_blank" rel="ugc" href="https://github.com/AbstractEyes/anima-trainer">https://github.com/AbstractEyes/anima-trainer</a></p><p>Trained with the same trainer as Anima was trained with originally - diffusion-pipe, snapped together with a new dataset organization system so I could run it in either Runpod or notebooks.</p><p><a target="_blank" rel="ugc" href="https://huggingface.co/datasets/AbstractPhil/diffusion-pretrain-set-ft1">https://huggingface.co/datasets/AbstractPhil/diffusion-pretrain-set-ft1</a></p><p>This is 1k images randomly sampled and subject-bucketed from the 80k image dataset "qwen_90k" that will be trained next.</p><p><a target="_blank" rel="ugc" href="https://huggingface.co/AbstractPhil/Qwen3.5-0.8B-json-captioner">https://huggingface.co/AbstractPhil/Qwen3.5-0.8B-json-captioner</a></p><p>Each of the images were captioned using the VLM's VIT for a JSON outputted system and additionally a variant of AnimeTIMM VIT also captioned and then processed into JSON as well.</p><p>12 epochs on the VLM JSON captions, same images back in for 8 more epochs with AnimeTIMM JSON. This is the results from subject-bucketing with json.</p><h1 id="more-specifically">More specifically</h1><p><a target="_blank" rel="ugc" href="https://huggingface.co/blog/AbstractPhil/subject-bucketing">https://huggingface.co/blog/AbstractPhil/subject-bucketing</a></p><p>This is a subject-bucket trained JSON finetune.</p><p>The specific targets are meant to provide better accuracy and more fidelity to finetunes experimentally while simultaneously training a proof-of-concept paradigm related to subject-bucketing.</p><h1 id="tldr-subject-bucketing">TLDR Subject Bucketing</h1><p>Dataset, balancing. Normally you end up with a series of, problems from finetunes. Breakpoints, kinks, issues, distortions, faults, and so on.</p><p>This is meant as an experiment to solve those exact problems. By finetuning a model with JSON, you provide a form of differentiated perspective to the AI. By grouping subjects to a more complex paradigm as stated in the article - the differentiation becomes robust.</p><h1 id="a-little-longer-still-short.">A little longer, still short.</h1><p>Each token separator is another format of language that QWEN already understands and recognizes. The more you combine in sequence, the more QWEN will understand this process - providing more utilizable structure to the diffusion system.</p><p>With robust and orderly encodings provided to the diffusion system that include differentiated lesser-used tokens in conjunction with more common-use tokens, the more powerful the training results in useful outcomes.</p><h1 id="why">Why?</h1><p>The smaller-scale non-bucketed variants were successful, so it's time to train the real thing. The tool itself, and the tool yields.</p><p>Now the first 1k image train for the direct tool has been successful. The results are yielding and powerful. This merits a full uptick in training.</p><p></p>

Anima - JSON+English

Files with SHA256: e9893acca27e9aaec58f43d32c85fc569a231bafca78a8c4850c7c9b822dffc2