这是从 indigoFurryMixAnima_v10 相对于 anima_baseV10 的完整模型差分中提取出的高质量自适应 Rank LoRA。

本模型不是通过图片数据集重新训练得到的传统 LoRA，而是通过比较原始基模与目标微调模型的权重，计算两者之间的参数差分，再使用分层低秩分解将差分压缩为 LoRA。

其目标是在保留较多原模型特征的同时，将完整微调模型转换成更方便加载、组合和调节强度的 LoRA 格式。

## 基础模型

推荐搭配：

- anima_baseV10.safetensors

- Anima Base v1.0 系列兼容模型

使用精确的原始 anima_baseV10 时，LoRA 强度 1.0 最接近原始 indigoFurryMixAnima_v10 的模型差分。

使用其他 Anima 派生模型、量化模型或混合模型时，最终效果可能发生变化。

## 推荐参数

- Model Strength0.85–1.0

- 推荐起始值0.9

- 精确原始基模1.0

- CLIP Strength0

- 触发词：无

强度参考：

- 0.6–0.75：效果较轻，更多保留当前基模特征

- 0.8–0.9：自然、稳定，适合大多数生成场景

- 1.0：最接近原始微调模型的差分强度

- 1.05–1.1：增强模型特征，但可能出现过度强化或结构失真

- 不建议高于 1.1

这是模型差分提取 LoRA，不依赖训练触发词。直接使用正常的 Anima 提示词即可。

## 提取方法

首先对两个结构一致的 Anima 模型逐层计算：

ΔW = W_tuned − W_base

其中：

- W_base 为 anima_baseV10

- W_tuned 为 indigoFurryMixAnima_v10

- ΔW 为需要通过 LoRA 重建的模型差分

对于二维权重矩阵，使用 torch.svd_lowrank 进行低秩分解：

ΔW ≈ LoRA_Up × LoRA_Down

计算阶段使用 FP32，最终 LoRA 权重以 FP16 保存。

对于偏置、归一化权重等非二维参数，不进行低秩压缩，而是保存为精确差分，以减少低维关键参数的信息损失。

## 自适应 Rank 设计

本模型没有对所有层使用相同 Rank，而是根据不同模块的重要性和参数规模分配 Rank：

- Attention：Rank 256

- MLP：Rank 128

- AdaLN 调制层：Rank 64

- LLM Adapter：Rank 64

- Embedding / Final：Rank 32

- 其他二维层：Rank 32

- 一维权重及偏置：精确差分

Attention 是原模型差分能量最集中的部分，因此分配了最高 Rank。MLP、AdaLN、LLM Adapter 和嵌入层则采用不同 Rank，在质量、文件大小和加载开销之间取得平衡。

SVD 参数：

- 算法torch.svd_lowrank

- Oversampling：16

- Power Iterations：4

- 固定随机种子：20260721

## 完整数值验证

最终文件经过完整 FP16 重建验证，而不是仅对部分矩阵进行抽样估计。

二维权重总体差分保留率：

- 总体二维差分：73.66%

- 主 Attention：80.68%

- AdaLN：88.17%

- Embedding / Final：52.82%

- LLM Adapter：33.46%

- 主 MLP：32.48%

- 非二维差分：接近 100%

这里的“保留率”是基于差分矩阵平方 Frobenius 范数计算的数值能量保留率，并不等同于相同百分比的主观画质。

由于原模型的大部分差分能量集中在 Attention，而 Attention 的实际保留率达到 80.68%，因此总体视觉和行为还原通常会优于单独观察 MLP 保留率所得出的印象。

## 文件结构

最终文件包含：

- 516 个 LoRA Up 矩阵

- 516 个 LoRA Down 矩阵

- 90 个精确权重差分

- 13 个精确偏置差分

- 共 1135 个 FP16 张量

源模型共有 685 个共同参数张量，其中：

- 619 个张量发生变化并被提取

- 66 个张量保持不变

最终文件大小约为 675.10 MiB。

## FP8 与量化模型说明

不建议在使用该 LoRA 时强制启用以下全局 FP8 参数：

- --fp8_e4m3fn-unet

- --fp8_e4m3fn-text-enc

- 裸的 --fast

这些参数可能将需要应用 LoRA 的权重强制转换为 FP8，进而引发 stochastic_rounding_fp8addmm_cuda 或 LoRA 权重写入错误。

混合精度量化模型可以尝试使用，但建议保持：

- 模型手动计算类型为 FP16

- FP16 accumulation

- 不强制全局 FP8

该 LoRA 已在混合精度量化 Anima 模型、FP16 manual cast 模式下完成实际采样测试。

## 已知限制

- 这是高质量低秩近似，并非原始完整微调模型的无损转换。

- MLP 和 LLM Adapter 中仍存在无法由当前 Rank 完整表达的高秩残差。

- 使用非原始 Anima 基模时，LoRA 差分会叠加在不同权重上，效果不一定等同于原始模型。

- 由于采用了较高 Attention Rank，文件明显大于普通角色或画风训练 LoRA。

- 如果需要最准确地还原原始模型，请使用 anima_base 并将模型强度设为 1.0。

This is a high-quality adaptive-rank LoRA extracted from the complete model delta between indigoFurryMixAnima_v10 and anima_baseV10.

Unlike a conventional LoRA trained from an image dataset, this model was created by comparing the weights of the original base model and the target fine-tuned model, calculating the parameter differences between them, and compressing those differences into LoRA form through layer-wise low-rank decomposition.

The goal is to preserve as many characteristics of the original fine-tuned model as possible while converting it into a LoRA format that is easier to load, combine with other models, and adjust in strength.

Base Model

Recommended base models:

• anima_baseV10.safetensors

• Models compatible with the Anima Base v1.0 series

When used with the exact original anima_baseV10, a LoRA strength of 1.0 provides the closest approximation to the original indigoFurryMixAnima_v10 model delta.

When used with other Anima-derived models, quantized models, or merged models, the final result may differ.

Recommended Settings

• Model Strength: 0.85–1.0

• Recommended Starting Strength: 0.9

• Exact Original Base Model: 1.0

• CLIP Strength: 0

• Trigger Words: None

Strength reference:

• 0.6–0.75: Lighter effect, preserving more characteristics of the currently loaded base model

• 0.8–0.9: Natural and stable; suitable for most generation scenarios

• 1.0: Closest to the full delta of the original fine-tuned model

• 1.05–1.1: Strengthens the model’s characteristics, but may cause overemphasis or structural distortion

• Strengths above 1.1 are not recommended

This is a model-delta extraction LoRA and does not rely on training trigger words. Standard Anima prompts can be used directly.

Extraction Method

The parameter delta was first calculated layer by layer between two Anima models with identical architectures:

ΔW = W_tuned − W_base

Where:

• W_base is anima_baseV10

• W_tuned is indigoFurryMixAnima_v10

• ΔW is the model delta to be reconstructed through LoRA

For two-dimensional weight matrices, torch.svd_lowrank was used for low-rank decomposition:

ΔW ≈ LoRA_Up × LoRA_Down

All calculations were performed in FP32, and the final LoRA weights were saved in FP16.

Non-two-dimensional parameters, including biases and normalization weights, were not compressed through low-rank decomposition. Instead, their exact deltas were stored directly to reduce information loss in low-dimensional but potentially important parameters.

Adaptive-Rank Design

This model does not use a uniform rank for every layer. Ranks were assigned according to the importance and parameter scale of each module:

• Attention: Rank 256

• MLP: Rank 128

• AdaLN modulation layers: Rank 64

• LLM Adapter: Rank 64

• Embedding / Final layers: Rank 32

• Other two-dimensional layers: Rank 32

• One-dimensional weights and biases: Exact deltas

Attention contains the highest concentration of delta energy in the original model, so it was assigned the highest rank.

MLP, AdaLN, LLM Adapter, and embedding layers use different ranks to balance reconstruction quality, file size, and loading overhead.

SVD parameters:

• Algorithm: torch.svd_lowrank

• Oversampling: 16

• Power Iterations: 4

• Fixed Random Seed: 20260721

Complete Numerical Validation

The final file was validated through full FP16 reconstruction rather than by estimating reconstruction quality from a sample of selected matrices.

Overall two-dimensional delta-energy retention:

• Overall 2D delta: 73.66%

• Main Attention layers: 80.68%

• AdaLN: 88.17%

• Embedding / Final layers: 52.82%

• LLM Adapter: 33.46%

• Main MLP layers: 32.48%

• Non-2D deltas: Approximately 100%

The term “retention” refers to the amount of numerical energy retained, calculated from the squared Frobenius norm of the delta matrices. It does not correspond directly to the same percentage of perceived visual quality.

Because most of the original model’s delta energy is concentrated in the Attention layers, and the Attention reconstruction retains 80.68% of that energy, the overall visual and behavioral reconstruction will generally be better than the MLP retention percentage alone might suggest.

File Structure

The final file contains:

• 516 LoRA Up matrices

• 516 LoRA Down matrices

• 90 exact weight deltas

• 13 exact bias deltas

• 1,135 FP16 tensors in total

The source models contain 685 shared parameter tensors:

• 619 tensors were changed and extracted

• 66 tensors were unchanged

Final file size: approximately 675.10 MiB

FP8 and Quantized Model Notes

It is not recommended to force the following global FP8 options while using this LoRA:

• --fp8_e4m3fn-unet

• --fp8_e4m3fn-text-enc

• The plain --fast option

These options may forcibly convert weights that need to receive LoRA deltas into FP8, potentially causing stochastic_rounding_fp8addmm_cuda errors or failures when applying LoRA weights.

Mixed-precision quantized models may still be used, but the following settings are recommended:

• Use FP16 as the model’s manual computation type

• Use FP16 accumulation

• Do not force global FP8

This LoRA has been successfully tested through actual sampling with a mixed-precision quantized Anima model using FP16 manual-cast mode.

Known Limitations

• This is a high-quality low-rank approximation, not a lossless conversion of the original full fine-tuned model.

• High-rank residuals remain in the MLP and LLM Adapter modules that cannot be fully represented by the current rank configuration.

• When used with a base model other than the original Anima base model, the extracted delta is applied to a different set of weights, so the result may not match the original fine-tuned model.

• Due to the relatively high Attention rank, the file is significantly larger than a typical character or style LoRA.

• For the most accurate reconstruction of the original model, use anima_baseV10 and set the model strength to 1.0.