GGUF quantizations of Ming-Image-0.1-Design for use with ComfyUI-GGUF. GGUFs: <a target="_blank" rel="ugc" href="https://huggingface.co/realrebelai/Ming-Image_GGUFs">https://huggingface.co/realrebelai/Ming-Image_GGUFs</a> REQUIRES PR for GGUF NODES:<a target="_blank" rel="ugc" href="https://github.com/city96/ComfyUI-GGUF/pull/484">https://github.com/city96/ComfyUI-GGUF/pull/484</a>Original model: <a target="_blank" rel="ugc" href="https://huggingface.co/inclusionAI/Ming-Image-0.1-Design">https://huggingface.co/inclusionAI/Ming-Image-0.1-Design</a>Official Ming-Image repository: <a target="_blank" rel="ugc" href="https://github.com/inclusionAI/Ming-Image">https://github.com/inclusionAI/Ming-Image</a>These are not simple one-pass quants. The diffusion-model files use a mixed-precision HQ ladder designed to keep the most sensitive Ming-Image tensors at higher precision while aggressively quantizing the larger bulk weights.<hr /><h2 id="diffusion-model-quantization">Diffusion model quantization</h2>The diffusion model contains 519 tensors.The process used for the files in this repository was:<ol><li>Convert the original BF16 diffusion weights into a shape-preserving BF16 GGUF master.</li><li>Quantize that BF16 GGUF directly with <code>llama-quantize</code> to create donor files:<ul><li><code>Q8_0</code></li><li><code>Q6_K</code></li><li><code>Q5_K_M</code></li><li><code>Q4_K_M</code></li><li><code>Q3_K_M</code></li><li><code>Q2_K</code></li></ul></li><li>Build the final <code>-HQ</code> models by selecting tensors from those already-quantized donor files.</li><li>The HQ assembly step copies the existing packed GGUF tensor data directly. It does not dequantize and requantize each selected tensor.</li></ol>The <code>general.architecture</code> transport metadata used during GGUF conversion is for quantizer/loader compatibility only. It should not be interpreted as Ming-Image being a Lumina2 model.<hr /><h2 id="hq-mixed-precision-policy">HQ mixed-precision policy</h2>The same tensor groups are protected across the entire ladder.<h3 id="always-kept-in-bf16">Always kept in BF16</h3>The following groups remain BF16 in every HQ quant:<pre><code>t_embedder.*
all_x_embedder.*
all_final_layer.*
cap_embedder.*
context_refiner.*
noise_refiner.*
*.adaLN_modulation.*
</code></pre>This includes the input/output projections, time conditioning, both refiner stacks, caption projection path, and all adaLN modulation tensors.There are 309 BF16 tensors retained in the HQ models.<h3 id="attention-tensors">Attention tensors</h3>The following attention weights are assigned a higher precision than the bulk quant where appropriate:<pre><code>*.attention.to_q.weight
*.attention.to_k.weight
*.attention.to_v.weight
*.attention.to_out.0.weight
</code></pre>There are 120 attention tensors in this protected group.<h3 id="ffn-down-projection">FFN down projection</h3>The FFN down projection is also protected separately:<pre><code>*.feed_forward.w2.weight
</code></pre>There are 30 protected FFN-down tensors.<h3 id="bulk-tensors">Bulk tensors</h3>The remaining 60 tensors use the base quantization level of that rung.This includes the large FFN <code>w1</code> / <code>w3</code> tensors unless otherwise covered by one of the protected groups above.<hr /><h2 id="exact-diffusion-hq-ladder">Exact diffusion HQ ladder</h2>File / rungBF16 critical tensorsAttention Q/K/V/OFFN <code>w2</code>Remaining bulkQ8_0-HQBF16Q8_0Q8_0Q8_0Q6_K-HQBF16Q8_0Q8_0Q6_KQ5_K_M-HQBF16Q8_0Q6_KQ5_K_MQ4_K_M-HQBF16Q8_0Q6_KQ4_K_MQ3_K_M-HQBF16Q6_KQ5_K_MQ3_K_MQ2_K-HQBF16Q5_K_MQ4_K_MQ2_KFor example, the Q4_K_M-HQ model is composed of:<pre><code>309 tensors BF16
120 tensors Q8_0
 30 tensors Q6_K
 60 tensors Q4_K
-------------------
519 tensors total
</code></pre>This is why the HQ files may be larger than a conventional uniform quant at the same advertised rung.The goal is to preserve Ming-Image's conditioning, attention, refinement, and output quality while still reducing the memory footprint of the largest weight groups.<hr /><h2 id="ling-mini-2.0-text-encoder-ggufs">Ling Mini 2.0 text encoder GGUFs</h2>This repository also includes low-VRAM GGUF variants of the Ming-Image Ling Mini 2.0 text encoder.The source encoder contains approximately 17.3B parameters across 642 tensors, including large routed MoE expert banks.Two practical variants were built:<h3 id="q4_k_m-hq-encoder">Q4_K_M-HQ encoder</h3><ul><li>Small / critical routing and bridge tensors remain at high precision.</li><li>The rest of the encoder is primarily <code>Q4_K_M</code>.</li><li>Intended as the higher-quality low-VRAM encoder option.</li></ul><h3 id="q2_k-hq-encoder">Q2_K-HQ encoder</h3>The Q2 encoder is intentionally not a uniform Q2 conversion.<ul><li>Small / critical routing and bridge tensors remain at high precision.</li><li>The non-MoE backbone remains at <code>Q4_K_M</code>.</li><li>The large routed MoE expert banks use <code>Q2_K</code>.</li></ul>This concentrates the most aggressive compression on the enormous expert weights instead of applying Q2 indiscriminately to the whole encoder.The encoder contains 38 large 3D expert tensors across the routed MoE layers, so this split makes a substantial difference to total size while protecting the shared backbone.<hr /><h2 id="comfyui-installation">ComfyUI installation</h2>Install:<a target="_blank" rel="ugc" href="https://github.com/city96/ComfyUI-GGUF">https://github.com/city96/ComfyUI-GGUF</a>Place diffusion GGUF files in:<pre><code>ComfyUI/models/diffusion_models/
</code></pre>or the GGUF UNet/diffusion-model folder used by your ComfyUI installation.Place Ling Mini GGUF text encoders in:<pre><code>ComfyUI/models/text_encoders/
</code></pre>Place the Ming-Image VAE in:<pre><code>ComfyUI/models/vae/
</code></pre>Use:<ul><li>Unet Loader (GGUF) for the diffusion model</li><li>CLIP Loader (GGUF) for the Ling Mini encoder</li><li>the standard VAE Loader for the Ming-Image VAE</li></ul><hr /><h2 id="important:-ming-image-gguf-loader-support">Important: Ming-Image GGUF loader support</h2>Ming-Image stores its attention Q/K/V weights separately.With quantized GGUF tensors, the physical packed byte width can differ from the tensor's logical width. For example, a logical width of <code>3840</code> can occupy <code>4080</code> packed bytes in <code>Q8_0</code>.The normal ComfyUI Diffusers conversion path tries to merge these tensors with ordinary Torch assignment and can fail with an error like:<pre><code>The expanded size of the tensor (3840) must match the existing size (4080)
Target sizes: [3840, 3840]
Tensor sizes: [3840, 4080]
</code></pre>A Ming-Image compatibility fix has been submitted for ComfyUI-GGUF that performs the Q/K/V merge while preserving the packed GGUF storage and the correct logical tensor shape.Until that support is merged into ComfyUI-GGUF main, use the Ming-Image PR/branch for loading these diffusion GGUFs.<blockquote>Add the ComfyUI-GGUF PR link here once published.</blockquote>The GGUF files themselves do not need to be repaired, rebuilt, dequantized, or requantized.<hr /><h2 id="recommended-starting-point">Recommended starting point</h2>For most low-VRAM users:<pre><code>Diffusion: Ming-Image-0.1-Design-Q4_K_M-HQ.gguf
Encoder: Ming-Image-0.1-Ling-Mini-2.0-Q4_K_M-HQ.gguf
</code></pre>If memory is extremely limited, move down to the Q3/Q2 diffusion files and/or the Q2 Ling Mini encoder.If you have more memory and want to preserve more precision, move upward through Q5, Q6, or Q8.<hr /><h2 id="suggested-generation-settings">Suggested generation settings</h2>The original Ming-Image release recommends:<pre><code>Resolution: 2048x2048
Steps: 12
CFG: 1.0
</code></pre>1024x1024 is also useful for faster testing.See the official model card for current upstream recommendations:<a target="_blank" rel="ugc" href="https://huggingface.co/inclusionAI/Ming-Image-0.1-Design">https://huggingface.co/inclusionAI/Ming-Image-0.1-Design</a><hr /><h2 id="notes">Notes</h2><ul><li>These files are intended for ComfyUI-GGUF.</li><li>The <code>-HQ</code> suffix means the file uses the mixed-precision tensor policy documented above.</li><li>Quantization is lossy. Lower-bit variants trade some model fidelity for reduced memory/storage requirements.</li><li>The original model, architecture, license, and upstream documentation belong to the Ming-Image authors.</li><li>This repository provides GGUF conversions/quantizations only.</li></ul><hr /><h2 id="credits">Credits</h2>Ming-Image-0.1-Design: <a target="_blank" rel="ugc" href="https://huggingface.co/inclusionAI/Ming-Image-0.1-Design">https://huggingface.co/inclusionAI/Ming-Image-0.1-Design</a>Official Ming-Image GitHub: <a target="_blank" rel="ugc" href="https://github.com/inclusionAI/Ming-Image">https://github.com/inclusionAI/Ming-Image</a>ComfyUI-GGUF: <a target="_blank" rel="ugc" href="https://github.com/city96/ComfyUI-GGUF">https://github.com/city96/ComfyUI-GGUF</a>

Files with SHA256: f43a5825676767cae4a96282b28a45c1cfac91ad62d523c8f0aca074f26ae2c8