CivArchive
    Qwen-Image-Edit FP8 & GGUF - mmproj-F16
    NSFW
    Preview 96259579

    Error: Can't find mmproj file for 'Qwen2.5-VL-7B-Instruct-Q3_K_M.gguf' (matching:'qwen2.5-vl-7b-instruct')! Qwen-Image-Edit will be broken!

    Rename the mmproj-F16:

    Make sure the downloaded text encoder has the correct file naming (whatever_text-encoder.gguf paired with whatever_text-encoder_mmproj-F16.gguf)

    Demo: https://chat.qwen.ai/
    Text encooder FP8: https://civarchive.com/models/1864281?modelVersionId=2110105

    Workflow GGUF: https://civarchive.com/models/1881851/qwen-iamge-edit-gguf-lightning-4steps-comfyui


    This FP8-optimized (e4m3fn) conversion of Qwen-Image-Edit, now fully compatible with the latest Qwen-VL image editing features! Leveraging Alibaba's advanced multimodal AI, this model enables seamless text-guided image manipulation, perfect for precise edits, prompt-based adjustments, and creative refinements. The model is mirrored here for convenience.

    Description

    mmproj file

    FAQ

    Comments (31)

    bigdog11Aug 27, 2025
    CivitAI

    does it work on forge?

    5817430Aug 27, 2025· 1 reaction

    I don't think so,

    bigdog11Aug 27, 2025· 1 reaction

    @sweetmax797 if you're not sure, I can try and let you know,

    simiyetSep 17, 2025
    CivitAI

    I am getting clip missing with a long list of weight with this text encoder.

    5817430Sep 17, 2025

    is it some error unrelated to the one I mentioned in the description?

    simiyetSep 17, 2025

    @sweetmax797 I dont think so because it recognise the text encoder:
    "Attenpting to find mmproj file for text encoder...

    Using mmproj 'QwenImageEdit2.5-VL-7B-Instruct-Q3_K_M-mmproj-F16.gguf' for text encoder 'QwenImageEdit2.5-VL-7B-Instruct-Q3_K_M-mmproj-F16.gguf'."
    What I am getting is:
    "clip missing: ['visual.patch_embed.proj.weight', 'visual.blocks.0.norm1.weight', 'visual.blocks.0.norm2.weight', 'visual.blocks.0.attn.qkv.weight', 'visual.blocks.0.attn.proj.weight', 'visual.blocks.0.mlp.gate_proj.weight', 'visual.blocks.0.mlp.up_proj.weight', 'visual.blocks.0.mlp.down_proj.weight', 'visual.blocks.1.norm1.weight', 'visual.blocks.1.norm2.weight', 'visual.blocks.1.attn.qkv.weight', 'visual.blocks.1.attn.proj.weight', 'visual.blocks.1.mlp.gate_proj.weight', 'visual.blocks.1.mlp.up_proj.weight', 'visual.blocks.1.mlp.down_proj.weight', 'visual.blocks.2.norm1.weight', 'visual.blocks.2.norm2.weight', 'visual.blocks.2.attn.qkv.weight', 'visual.blocks.2.attn.proj.weight', 'visual.blocks.2.mlp.gate_proj.weight', 'visual.blocks.2.mlp.up_proj.weight', 'visual.blocks.2.mlp.down_proj.weight', 'visual.blocks.3.norm1.weight', 'visual.blocks.3.norm2.weight', 'visual.blocks.3.attn.qkv.weight', 'visual.blocks.3.attn.proj.weight', 'visual.blocks.3.mlp.gate_proj.weight', 'visual.blocks.3.mlp.up_proj.weight', 'visual.blocks.3.mlp.down_proj.weight', 'visual.blocks.4.norm1.weight', 'visual.blocks.4.norm2.weight', 'visual.blocks.4.attn.qkv.weight', 'visual.blocks.4.attn.proj.weight', 'visual.blocks.4.mlp.gate_proj.weight', 'visual.blocks.4.mlp.up_proj.weight', 'visual.blocks.4.mlp.down_proj.weight', 'visual.blocks.5.norm1.weight', 'visual.blocks.5.norm2.weight', 'visual.blocks.5.attn.qkv.weight', 'visual.blocks.5.attn.proj.weight', 'visual.blocks.5.mlp.gate_proj.weight', 'visual.blocks.5.mlp.up_proj.weight', 'visual.blocks.5.mlp.down_proj.weight', 'visual.blocks.6.norm1.weight', 'visual.blocks.6.norm2.weight', 'visual.blocks.6.attn.qkv.weight', 'visual.blocks.6.attn.proj.weight', 'visual.blocks.6.mlp.gate_proj.weight', 'visual.blocks.6.mlp.up_proj.weight', 'visual.blocks.6.mlp.down_proj.weight', 'visual.blocks.7.norm1.weight', 'visual.blocks.7.norm2.weight', 'visual.blocks.7.attn.qkv.weight', 'visual.blocks.7.attn.proj.weight', 'visual.blocks.7.mlp.gate_proj.weight', 'visual.blocks.7.mlp.up_proj.weight', 'visual.blocks.7.mlp.down_proj.weight', 'visual.blocks.8.norm1.weight', 'visual.blocks.8.norm2.weight', 'visual.blocks.8.attn.qkv.weight', 'visual.blocks.8.attn.proj.weight', 'visual.blocks.8.mlp.gate_proj.weight', 'visual.blocks.8.mlp.up_proj.weight', 'visual.blocks.8.mlp.down_proj.weight', 'visual.blocks.9.norm1.weight', 'visual.blocks.9.norm2.weight', 'visual.blocks.9.attn.qkv.weight', 'visual.blocks.9.attn.proj.weight', 'visual.blocks.9.mlp.gate_proj.weight', 'visual.blocks.9.mlp.up_proj.weight', 'visual.blocks.9.mlp.down_proj.weight', 'visual.blocks.10.norm1.weight', 'visual.blocks.10.norm2.weight', 'visual.blocks.10.attn.qkv.weight', 'visual.blocks.10.attn.proj.weight', 'visual.blocks.10.mlp.gate_proj.weight', 'visual.blocks.10.mlp.up_proj.weight', 'visual.blocks.10.mlp.down_proj.weight', 'visual.blocks.11.norm1.weight', 'visual.blocks.11.norm2.weight', 'visual.blocks.11.attn.qkv.weight', 'visual.blocks.11.attn.proj.weight', 'visual.blocks.11.mlp.gate_proj.weight', 'visual.blocks.11.mlp.up_proj.weight', 'visual.blocks.11.mlp.down_proj.weight', 'visual.blocks.12.norm1.weight', 'visual.blocks.12.norm2.weight', 'visual.blocks.12.attn.qkv.weight', 'visual.blocks.12.attn.proj.weight', 'visual.blocks.12.mlp.gate_proj.weight', 'visual.blocks.12.mlp.up_proj.weight', 'visual.blocks.12.mlp.down_proj.weight', 'visual.blocks.13.norm1.weight', 'visual.blocks.13.norm2.weight', 'visual.blocks.13.attn.qkv.weight', 'visual.blocks.13.attn.proj.weight', 'visual.blocks.13.mlp.gate_proj.weight', 'visual.blocks.13.mlp.up_proj.weight', 'visual.blocks.13.mlp.down_proj.weight', 'visual.blocks.14.norm1.weight', 'visual.blocks.14.norm2.weight', 'visual.blocks.14.attn.qkv.weight', 'visual.blocks.14.attn.proj.weight', 'visual.blocks.14.mlp.gate_proj.weight', 'visual.blocks.14.mlp.up_proj.weight', 'visual.blocks.14.mlp.down_proj.weight', 'visual.blocks.15.norm1.weight', 'visual.blocks.15.norm2.weight', 'visual.blocks.15.attn.qkv.weight', 'visual.blocks.15.attn.proj.weight', 'visual.blocks.15.mlp.gate_proj.weight', 'visual.blocks.15.mlp.up_proj.weight', 'visual.blocks.15.mlp.down_proj.weight', 'visual.blocks.16.norm1.weight', 'visual.blocks.16.norm2.weight', 'visual.blocks.16.attn.qkv.weight', 'visual.blocks.16.attn.proj.weight', 'visual.blocks.16.mlp.gate_proj.weight', 'visual.blocks.16.mlp.up_proj.weight', 'visual.blocks.16.mlp.down_proj.weight', 'visual.blocks.17.norm1.weight', 'visual.blocks.17.norm2.weight', 'visual.blocks.17.attn.qkv.weight', 'visual.blocks.17.attn.proj.weight', 'visual.blocks.17.mlp.gate_proj.weight', 'visual.blocks.17.mlp.up_proj.weight', 'visual.blocks.17.mlp.down_proj.weight', 'visual.blocks.18.norm1.weight', 'visual.blocks.18.norm2.weight', 'visual.blocks.18.attn.qkv.weight', 'visual.blocks.18.attn.proj.weight', 'visual.blocks.18.mlp.gate_proj.weight', 'visual.blocks.18.mlp.up_proj.weight', 'visual.blocks.18.mlp.down_proj.weight', 'visual.blocks.19.norm1.weight', 'visual.blocks.19.norm2.weight', 'visual.blocks.19.attn.qkv.weight', 'visual.blocks.19.attn.proj.weight', 'visual.blocks.19.mlp.gate_proj.weight', 'visual.blocks.19.mlp.up_proj.weight', 'visual.blocks.19.mlp.down_proj.weight', 'visual.blocks.20.norm1.weight', 'visual.blocks.20.norm2.weight', 'visual.blocks.20.attn.qkv.weight', 'visual.blocks.20.attn.proj.weight', 'visual.blocks.20.mlp.gate_proj.weight', 'visual.blocks.20.mlp.up_proj.weight', 'visual.blocks.20.mlp.down_proj.weight', 'visual.blocks.21.norm1.weight', 'visual.blocks.21.norm2.weight', 'visual.blocks.21.attn.qkv.weight', 'visual.blocks.21.attn.proj.weight', 'visual.blocks.21.mlp.gate_proj.weight', 'visual.blocks.21.mlp.up_proj.weight', 'visual.blocks.21.mlp.down_proj.weight', 'visual.blocks.22.norm1.weight', 'visual.blocks.22.norm2.weight', 'visual.blocks.22.attn.qkv.weight', 'visual.blocks.22.attn.proj.weight', 'visual.blocks.22.mlp.gate_proj.weight', 'visual.blocks.22.mlp.up_proj.weight', 'visual.blocks.22.mlp.down_proj.weight', 'visual.blocks.23.norm1.weight', 'visual.blocks.23.norm2.weight', 'visual.blocks.23.attn.qkv.weight', 'visual.blocks.23.attn.proj.weight', 'visual.blocks.23.mlp.gate_proj.weight', 'visual.blocks.23.mlp.up_proj.weight', 'visual.blocks.23.mlp.down_proj.weight', 'visual.blocks.24.norm1.weight', 'visual.blocks.24.norm2.weight', 'visual.blocks.24.attn.qkv.weight', 'visual.blocks.24.attn.proj.weight', 'visual.blocks.24.mlp.gate_proj.weight', 'visual.blocks.24.mlp.up_proj.weight', 'visual.blocks.24.mlp.down_proj.weight', 'visual.blocks.25.norm1.weight', 'visual.blocks.25.norm2.weight', 'visual.blocks.25.attn.qkv.weight', 'visual.blocks.25.attn.proj.weight', 'visual.blocks.25.mlp.gate_proj.weight', 'visual.blocks.25.mlp.up_proj.weight', 'visual.blocks.25.mlp.down_proj.weight', 'visual.blocks.26.norm1.weight', 'visual.blocks.26.norm2.weight', 'visual.blocks.26.attn.qkv.weight', 'visual.blocks.26.attn.proj.weight', 'visual.blocks.26.mlp.gate_proj.weight', 'visual.blocks.26.mlp.up_proj.weight', 'visual.blocks.26.mlp.down_proj.weight', 'visual.blocks.27.norm1.weight', 'visual.blocks.27.norm2.weight', 'visual.blocks.27.attn.qkv.weight', 'visual.blocks.27.attn.proj.weight', 'visual.blocks.27.mlp.gate_proj.weight', 'visual.blocks.27.mlp.up_proj.weight', 'visual.blocks.27.mlp.down_proj.weight', 'visual.blocks.28.norm1.weight', 'visual.blocks.28.norm2.weight', 'visual.blocks.28.attn.qkv.weight', 'visual.blocks.28.attn.proj.weight', 'visual.blocks.28.mlp.gate_proj.weight', 'visual.blocks.28.mlp.up_proj.weight', 'visual.blocks.28.mlp.down_proj.weight', 'visual.blocks.29.norm1.weight', 'visual.blocks.29.norm2.weight', 'visual.blocks.29.attn.qkv.weight', 'visual.blocks.29.attn.proj.weight', 'visual.blocks.29.mlp.gate_proj.weight', 'visual.blocks.29.mlp.up_proj.weight', 'visual.blocks.29.mlp.down_proj.weight', 'visual.blocks.30.norm1.weight', 'visual.blocks.30.norm2.weight', 'visual.blocks.30.attn.qkv.weight', 'visual.blocks.30.attn.proj.weight', 'visual.blocks.30.mlp.gate_proj.weight', 'visual.blocks.30.mlp.up_proj.weight', 'visual.blocks.30.mlp.down_proj.weight', 'visual.blocks.31.norm1.weight', 'visual.blocks.31.norm2.weight', 'visual.blocks.31.attn.qkv.weight', 'visual.blocks.31.attn.proj.weight', 'visual.blocks.31.mlp.gate_proj.weight', 'visual.blocks.31.mlp.up_proj.weight', 'visual.blocks.31.mlp.down_proj.weight', 'visual.merger.ln_q.weight', 'visual.merger.mlp.0.weight', 'visual.merger.mlp.2.weight']"

    simiyetSep 17, 2025

    Could it be the lightining lora? I was using the one for qwen image, since I have read some people saying it was performing better.

    5817430Sep 17, 2025

    @simiyet looks like mismatch, did u download all files here or form other sources? i checked mine works fine,,, start with gguf loader node, see if it is updated,, if it is try to red-ownload them form : https://huggingface.co/unsloth/Qwen2.5-VL-7B-Instruct-GGUF/tree/main both text encoder mmproj file (at the bottom of the repo) see if it helps
    alternatively try this repo too if 'unsloth' doesn't solve the issue:
    https://huggingface.co/bartowski/Qwen2-VL-7B-Instruct-GGUF/tree/main

    5817430Sep 17, 2025

    @simiyet lightning lora generally slows done the generation combined with gguf, (if i remember currently) or maybe it was something specific to my pc but try to run it without it and monitor the s/it in terminal

    simiyetSep 17, 2025

    @sweetmax797 I downloaded both, from here (txt-enc-7b-Intruct-Q3) and from unsloth HF (Qwen2.5-VL-7B-Instruct-Q3_K_M.gguf), and got the same error. I'll try bartowski.
    The lora actually halfen the generation time. But lora change didnt solve the issue.

    simiyetSep 17, 2025

    Wait.. Do I need txt-enc-7b-Intruct-Q3 or mmprof-F16 verison? Sorry, first time trying QWEN models.

    5817430Sep 17, 2025· 1 reaction

    @simiyet yes, put them in text_encoders folder and in the GGUF clip loader, make sure u select the text-encoder model not the mmproj file

    simiyetSep 17, 2025

    @sweetmax797 Oh so I need both.. I only downloaded the text encoder.. Hope this will solve the issue.

    5817430Sep 17, 2025

    @simiyet Yes, it has a bit of a learning curve, but suddenly everything clicks, and the next thing you know, you're developing a custom node for it! :)

    simiyetSep 17, 2025· 1 reaction

    @sweetmax797 That solved the issue! Thank you so much!

    5817430Sep 17, 2025

    @simiyet you're welcome!

    bevas55694654Sep 22, 2025
    CivitAI

    Any chance this could run on 8Go VRAM ?

    Silver_bullet666Sep 30, 2025· 1 reaction
    Seii1Nov 4, 2025· 1 reaction
    CivitAI

    im not sure if i can run fp8 with my 16gb vram

    5817430Nov 4, 2025

    are you serious right now? u can run fp8 with 8gb vram, if u can't, there is wrong setup, not the vram

    Seii1Nov 4, 2025

    @sweetmax797 thx idk about that,cause ive seen on youtube the size matters to vram, like 10gb file require 10gbvram

    5817430Nov 4, 2025· 2 reactions

    @Seii1 oh no, they're wrong. the size of the model has nothing to do with the vram. ask ai. I run full wan2.2 fp16 on 10gb vram 64gb ram i7 , even full qwen-image-edit bf16 40gb in size with ease. not to mension all other applications and 3 big monitors running at 120ghz. u have 12gb vram, u can do much more

    Seii1Nov 4, 2025· 1 reaction

    @sweetmax797 thx for the answer

    Seii1Nov 4, 2025

    its took like 20minutes just to load things xD , maybe i should download the GGuf version

    5817430Nov 4, 2025

    @Seii1 what type of CPU do u have? how much ram. ddr4 or ddr5, and what kind of hard disk , windows or linux?

    Seii1Nov 4, 2025

    @sweetmax797 kinda old, 5600x, 32gb ram,NVME , if my ram 64 thats not a problem i think

    5817430Nov 4, 2025

    @Seii1 64GB RAM + NVME great. do u have i5 or i7, anything above 10th generation is more than enough. Im guessing you have internal GPU too, if it is disabled, enable it via BIOS so u offload more of the OS to internal and let your nvidia be used only for AI.
    ----
    You need to install sage attention and Triton. after that you need to use advanced diffiusion loader and use these settings:
    {'compute_dtype': torch.bfloat16, 'sage_attention': 'sageattn_qk_int8_pv_fp16_triton', 'use_fp16_accumulation': True}

    in comfyui manager search for this node pack: https://github.com/kijai/ComfyUI-KJNodes
    It has this node and choose those settings, if u run fp8 change the weight type to default
    https://imgur.com/a/fmxxtDF

    Seii1Nov 4, 2025

    @sweetmax797 im using 4060ti 16gb, i gues i just need more ram to load faster, thx for the tips

    5817430Nov 4, 2025

    @Seii1 yes more ram in your situation is very useful, Ti is more for energy officency and have less cuda cores compare to regular ones. your ssd is great, ram is cheap, but first fix your workflow, and windows 11 is just not good, to much overhead, it eats your resources, Ubuntu or LinuxMint best for AI.

    bbrsNov 17, 2025· 1 reaction

    i have 16gb vram + 32ram before,many workflow need 20min, than i up to 64ram and every change

    regalyuzuApr 17, 2026
    CivitAI

    this is not explained at all very well on what to do, the separate files are all things you need to download yet have the exact same instructions that dont even apply... where does each file need to go?