CivArchive
    ← All articles
    Published February 27, 2024by gokaygokay

    Image to Music in ComfyUI - Workflow included

    1.1K views5 reactions3 comments on CivitAI7 collected
    img2sfxworkflowsimg2music

    New node:

    LLaVA -> LLM -> Audio

    Update the VLM Nodes from github.

    https://github.com/gokayfem/ComfyUI_VLM_nodes

    Download both from the link below mmproj-model-f16.gguf and llava-v1.6-mistral-7b.Q5_K_M.gguf model and put them into models/LLavacheckpoints

    https://huggingface.co/cjpais/llava-1.6-mistral-7b-gguf/tree/main

    It will automatically download the necessary files into

    custom_nodes/ComfyUI_VLM_nodes/nodes/files_for_audioldm2

    It will automatically save the files into your output folder

    Attachments