ComfyUI_VisualCloze

ComfyUI_VisualCloze
★ 11

图像生成视觉示例学习少样本学习ComfyUI节点
在ComfyUI中集成VisualCloze,实现基于视觉示例的通用图像生成与少样本任务迁移,便于通过示例控制输出风格与内容。
💡 用示例图像在ComfyUI内进行少样本图像生成与风格迁移。
🍴 1 Forks💻 Python🔄 2025-05-21
📦
网盘下载
复制链接后前往夸克网盘下载
https://pan.quark.cn/s/c1eafc754fbb
📄 README

VisualCloze: A Universal Image Generation Framework via Visual In-Context Learning

Tips

  • 量化fp8的模式始终跑不出效果,官方的diffuser版本暂时没空捣鼓,先放代码出来,免得说占坑。方法需要的显存较大,内存也要64+,24显存可以试试关闭cpu offload
  • 1.Installation


    In the ./ComfyUI /custom_node directory, run the following:

    git clone https://github.com/smthemex/ComfyUI_VisualCloze.git

    2.requirements


    pip install -r requirements.txt

    3 models


    lora 384 or lora 512

    ├── ComfyUI/models/loras/
    |             ├── visualcloze-lora-512.safetensors # or 384
    ├── ComfyUI/models/diffusion_models/
    |             ├── flux1-fill-dev.safetensors # or flux1-fill-dev-fp8.safetensors

    Example

    Citation

    @article{li2025visualcloze,
      title={VisualCloze : A Universal Image Generation Framework via Visual In-Context Learning},
      author={Li, Zhong-Yu and Du, Ruoyi and Yan, Juncheng and Zhuo, Le and Li, Zhen and Gao, Peng and Ma, Zhanyu and Cheng, Ming-Ming},
      journal={arXiv preprint arxiv:},
      year={2025}
    }