demofusion-comfyui

demofusion-comfyui
★ 88

DemoFusionComfyUI自定义节点图像融合
将Ruoyi Du的DemoFusion技术封装为ComfyUI自定义节点,便于在ComfyUI流程中直接调用和实验图像融合效果
💡 在ComfyUI中快速调用DemoFusion进行图像融合实验
🍴 5 Forks💻 Python🔄 2024-05-22
📦
网盘下载
复制链接后前往夸克网盘下载
https://pan.quark.cn/s/e00a65475347
📦 requirements.txt
diffusers~=0.21.4
matplotlib
example
example_2
📄 README

ComfyUI Demofusion Custom Node

Introduction

The Demofusion Custom Node is a wrapper that adapts the work and implementation of the Demofusion technique created and implemented by Ruoyi Du to the Comfyui environment.

The original paper and official implementations by Ruoyi Du can be found here :

  • https://ruoyidu.github.io/demofusion/demofusion.html
  • https://github.com/PRIS-CV/DemoFusion
  • My idea was wrapping Demofusion in a node to be used in ComfyUI, so we could use this amazing tool to experimenting with this technique.

    As it it my first ComfyUI custom node, I’m not sure if I’m implementing the best practices, so any comments and/or sugestions are welcome.

    Update: Now you can also use local SDXL checkpoints!

    If anyone have some ideas about how to do it, again, thank you very much for yor collaboration and tips.

    Installing

    To install this node, is just like any other one, no special procedures are needed:

  • Git clone the repository in the ComfyUI/custom_nodes folder
  • Restart ComfyUI
  • It’s also good to remember that this technique requires a lot of VRAM (plus 18G).

    How to use

    Here you can see an example of how to use the node

    And here it’s the generated image (that can also works as the basic worflow, if you drag and drop it in the Comfyui browser window):

    So far I’ve only tried to generate square images with 2048×2048 and 3072×3072.

    I’ve also only tried these Huggingface models:

  • stabilityai/stable-diffusion-xl-base-1.0
  • stablediffusionapi/sdxl-unstable-diffusers-y
  • Being the first one the model used by the author of the technique in his paper and implementation.

    Under development

    This node is under development, so use it at your own risk. And probably the interface will change a lot, impacting the generated workflows in the future versions.