ComfyUI_HelloMeme

ComfyUI_HelloMeme
★ 373

图像生成视频生成高保真条件扩散低VRAM兼容
在ComfyUI中集成HelloMeme节点，支持图像与视频生成，采用Spatial Knitting Attentions提升表达一致性与高保真，并兼容V2/V3等低VRAM运行模式。
💡 在ComfyUI工作流中生成表达一致且高保真的人物图像与驱动视频
🍴 26 Forks💻 Python🔄 2025-06-27
📦
网盘下载
复制链接后前往夸克网盘下载
https://pan.quark.cn/s/9d76119b2ef2
📦 requirements.txt
accelerate>=1.1.1
diffusers>=0.33.1
einops>=0.8.0
huggingface-hub>=0.30.2
imageio>=2.36.0
imageio-ffmpeg>=0.5.1
onnxruntime>=1.14.0
opencv-python>=4.10.0.84
peft>=0.15.2
pillow>=10.2.0
safetensors>=0.4.5
tqdm>=4.67.0
transformers>=4.46.3
scikit-image>=0.25.2
modelscope>=1.21.0
torchvision>=0.18.0
📄 README

HelloMeme: Integrating Spatial Knitting Attentions to Embed High-Level and Fidelity-Rich Conditions in Diffusion Models

HelloVision | HelloGroup Inc.

* Intern

🔆 New Features/Updates

  • ✅ 02/09/2025 HelloMemeV3 is now available.

    • YouTube Demo

  • ✅ 12/17/2024 Support modelscope (Modelscope Demo).
  • ✅ 12/08/2024 Added HelloMemeV2 (select “v2” in the version option of the LoadHelloMemeImage/Video Node). Its features include:

    • a. Improved expression consistency between the generated video and the driving video.

    b. Better compatibility with third-party checkpoints.

    c. Reduced VRAM usage.

    YouTube Demo

  • ✅ 11/29/2024 a.Optimize the algorithm; b.Add VAE selection functionality; c.Introduce a super-resolution feature.

    • YouTube Demo

  • ✅ 11/14/2024 Added the HMControlNet2 module, which uses the PD-FGC motion module to extract facial expression information (drive_exp2); restructured the ComfyUI interface; and optimized VRAM usage.

    • YouTube Demo

  • ✅ 11/12/2024 Added a newly fine-tuned version of Animatediff with a patch size of 12, which uses less VRAM (Tested on 2080Ti).
  • ✅ 11/11/2024 ~~Optimized VRAM usage and added HMVideoSimplePipeline (workflows/hellomeme_video_simple_workflow.json), which doesn’t use Animatediff and can run on machines with less than 12G VRAM.~~
  • ✅ 11/6/2024 The face proportion in the reference image significantly affects the generation quality. We have encapsulated the recommended image cropping method used during training into a CropReferenceImage Node. Refer to the workflows in the ComfyUI_HelloMeme/workflows directory: hellomeme_video_cropref_workflow.json and hellomeme_image_cropref_workflow.json.

    • Introduction

    This repository is the official implementation of the HelloMeme ComfyUI interface, featuring both image and video generation functionalities. Example workflow files can be found in the ComfyUI_HelloMeme/workflows directory. Test images and videos are saved in the ComfyUI_HelloMeme/examples directory. Below are screenshots of the interfaces for image and video generation.

    [!Note]

    Custom models should be placed in the directories listed below.

    Checkpoints under: ComfyUI/models/checkpoints

    Loras under: ComfyUI/models/loras

    Installation

    Keyword of ComfyUI Manager : hellomeme-api

    Workflows

    | workflow file | Video Generation | Image Generation | HMControlNet | HMControlNet2 |

    |—————|——————|——————|———–|—————|

    | image_generation.json | | ✅ | | ✅ |

    | image_style_transfer.json | | ✅ | | ✅ |

    | video_generation.json | ✅ | | | ✅ |

    Image Generation Interface

    Style Transfer Interface

    Video Generation Interface