ComfyUI-AniPortrait

ComfyUI-AniPortrait
★ 254

人像生成动画化diffusers兼容工作流示例
在ComfyUI中集成AniPortrait，兼容新版diffusers，提供肖像/二次元人像生成与动画化的节点与示例工作流，便于快速搭建管线。
💡 快速在ComfyUI中构建并运行AniPortrait人像生成与动画工作流
🍴 21 Forks💻 Python🔄 2024-05-22
📦
网盘下载
复制链接后前往夸克网盘下载
https://pan.quark.cn/s/b6135d9bd930
📦 requirements.txt
accelerate
av
clip
@
https://github.com/openai/CLIP/archive/d50d76daa670286dd6cacf3bcd80b5e4823fc8e1.zip#sha256=b5842c25da441d6c581b53a5c60e0c2127ebafe0f746f8e15561a006c6c3be6a
decord
diffusers>=0.26.3
einops
imageio
imageio-ffmpeg
omegaconf
onnxruntime-gpu
open-clip-torch
opencv-contrib-python
opencv-python
controlnet-aux
mediapipe
librosa
ffmpeg-python
📄 README

ComfyUI-AniPortrait

Thanks to the contribution from WainWong, the support for the new version of diffusers is now available.

  • base workflow

    • https://github.com/chaojie/ComfyUI-AniPortrait/blob/main/wf.json

    Installation

    Build environment

    We recommend a python version >=3.10 and cuda version =11.7. Then build environment as follows:

    pip install -r requirements.txt

    Download weights

  • Download our trained weights, which include five parts: denoising_unet.pth, reference_unet.pth, pose_guider.pth, motion_module.pth and audio2mesh.pt.

  • Download pretrained weight of based models and other components:
  • StableDiffusion V1.5
  • sd-vae-ft-mse
  • image_encoder
  • wav2vec2-base-960h

  • Enter the appropriate path in the node

    • AniPortrait