ComfyUI-MimicMotion

ComfyUI-MimicMotion
★ 387

动画生成人像驱动MimicMotionComfyUI扩展
ComfyUI 的自定义节点,集成 Tencent 的 MimicMotion,通过参考图片或参考视频将静态人像驱动为动作动画,便于在 ComfyUI 工作流中一键生成动画。
💡 用参考视频驱动静态人像生成动作动画。
🍴 30 Forks💻 Python🔄 2024-08-06
📦
网盘下载
复制链接后前往夸克网盘下载
https://pan.quark.cn/s/b6135d9bd930
📦 requirements.txt
diffusers
transformers
decord
einops
omegaconf
onnxruntime-gpu
moviepy
matplotlib
opencv-python
accelerate
av
📄 README

ComfyUI-MimicMotion

a comfyui custom node for MimicMotion

workflow

Example

test on 2080ti 11GB torch==2.3.0+cu121 python 3.10.8

  • input
  • refer_img

    refer_video

  • output
  • https://github.com/Tencent/MimicMotion/assets/149982694/940a4aa0-a174-48e6-add7-96bb74ea916e

    How to use

    make sure ffmpeg is worked in your commandline

    for Linux

    apt update
    apt install ffmpeg

    for Windows,you can install ffmpeg by WingetUI automatically

    then!

    ## insatll xformers match your torch,for torch==2.1.0+cu121
    pip install xformers==0.0.22.post7
    
    ## in ComfyUI/custom_nodes
    git clone https://github.com/AIFSH/ComfyUI-MimicMotion.git
    cd ComfyUI-MimicMotion
    pip install -r requirements.txt

    weights will be downloaded from huggingface

    Tutorial

    -【MimicMotion! ComfyUI插件来了-哔哩哔哩】 https://b23.tv/McnRUpd

  • QQ群:852228202
  • Thanks

    MimicMotion