ComfyUI-MimicMotionWrapper

ComfyUI-MimicMotionWrapper
★ 519

视频扩散动作迁移模型自动管理ComfyUI节点
ComfyUI-MimicMotionWrapper 是为 MimicMotion 提供的 ComfyUI 优化封装节点,自动安装依赖并管理模型,简化图像到视频与动作迁移的集成与使用。
💡 在 ComfyUI 中快速构建图像到视频/动作迁移管线
🍴 40 Forks💻 Python🔄 2025-01-12
📦
网盘下载
复制链接后前往夸克网盘下载
https://pan.quark.cn/s/b45acaa3411d
📦 requirements.txt
diffusers>=0.28.0
transformers>=4.32.1
accelerate
📄 README

WORK IN PROGRESS

MimicMotion wrapper for ComfyUI

Installation

Clone this repo into custom_nodes folder.

Install dependencies: pip install -r requirements.txt

or if you use the portable install, run this in ComfyUI_windows_portable -folder:

python_embeded\python.exe -m pip install -r ComfyUI\custom_nodes\ComfyUI-MimicMotionWrapper\requirements.txt

Models are auto downloaded to their respective folders.

SVD XT:

\ComfyUI\models\diffusers\stable-video-diffusion-img2vid-xt-1-1

│   model_index.json
│
├───feature_extractor
│       preprocessor_config.json
│
├───image_encoder
│       config.json
│       model.fp16.safetensors
│
├───scheduler
│       scheduler_config.json
│
├───unet
│       config.json
│       diffusion_pytorch_model.fp16.safetensors
│
└───vae
        config.json
        diffusion_pytorch_model.fp16.safetensors

MimicMotion -model (3.05 GB), to ComfyUI\models\mimicmotion:

https://huggingface.co/Kijai/MimicMotion_pruned/tree/main

This needs Fp16 version (4.19 GB) diffusers version of SVD XT 1.1 to ComfyUI/models/diffusers:

https://huggingface.co/stabilityai/stable-video-diffusion-img2vid-xt-1-1/tree/main

https://github.com/kijai/ComfyUI-MimicMotionWrapper/assets/40791699/c1517e20-8537-4ab0-b6fb-2d4aefa618d2

Original repo:

https://github.com/tencent/MimicMotion