ComfyUI-MuseTalk

★ 288

对话式控制工作流管理参数调整ComfyUI 插件

在 ComfyUI 中集成 MuseTalk，实现对话式控制与工作流管理，方便通过自然语言交互创建、调整和运行生成流程。

💡 通过对话式界面在 ComfyUI 中创建并管理图像生成工作流。

🍴 37 Forks💻 Python🔄 2024-05-22

🔗 GitHub 原文

📦

网盘下载

复制链接后前往夸克网盘下载

https://pan.quark.cn/s/2df45d172dc1

📦 requirements.txt

numpy
torch
tqdm
more-itertools
transformers>=4.19.0
ffmpeg-python==0.2.0

📄 README

ComfyUI-MuseTalk

workflow

https://github.com/chaojie/ComfyUI-MuseTalk/blob/main/wf.json

Installation

Build environment

pip install -r requirements.txt

mmlab packages

pip install --no-cache-dir -U openmim 
mim install mmengine 
mim install "mmcv>=2.0.1" 
mim install "mmdet>=3.1.0" 
mim install "mmpose>=1.1.0"

Download weights

You can download weights manually as follows:

Download our trained weights.

Download the weights of other components:

Finally, these weights should be organized in models as follows:

ComfyUI/models/diffusers/TMElyralab/MuseTalk/
├── musetalk
│   └── musetalk.json
│   └── pytorch_model.bin
├── dwpose
│   └── dw-ll_ucoco_384.pth
├── face-parse-bisent
│   ├── 79999_iter.pth
│   └── resnet18-5c106cde.pth
├── sd-vae-ft-mse
│   ├── config.json
│   └── diffusion_pytorch_model.bin
└── whisper
    └── tiny.pt