ComfyUI-IP_LAP

ComfyUI-IP_LAP
★ 34

音频驱动口型同步视频合成ComfyUI插件
ComfyUI 的 IP_LAP 自定义节点集,利用 IP_LAP 根据音频生成口型同步视频并合成音轨,包含加载、预览和合成节点,简化音频驱动视频制作流程。
💡 用音频驱动生成口型同步视频并合成音轨
🍴 10 Forks💻 Python🔄 2024-06-14
📦
网盘下载
复制链接后前往夸克网盘下载
https://pan.quark.cn/s/b6135d9bd930
📦 requirements.txt
face_alignment
mediapipe
basicsr
lws
librosa
moviepy
pydub
📄 README

ComfyUI-IP_LAP

the comfyui custom node of IP_LAP to make audio driven videos!

How to use

make sure ffmpeg is worked in your commandline

for Linux

apt update
apt install ffmpeg

for Windows,you can install ffmpeg by WingetUI automatically

then!

git clone https://github.com/AIFSH/ComfyUI-IP_LAP.git
cd ComfyUI-IP_LAP
pip install -r requirements.txt

download weights or OneDrive and put the *.pth files in ComfyUI-IP_LAP/weights

Windows

There is a portable standalone build for Windows that should work for running on Nvidia GPUs and cuda>=11.8,

click the link to download

Tutorial

  • Demo
  • FULL WorkFLOW
  • WeChat Group && Donate

    Thanks

  • NativeSpeakerUI
  • IP_LAP