ComfyUI-LivePortrait_v2

ComfyUI-LivePortrait_v2
★ 5

ComfyUI节点视频驱动表情包生成拼接与重定向
ComfyUI节点,基于LivePortrait_v2通过视频驱动物像生成动物表情图,支持拼接与重定向控制,灵活易用。
💡 用视频驱动动物头像生成动态图像或表情包。
🍴 1 Forks💻 Python🔄 2024-11-09
📦
网盘下载
复制链接后前往夸克网盘下载
https://pan.quark.cn/s/9d76119b2ef2
📦 requirements.txt
torch==2.3.0+cu121
torchaudio==2.3.0+cu121
torchmetrics==1.5.1
torchscale==0.3.0
torchsde==0.2.6
torchvision==0.18.0+cu121
absl-py==2.1.0
accelerate==0.34.2
addict==2.4.0
aggdraw==1.3.19
aiofiles==23.2.1
aiohappyeyeballs==2.4.0
aiohttp==3.10.5
aioresponses==0.7.6
aiosignal==1.3.1
albucore==0.0.14
albumentations==1.4.10
altair==5.4.1
annotated-types==0.7.0
anthropic==0.34.2
antlr4-python3-runtime==4.9.3
anyio==4.4.0
APScheduler==3.10.1
arrow==1.3.0
async-timeout==4.0.3
attrs==24.2.0
av==12.3.0
awscli==1.33.44
backoff==2.2.1
basicsr==1.4.2
beautifulsoup4==4.12.3
binaryornot==0.4.4
bitsandbytes==0.44.1
blend_modes==2.1.0
blind-watermark==0.4.4
boto3==1.34.123
botocore==1.34.162
cachetools==5.5.0
certifi==2024.8.30
cffi==1.17.0
cfgv==3.4.0
chardet==5.2.0
charset-normalizer==3.3.2
click==8.1.7
clip-interrogator==0.6.0
cmake==3.30.2
color-matcher==0.5.0
colorama==0.4.4
coloredlogs==15.0.1
colorlog==6.8.2
colour-science==0.4.4
contourpy==1.3.0
cookiecutter==2.6.0
cryptography==43.0.0
cssselect2==0.7.0
cstr
@
git+https://github.com/WASasquatch/cstr@0520c29a18a7a869a6e5983861d6f7a4c86f8e9b
ctranslate2==4.5.0
cycler==0.12.1
Cython==3.0.0
dataclasses-json==0.6.7
ddt==1.7.2
decord==0.6.0
deepspeed==0.15.1
defusedxml==0.7.1
Deprecated==1.2.14
diffusers==0.31.0
dill==0.3.8
distlib==0.3.9
distro==1.9.0
dlib
@
file:///home/conda/feedstock_root/build_artifacts/dlib-split_1726093008991/work
docker==6.1.3
docker-pycreds==0.4.0
docopt==0.6.2
docstring_parser==0.16
docutils==0.16
easydict==1.13
einops==0.8.0
embreex==2.17.7.post5
exceptiongroup==1.2.2
fairscale==0.4.13
fal_client==0.5.2
fastapi==0.110.3
faster-whisper==1.0.3
ffmpeg==1.4
ffmpeg-python==0.2.0
ffmpy
@
git+https://github.com/WASasquatch/ffmpy.git@f000737698b387ffaeab7cd871b0e9185811230d
ffprobe==0.5
filelock==3.13.1
flatbuffers==24.3.25
flet==0.24.1
flet-core==0.24.1
flet-runtime==0.24.1
fonttools==4.53.1
frozenlist==1.4.1
fsspec==2024.2.0
ftfy==6.2.3
future==1.0.0
fvcore==0.1.5.post20221221
gdown==5.2.0
gitdb==4.0.11
GitPython==3.1.43
GPUtil==1.4.0
gradio==4.37.1
gradio_client==1.0.2
grpcio==1.66.1
grpcio-status==1.66.1
h11==0.14.0
hjson==3.1.0
httpcore==1.0.5
httplib2==0.22.0
httptools==0.6.1
httpx==0.27.2
httpx-sse==0.4.0
huggingface-hub==0.23.4
humanfriendly==10.0
hydra-core==1.3.2
identify==2.6.1
idna==3.8
imageio==2.34.2
imageio-ffmpeg==0.5.1
img2texture
@
git+https://github.com/WASasquatch/img2texture.git@d6159abea44a0b2cf77454d3d46962c8b21eb9d3
importlib_metadata==8.5.0
importlib_resources==6.4.4
inference-cli==0.20.1
inference-gpu==0.20.1
iniconfig==2.0.0
insightface==0.7.3
instructor==1.6.3
iopath==0.1.10
jax==0.4.31
jaxlib==0.4.31
Jinja2==3.1.4
jiter==0.5.0
jmespath==1.0.1
joblib==1.4.2
json_repair==0.30.0
jsonschema==4.23.0
jsonschema-specifications==2023.12.1
kaldi-native-fbank==1.20.0
kiwisolver==1.4.5
kornia==0.7.3
kornia_rs==0.1.5
lark-parser==0.12.0
lazy_loader==0.4
lightning-utilities==0.11.8
llvmlite==0.43.0
lmdb==1.4.1
loguru==0.7.2
loralib==0.1.2
lxml==5.3.0
manifold3d==2.5.1
mapbox_earcut==1.0.2
Markdown==3.7
markdown-it-py==3.0.0
MarkupSafe==2.1.5
marshmallow==3.22.0
matplotlib==3.9.2
matrix-client==0.4.0
mdurl==0.1.2
mediapipe==0.10.15
ml-dtypes==0.4.0
mpmath==1.3.0
mss==9.0.2
multidict==6.0.5
MultiScaleDeformableAttention==1.0
mypy-extensions==1.0.0
narwhals==1.6.0
natsort==8.4.0
networkx==3.2.1
ninja==1.11.1.1
nodeenv==1.9.1
numba==0.60.0
numpy==1.26.4
nvidia-cublas-cu12==12.1.3.1
nvidia-cuda-cupti-cu12==12.1.105
nvidia-cuda-nvrtc-cu12==12.1.105
nvidia-cuda-runtime-cu12==12.1.105
nvidia-cudnn-cu12==8.9.2.26
nvidia-cufft-cu12==11.0.2.54
nvidia-curand-cu12==10.3.2.106
nvidia-cusolver-cu12==11.4.5.107
nvidia-cusparse-cu12==12.1.0.106
nvidia-ml-py==12.560.30
nvidia-nccl-cu12==2.20.5
nvidia-nvjitlink-cu12==12.1.105
nvidia-nvtx-cu12==12.1.105
oauthlib==3.2.2
omegaconf==2.3.0
onnx==1.16.1
onnxruntime==1.19.2
onnxruntime-gpu==1.15.1
open_clip_torch==2.26.1
openai==1.52.1
opencv-contrib-python==4.10.0.84
opencv-python==4.10.0.84
opencv-python-headless==4.10.0.84
opt-einsum==3.3.0
orjson==3.10.7
packaging==24.1
pandas==2.2.2
peft==0.12.0
pendulum==3.0.0
piexif==1.1.3
pilgram==1.2.1
pillow==10.4.0
pixeloe==0.0.10
platformdirs==4.2.2
pluggy==1.5.0
pooch==1.8.2
portalocker==2.10.1
positional-encodings==6.0.3
pre_commit==4.0.1
prettytable==3.11.0
prometheus-fastapi-instrumentator==6.0.0
prometheus_client==0.21.0
proto-plus==1.24.0
protobuf==5.28.3
psd-tools==1.10.0
psutil==5.9.8
PuLP==2.9.0
py-cpuinfo==9.0.0
pyasn1==0.6.1
pyasn1_modules==0.4.1
pybase64==1.4.0
pycollada==0.8
pycparser==2.22
pydantic==2.8.2
pydantic-settings==2.5.2
pydantic_core==2.20.1
pydot==3.0.2
pydub==0.25.1
PyGithub==2.4.0
Pygments==2.18.0
PyJWT==2.9.0
pykalman==0.9.7
PyMatting==1.1.12
PyNaCl==1.5.0
pyOpenSSL==24.2.1
pyparsing==3.1.4
pypng==0.20220715.0
PySocks==1.7.1
pytest==8.3.3
pytest-asyncio==0.21.1
python-dateutil==2.9.0.post0
python-dotenv==1.0.1
python-multipart==0.0.9
python-slugify==8.0.4
pytorch-lightning==2.4.0
pytz==2024.1
PyWavelets==1.7.0
PyYAML==6.0.1
pyzbar==0.1.9
qrcode==7.4.2
redis==5.0.8
referencing==0.35.1
regex==2024.7.24
rembg==2.0.59
repath==0.9.0
reportlab==4.2.5
requests==2.31.0
requests-file==2.1.0
requests-toolbelt==1.0.0
rf-clip==1.1
rich==13.9.3
rpds-py==0.20.0
rsa==4.7.2
Rtree==1.3.0
ruff==0.6.3
s3transfer==0.10.2
safetensors==0.4.4
scenedetect==0.6.4
scikit-image==0.24.0
scikit-learn==1.5.1
scipy==1.13.1
seaborn==0.13.2
segment-anything==1.0
semantic-version==2.10.0
sensevoice-onnx
@
git+https://github.com/shadowcz007/SenseVoice-python.git@43f6cf1531e7e4a7d7507d37fbc9b0fb169166ab
sentencepiece==0.2.0
sentry-sdk==2.14.0
setproctitle==1.3.3
shapely==2.0.6
shellingham==1.5.4
shtab==1.7.1
simpleeval==1.0.0
six==1.16.0
skypilot==0.5.0
smmap==5.0.1
sniffio==1.3.1
sounddevice==0.5.0
soundfile==0.12.1
soupsieve==2.6
spaces==0.30.3
spandrel==0.3.4
starlette==0.37.2
structlog==24.4.0
supervision==0.22.0
svg.path==6.3
svglib==1.5.1
swarm
@
git+https://github.com/openai/swarm.git@9db581cecaacea0d46a933d6453c312b034dbf47
sympy==1.12
tabulate==0.9.0
tb-nightly==2.18.0a20240911
tenacity==9.0.0
tensorboard-data-server==0.7.2
termcolor==2.5.0
text-unidecode==1.3
threadpoolctl==3.5.0
tifffile==2024.8.30
time-machine==2.15.0
timm==0.6.13
tinycss2==1.3.0
tldextract==5.1.2
tokenizers==0.19.1
tomli==2.0.1
tomlkit==0.12.0
tqdm==4.66.4
trampoline==0.1.2
transformers==4.44.2
transparent-background==1.3.2
trimesh==4.4.9
triton==2.3.0
typer==0.12.5
typer-config==1.4.0
types-python-dateutil==2.9.0.20240821
typing-inspect==0.9.0
typing_extensions==4.12.2
tyro==0.8.5
tzdata==2024.1
tzlocal==5.2
ultralytics==8.2.102
ultralytics-thop==2.0.8
uritemplate==4.1.1
urllib3==2.2.3
uvicorn==0.30.6
uvloop==0.20.0
vhacdx==0.0.8.post1
virtualenv==20.27.0
wandb==0.18.0
watchdog==4.0.2
watchfiles==0.24.0
wcwidth==0.2.13
webencodings==0.5.1
websocket-client==1.8.0
websockets==11.0.3
Werkzeug==3.0.4
wget==3.2
wrapt==1.16.0
xatlas==0.0.9
xxhash==3.5.0
yacs==0.1.8
yapf==0.40.2
yarl==1.9.7
zipp==3.20.1
zxing-cpp==2.2.0
image
📄 README

ComfyUI-LivePortrait_v2

https://github.com/user-attachments/assets/3bc8bb2a-7e2b-4c1f-9f09-55c38a7a86c7

https://github.com/user-attachments/assets/01ba6af3-9080-4af7-8795-11b8561e78f8

🔥 Updates

ComfyUI nodes for LivePortrait, We support animal image driven mode and regional control for Comfyui!!!

We have developed animal expression-driven nodes for ComfyUI that have the same effect as the source code.

Introduction

This repo, named ComfyUI-LivePortrait_v2, thanks to paper LivePortrait: Efficient Portrait Animation with Stitching and Retargeting Control.

We developed a custom_node for Liveportrait_v2 that enables flexible use on Comfyui to drive animal image-based emoji generation from videos.

Getting Started

Clone the code and prepare the environment

git clone https://github.com/VangengLab/ComfyUI-LivePortrait_v2.git
cd ComfyUI-LivePortrait_v2

In this node, we need dependencies related to XPose. Specifically, it needs to be configured and prepared according to the instructions on https://github.com/KwaiVGI/LivePortrait. The cuda version is preferably 12.1.

or you can refer to my environment on https://github.com/VangengLab/Comfyui_Liveportrait_v3/edit/main/README.md

Download pretrained weights

refer to https://github.com/VangengLab/Comfyui_Liveportrait_v3/edit/main/README.md

this repo will tell you all details about pretrained weights

!!!Important reminder

Since the node we developed is relatively simple and we hope that users can get started quickly, we did not open a video upload window. We need to put the expression video (of a person) that needs to be driven into

ComfyUI-LivePortrait_v2/assets/examples/driving

and enter its name in the node. According to the example in the figure, it can be completed.