ComfyUI-I2VGEN-XL

ComfyUI-I2VGEN-XL
★ 28

视频生成模型集成ComfyUI节点显存优化
在 ComfyUI 中集成 i2vgen-xl 节点，便捷调用 i2vgen-xl 进行视频/动画生成，并提供安装、依赖与显存优化提示以降低出错率
💡 在 ComfyUI 流程中调用 i2vgen-xl 生成视频或动画
🍴 5 Forks💻 Python🔄 2024-06-14
📦
网盘下载
复制链接后前往夸克网盘下载
https://pan.quark.cn/s/2df45d172dc1
📦 requirements.txt
easydict>=1.10
tokenizers>=0.12.1
numpy>=1.19.2
ftfy>=6.1.1
transformers>=4.18.0
imageio>=2.15.0
fairscale>=0.4.6
ipdb
open-clip-torch>=2.0.2
xformers>=0.0.13
chardet>=5.1.0
torchdiffeq>=0.2.3
opencv-python>=4.4.0.46
opencv-python-headless>=4.7.0.68
torchsde>=0.2.6
simplejson>=3.18.4
scikit-learn
scikit-image
rotary-embedding-torch>=0.2.1
pynvml>=11.5.0
pytorch-lightning>=1.4.2
torchmetrics>=0.6.0
imageio-ffmpeg
📄 README

This is an implementation of i2vgen-xl

i2vgen-xl

Install

  • Clone this repo into custom_nodes directory of ComfyUI location

  • Run pip install -r requirements.txt

    • How to fix problems:

  • ValueError: attempted relative import beyond top-level package

    • Delete all content in file ~/.cache/modelscope/hub/damo/i2vgen-xl/tools/__init__.py

    Delete all content in file ~/.cache/modelscope/hub/damo/i2vgen-xl/tools/modules/__init__.py

  • CUDA out of memory

    • Edit ~/.cache/modelscope/hub/damo/i2vgen-xl/ms_wrapper.py

    change self.model.to(gpu) to self.model.half().to(gpu)

    Examples

  • base workflow

    • https://github.com/chaojie/ComfyUI-I2VGEN-XL/blob/main/workflow.json