ComfyUI-CogVideoX-MZ

ComfyUI-CogVideoX-MZ
★ 110

模型加载CogVideoX视频生成ComfyUI扩展
在ComfyUI中加载CogVideoX-5B模型的节点,简化模型文件放置与接入,便于在管道中调用视频生成能力。
💡 在ComfyUI管道中快速加载并使用CogVideoX-5B进行视频生成。
🍴 3 Forks💻 Python🔄 2024-10-30
📦
网盘下载
复制链接后前往夸克网盘下载
https://pan.quark.cn/s/8b0992d318c3
image
📄 README

ComfyUI-CogVideoX-MZ

在 https://github.com/kijai/ComfyUI-CogVideoXWrapper 的基础上增加一个独立的模型加载器和一些其他的功能, 使用前需要先安装ComfyUI-CogVideoXWrapper

Based on https://github.com/kijai/ComfyUI-CogVideoXWrapper add model loader and some other features, you need to install ComfyUI-CogVideoXWrapper before using

Update – 2024-09-24

添加vae encode tiling开关, 在16G显存下可以生成1024分辨率的视频不会OOM

(add vae encode tiling switch, can generate 1024 resolution video without OOM on 16G vram)

Update – 2024-09-22

支持CogVideoX-I2V图生视频, 提供Q4量化模型

(support CogVideoX-I2V image to video, provide Q4 quantization model)

CogVideoX_5b_I2V_GGUF_Q4_0.safetensors 下载到unet文件夹 (Donwload to unet folder)

工作流在examples\workflow_I2V_GGUF_Q4_0.png (Workflow in examples\workflow_I2V_GGUF_Q4_0.png)

Prompt :The girl in the video happily puts on sunglasses.

https://github.com/user-attachments/assets/3eae12b7-1a2d-40c5-b6fb-10afb1349f4e

Update – 2024-09-19

支持CogVideoX-Fun图生视频, 提供Q4量化模型

(support CogVideoX-Fun image to video, provide Q4 quantization model)

CogVideoX_Fun_GGUF_Q4_0.safetensors 下载到unet文件夹 (Donwload to unet folder)

工作流在examples\workflow_FUN_I2V_GGUF_Q4_0.png (Workflow in examples\workflow_FUN_I2V_GGUF_Q4_0.png)

Prompt :The girl in the video happily puts on sunglasses.

https://github.com/user-attachments/assets/32101df0-d50c-404a-a2ea-3ddff0dcc59b

Update – 2024-09-05

部分层4位量化模型, 采样方式选择DPM, weight_dtype选择GGUF, cpu_offload不启用分辨率480×720在32帧下占用显存小于8G

(CogVideoX-5B 4-bit quantization model, when using it, the sampling method needs to select DPM, weight_dtype selects GGUF, and cpu_offload is not enabled)

CogVideoX_5b_GGUF_Q4_0.safetensors 下载到unet文件夹

4位量化工作流在examples\workflow_GGUF_Q4_0.png

使用

CogVideoX-5B的模型加载器

依赖 https://github.com/kijai/ComfyUI-CogVideoXWrapper

模型下载地址

CogVideoX_5b_fp8_4em.safetensors 下载到unet文件夹

diffusion_pytorch_model.safetensors 下载到vae文件夹(记得重命名文件名方便辨认)

t5xxl_fp8_e4m3fn.safetensors 下载到clip文件夹(和sd3/flux通用,不需要重复下载)

工作流在examples/*.png

Usage

CogVideoX-5B model loader

Depends on https://github.com/kijai/ComfyUI-CogVideoXWrapper

Model download address

CogVideoX_5b_fp8_4em.safetensors Download to unet folder

diffusion_pytorch_model.safetensors Download to vae folder (remember to rename the file name for easy identification)

t5xxl_fp8_e4m3fn.safetensors Download to clip folder (universal with sd3/flux, no need to download repeatedly)

Workflow in examples/*.png

Credits

  • CogVideo
  • CogVideoX-Fun
  • ComfyUI-CogVideoXWrapper