ComfyUI-Stable-Video-Diffusion

ComfyUI-Stable-Video-Diffusion
★ 375

视频生成帧插值高帧率ComfyUI 插件
在 ComfyUI 中直接使用 Stable Video Diffusion 生成与编辑视频，支持帧插值与高帧率输出，便于集成到可视化工作流中。
💡 将图像或文本提示快速生成流畅视频并进行帧插值处理。
🍴 29 Forks💻 Python🔄 2024-05-24
📦
网盘下载
复制链接后前往夸克网盘下载
https://pan.quark.cn/s/51137d50651f
📦 requirements.txt
numpy
fsspec
matplotlib
requests
omegaconf
transformers
pytorch-lightning
packaging
regex
ftfy
tqdm
sentencepiece
protobuf
pyyaml
huggingface_hub
workflow graph
sample output
workflow graph
sample output
📄 README

ComfyUI Stable Video Diffusion

Easily use Stable Video Diffusion inside ComfyUI!

[](https://discord.gg/MfVCahkc2y)

  • Installation
  • Node types
  • Example workflows
  • Image to video
  • Image to video generation (high FPS w/ frame interpolation)

    • Need help? Join our Discord!

    1. Installation

    Option 1: Install via ComfyUI Manager

    Open ComfyUI Manager and install the ComfyUI Stable Video Diffusion (author: thecooltechguy) custom node.

    Option 2: Install manually

    cd ComfyUI/custom_nodes/
git clone https://github.com/thecooltechguy/ComfyUI-Stable-Video-Diffusion
cd ComfyUI-Stable-Video-Diffusion/
python install.py

    2. Download models into ComfyUI/models/svd/

  • svd.safetensors – Download
  • svd_image_decoder.safetensors – Download
  • svd_xt.safetensors – Download
  • svd_xt_image_decoder.safetensors – Download

    • Node types

  • SVDModelLoader
  • Loads the Stable Video Diffusion model
  • SVDSampler
  • Runs the sampling process for an input image, using the model, and outputs a latent
  • SVDDecoder
  • Decodes the sampled latent into a series of image frames
  • SVDSimpleImg2Vid
  • Combines the above 3 nodes above into a single node

    • Example workflows

    Image to video

    https://comfyworkflows.com/workflows/5a4cd9fd-9685-4985-adb8-7be84e8636ad

    Image to video generation (high FPS w/ frame interpolation)

    https://comfyworkflows.com/workflows/bf3b455d-ba13-4063-9ab7-ff1de0c9fa75