ComfyUI-DepthCrafter-Nodes

ComfyUI-DepthCrafter-Nodes
★ 249

视频深度估计多帧一致性ComfyUI节点模型管理
在ComfyUI中集成DepthCrafter节点,批量为视频生成一致性深度图,便于视频编辑、跟踪与3D重建
💡 为视频批量生成一致性深度图,用于编辑或3D重建
🍴 11 Forks💻 Python🔄 2025-05-05
📦
网盘下载
复制链接后前往夸克网盘下载
https://pan.quark.cn/s/e58c8376a81b
📦 requirements.txt
torch
diffusers>=0.29.1
accelerate>=0.17.0
depthcrafter
📄 README

DepthCrafter Nodes

Create consistent depth maps for your videos using DepthCrafter in ComfyUI.

Original DepthCrafter repo: https://github.com/Tencent/DepthCrafter

DepthCrafter model download available here

(Model license is limited to non-commercial academic use only)

Recommended minimum VRAM: 8GB

Updates:

(04/16/2025): Disabled forced xFormers in model loading stage to prevent issues with higher dimension inputs (e.g. 960×960) from hitting batch size cap.

(04/04/2025): Replaced max_size with force_rate parameter to automatically attempt re-sizing input resolution to match closest multiple of 64.

  • Updated requirements.txt with accelerate
  • Added warning message in node description about 64 pixel resolution multiple constraint.
  • (11/27/2024): Updated to support DepthCrafter v1.0.1 inference configuration.

    (10/25/2024): Added enable_model_cpu_offload and enable_sequential_cpu_offload options to model loader. Only enable one at a time!

  • enable_model_cpu_offload: Can save +25% of VRAM with little impact to speed by offloading models to cpu when no longer needed for inference.
  • enable_sequential_cpu_offload: Can save +37% of VRAM at the expense of slower inference speed by moving all models to CPU.
  • 🖥️ Custom Environment

    I created a custom ComfyUI environment for testing out DepthCrafter nodes:

    akatzai/comfy-env-depthcrafter:latest

    Create a new environment and copy and paste the link above into the “Custom Image” field in my Environment Manager tool:

    https://github.com/akatz-ai/ComfyUI-Environment-Manager

    Make sure to select the Basic environment type to access the included workflow!

    ⭐ Example Workflow:

    📦 Included Nodes:

  • DownloadAndLoadDepthCrafterModel: Will fetch the model files need to run DepthCrafter and save them under models/depthcrafter.
  • DepthCrafter: Renders out depthmap videos given the following inputs:
  • depthcrafter_model: (input from the first node)
  • images: (single or batch),
  • max_res: the maximum resolution of the input images, supports increments of 64 pixels. (Larger resolutions require more VRAM)
  • max_inference_steps: more steps may result in less artifacts in the output, but will take longer to render.
  • guidance_scale: (1 – 1.2 recommended)
  • window_size: the length of the context window for DepthCrafter. You can lower this to save on VRAM at the expense of taking longer to render (75-110 recommended)
  • overlap: how much to overlap each context window to render longer videos > 110 frames. (25 recommended)
  • 🔧 Installation and Usage

  • ComfyUI Manager:
  • This node pack is available to install via the ComfyUI Manager. You can find it in the Custom Nodes section by searching for “DepthCrafter” and clicking on the entry called “DepthCrafter Nodes”.
  • Clone the repository:
  • Navigate to ComfyUI/custom_nodes folder in terminal or command prompt.
  • Clone the repo using the following command:
  • git clone https://github.com/akatz-ai/ComfyUI-DepthCrafter-Nodes.git
  • Restart ComfyUI
  • Manual Model Installation

    If you have trouble using the automatic download feature of the “DownloadAndLoadDepthCrafterModel” node, you can manually download the necessary files like so:

  • Create the model directories for Depthcrafter:
  • In your models/ folder you should create a new directory called depthcrafter/
  • Inside of models/depthcrafter/ you should create 2 additional directories called tencent_DepthCrafter/ and stabilityai_stable-video-diffusion-img2vid-xt/
  • Result:

    models/

    depthcrafter/

    tencent_DepthCrafter/

    stabilityai_stable-video-diffusion-img2vid-xt/

  • Now navigate to https://huggingface.co/stabilityai/stable-video-diffusion-img2vid-xt/tree/main
  • Download the following files and directories and place them inside of model/depthcrafter/stabilityai_stable-video-diffusion-img2vid-xt/:
  • “`

    feature_extractor/preprocessor_config.json,

    image_encoder/config.json,

    image_encoder/model.fp16.safetensors,

    scheduler/scheduler_config.json,

    unet/config.json,

    unet/diffusion_pytorch_model.fp16.safetensors,

    vae/config.json,

    vae/diffusion_pytorch_model.fp16.safetensors,

    model_index.json,

    “`

    * Note: Make sure you actually have/create the subdirectories feature_extractor/, image_encoder/, scheduler/, unet/, and vae/ for the files above! *

  • Navigate to https://huggingface.co/tencent/DepthCrafter/tree/main:
  • Download the following files and place the inside of model/depthcrafter/tencent_DepthCrafter/:
  • “`

    config.json

    diffusion_pytorch_model.safetensors

    “`

    After running the node with the above files and directories installed you should be able to run DepthCrafter.