InteriorDesign-for-ComfyUI

InteriorDesign-for-ComfyUI
★ 16

ComfyUI室内设计语义分割ControlNet
为ComfyUI重构的室内设计图像管线节点,集成语义分割、图像归一化与深度映射,并将自定义ControlNet输入UNet以提升室内场景生成质量与细节。
💡 在ComfyUI中生成或优化高保真室内场景图像。
🍴 7 Forks💻 Python🔄 2025-08-07
📦
网盘下载
复制链接后前往夸克网盘下载
https://pan.quark.cn/s/e98a62d17551
📦 requirements.txt
torch
transformers
Pillow
numpy
scipy
Preview
📄 README

🛋️ Interior Design for ComfyUI v2.0

This project adapts the original pipeline from

StableDesign: 2nd place solution for the Generative Interior Design 2024 competition

to work natively and fully inside ComfyUI, leveraging modern custom nodes and a modular architecture.

Learn more about the original method in this Medium article.


✅ Key Features

  • Fully restructured for ComfyUI compatibility
  • Includes 3 custom nodes developed specifically for this repository:
  • "Interior Design Segmentator"
  • "Image Normalize"
  • "Control Items"
  • Uses additional advanced custom nodes:
  • Depth Anything V2
  • ComfyUI_IPAdapter_plus
  • Reimplements only the necessary components from the original pipeline, such as:
  • Semantic segmenter using openmmlab/upernet-convnext-small
  • Supports standard ComfyUI workflows with ControlNet and IP Adapter integration
  • Compatible with other workflows and custom models
  • Inference is significantly faster than the original pipeline (test the workflow and compare).

  • 🧱 Pipeline Overview

  • The idea was to use as many nodes from the ComfyUI core as possible. However, for certain tasks, I had to rely on custom nodes or adapt my own nodes to stay as faithful as possible to the original pipeline, or alternatively, use dependencies from other custom node repositories.
  • Uses the same base models as the original StableDesign pipeline
  • Includes custom ControlNet models:
  • controlnet_depth
  • own_controlnet (segmentation)
  • These ControlNets, along with the depth map and segmentation map, are passed into the UNet of the diffusion model
  • Final step includes refinement with latent noise injection and up/down-scaling(because of the size limitation of the original pipeline)

  • 📁 Example Workflow

    An example workflow is included in this repository:

    stable-design-for-comfyui.json

    You can load it directly into ComfyUI to test or extend the pipeline.


    📦 Installation & Dependencies

    This node is available on ComfyUI Manager

    You must also install the following custom nodes manually if not yet available:

  • Depth Anything V2
  • ComfyUI_IPAdapter_plus *(note: unmaintained)*
  • ComfyMath

  • 🔧 Upcoming Features

  • Expansion of Control Items: Add support for more semantic regions and control inputs to increase flexibility and detail in generation.
  • Evaluation of CLIP Conditioning: Reassess the combination of positive and negative CLIP embeddings in ControlNet to verify if results match the original pipeline’s behavior.
  • Custom IP Adapter Node: Implement a native IP Adapter node to replace the current dependency on ComfyUI_IPAdapter_plus, which is currently unmaintained.

  • 🧪 License & Acknowledgements

    Original pipeline by MykolaL (StableDesign on Hugging Face)

    This adaptation reuses only essential logic, converted to full ComfyUI-compatible workflow format.


    feel free to open issues and PRs