diffusers

“`sh
{
“width”: 832,
“height”: 512,
“pmts_environment”:
{
“pmt_scene” : “a farm in the grasslands of Iowa at golden hour”,
“pmt_style” : “high-quality architectural rendering”,
“pmt_negative” : “low-res, watermark, ugly”,
},
“map_semantic”:
[
{
“pmt_txt”: “mid-century modern farmhouse with Shou Sugi Ban siding”,
“pmt_img”: null,
“mask”: “BASE 64 ENCODED BITMAP”,
“pct”: 0.75
},
{
“pmt_txt”: “an text prompt for the object, MAY BE NULL or EMPTY”,
“pmt_img”: “BASE 64 ENCODED BITMAP of a guidence image, MAY BE NULL OR EMPTY”,
“mask”: “BASE 64 ENCODED BITMAP”,
“pct”: 0.00
},
…
],
“img_depth”: “BASE 64 ENCODED IMAGE”,
“img_edge”: “optional BASE 64 ENCODED IMAGE”,
“img_style”: “optional BASE 64 ENCODED IMAGE”,
“pseudorandom_snapshot_version”: 0.1
}
“`
“`sh
{
“pseudorandom_snapshot_version”: 0.4,
“width”: 1600,
“height”: 900,
“global_guidance”: {
“txt_scene”: “Two-story timber atrium with mezzanine ring and clerestory.”,
“txt_style”: “Soft daylight, neutral white balance, editorial photo.”,
“txt_negative”: “No text, no watermark, no warped structure.”,
“img_style”: “data:image/jpeg;base64,/9j/4AAQSkZJRgABAQ…”
},
“regional_guidance”: [
{
“txt”: “white oak planks, matte finish, tight grain”,
“img”: null,
“mask”: “data:image/png;base64,iVBORw0KGgoAAA…”,
“pct”: 38.2
},
{
“txt”: null,
“img”: “data:image/png;base64,iVBORw0KGgoAAA…”,
“mask”: “data:image/png;base64,iVBORw0KGgoAAA…”,
“pct”: 12.7
}
],
“spatial_guidance”: {
“depth”: “data:image/png;base64,iVBORw0KGgoAAA…”,
“edge”: “data:image/png;base64,iVBORw0KGgoAAA…”
}
}
“`
Note: The PseudoUnpackModelSnapshot node supports both v0.1 and v0.4 formats with automatic detection and backwards compatibility. The v0.4 format provides a cleaner structure with three guidance categories: global_guidance, regional_guidance, and spatial_guidance.
IMPORTANT: If you’re using the Windows portable version of ComfyUI, which includes an embedded Python environment, you will first need to install the diffusers module:
diffusers library for ComfyUI (Windows Portable Version)ComfyUI_windows_portable directory.ComfyUI Windows Portable Directory via a Command Prompt:Win + R, or typing cmd, and pressing Enter.cd command to change the current directory to the ComfyUI_windows_portable directory. For example:“`sh
cd C:\path\to\your\ComfyUI_windows_portable
“`
ComfyUI_windows_portable directory, run the following command:“`sh
.\python_embeded\python.exe -m pip install diffusers
“`
it should look like this:
“`sh
\ComfyUI_windows_portable>.\python_embeded\python.exe -m pip install diffusers
“`
“`sh
pip install diffusers
“`
These steps will ensure that the diffusers module is installed within the embedded Python environment used by ComfyUI.
There are many places you can download depth ControlNet models, but the one we recommend is diffusion_pytorch_model.safetensors from Hugging Face.
To do this:
1) Download the model:
diffusion_pytorch_model.safetensors file from the link above (https://huggingface.co/lllyasviel/sd-controlnet-depth/tree/main).2) Move the model to the controlnet folder:
controlnet subfolder inside the models folder of your ComfyUI directory:“`sh
C:\path\to\your\ComfyUI_windows_portable\ComfyUI\models\controlnet
“`
depth.Manager > Model Manager (Install Models)Manager > Custom Nodes Manager (Install Custom Nodes)Install on the one called ComfyUI_IPAdapter_plus by cubiq/ComfyUI/models/clip_vision part:...\models\clip_visionC:\path\to\your\ComfyUI_windows_portable\ComfyUI\modelsmodels, create a new folder called ipadapter.safetensors files of your choice depending on the preferred SD versionip-adapter-plus_sd15.safetensors, *”Plus model, very strong”* versionip-adapter-plus_sdxl_vit-h.safetensors, *”SDXL plus model”* version...\models\ipadapterWe recommend:
Clone this repo inside your custom_nodes folder by:
C:\path\to\your\ComfyUI_windows_portable\ComfyUI\custom_nodes“`sh
git clone https://github.com/Pseudotools/Pseudocomfy.git
“`
This project incorporates code that has been adapted or directly copied from the following open-source packages:
Original source: https://github.com/huchenlei/ComfyUI_densediffusion
Original source: https://github.com/cubiq/ComfyUI_IPAdapter_plus
Original source: https://github.com/ltdrdata/ComfyUI-Impact-Pack
The code from these packages is used under the terms of their respective licenses, with modifications made to fit the specific requirements of this project. The contributions of these developers are greatly appreciated, and their work has been instrumental in the development of this project.