comfyui-mixlab-nodes

comfyui-mixlab-nodes
★ 1,827

多模态视频生成语音识别与合成ComfyUI扩展
为 ComfyUI 提供 3D、屏幕共享、悬浮视频、语音识别/合成、GPT 与本地图片等多模态节点，便于构建视频与交互工作流。
💡 在 ComfyUI 中快速构建视频、语音与 GPT 多模态工作流
🍴 117 Forks💻 JavaScript🔄 2025-07-22
📦
网盘下载
复制链接后前往夸克网盘下载
https://pan.quark.cn/s/51137d50651f
📦 requirements.txt
numpy
pyOpenSSL
watchdog
opencv-python-headless
matplotlib
openai
torchaudio
clip-interrogator==0.6.0
transformers>=4.36.0
lark-parser
imageio-ffmpeg
rembg[gpu]
omegaconf>=2.3.0
Pillow>=9.5.0
einops>=0.7.0
trimesh>=4.0.5
huggingface-hub
scikit-image
soundfile>=0.12.1
json-repair
bitsandbytes
accelerate
scenedetect[opencv-headless]
hydra-core>=1.3.2
loralib>=0.1.2
natsort>=8.4.0
#simple-lama-inpainting
git+https://github.com/shadowcz007/SenseVoice-python.git
faster_whisper
Her 的DEMO页面
alt text
APP info
screenshare
f
randomPrompt
layers
poster
watch
alt text
main
main2
TransparentImage
FeatheredMask
help
node-not-found
alt text
📄 README

适配了最新版 comfyui 的 py3.11 ，torch 2.3.1+cu121

Mixlab nodes discord

商务合作请联系 389570357@qq.com

For business cooperation, please contact email 389570357@qq.com

最新：

  • 新增fal.ai的视频生成:Kling、RunwayGen3、LumaDreamMachine，工作流下载

  • 新增 SimulateDevDesignDiscussions，需要安装swarm和Comfyui-ChatTTS，工作流下载

  • 新增 SenseVoice

  • 新增JS-SDK，方便直接在前端项目中使用comfyui

  • 新增API调用图像生成节点 TextToImage Siliconflow，可以直接调用Siliconflow提供的flux生成图像

  • 增加 Her 的DEMO页面，和数字人对话

  • 右键菜单支持 text-to-text，方便对 prompt 词补全，支持云LLM或者是本地LLM。

  • 增加 MiniCPM-V 2.6 int4

    • This is the int4 quantized version of MiniCPM-V 2.6.

    Running with int4 version would use lower GPU memory (about 7GB).

  • 移动端适配、修改 app 模式的 Mask 编辑器

  • 增加 p5.js 作为输入节点

    • workflow

    workflow2

  • App 模式增加 batch prompt，批量提示词，可以把动态提示词批量组成后运行
  • 增加 API Key Input 节点，用于管理 LLM 的 Key,同时优化 LLM 相关节点，为后续 agent 模式做准备

  • 增加 SiliconflowLLM，可以使用由 Siliconflow 提供的免费 LLM

    • 🚀🚗🚚🏃 Workflow-to-APP

  • 新增 AppInfo 节点，可以通过简单的配置，把 workflow 转变为一个 Web APP。
  • 支持多个 web app 切换
  • 发布为 app 的 workflow，可以在右键里再次编辑了
  • web app 可以设置分类，在 comfyui 右键菜单可以编辑更新 web app
  • 支持动态提示
  • 支持把输出显示到 comfyui 背景（TouchDesigner 风格）
  • 如果转为 web app 打开是空白的，注意检查下插件目录的名字需要是：comfyui-mixlab-nodes(如果是 zip 包下载会多了个-main 的后缀，需要去掉)
  • Support multiple web app switching.
  • Add the AppInfo node, which allows you to transform the workflow into a web app by simple configuration.
  • The workflow, which is now released as an app, can also be edited again by right-clicking.
  • The web app can be configured with categories, and the web app can be edited and updated in the right-click menu of ComfyUI.

    • Example:

  • workflow

    • text-to-image

    APP-JSON:

  • text-to-image
  • image-to-image
  • text-to-text

    • 暂时支持 9 种节点作为界面上的输入节点：Load Image、VHS*LoadVideo、CLIPTextEncode、PromptSlide、TextInput*、Color、FloatSlider、IntNumber、CheckpointLoaderSimple、LoraLoader

    输出节点：PreviewImage 、SaveImage、ShowTextForGPT、VHS_VideoCombine、PromptImage

    seed 统一输入控件，支持：SamplerCustom、KSampler

    配套ps 插件

    如果遇到上传图片不成功，请检查下：局域网或者是云服务，请使用 https，端口 8189 这个服务（ 感谢 @Damien 反馈问题）

    If you encounter difficulties in uploading images, please check the following: for local network or cloud services, please use HTTPS and the service on port 8189. (Thanks to @Damien for reporting the issue.)

    🏃🚗🚚🚀 Real-time Design

    ScreenShareNode & FloatingVideoNode. Now comfyui supports capturing screen pixel streams from any software and can be used for LCM-Lora integration. Let’s get started with implementation and design! 💻🌐

    https://github.com/shadowcz007/comfyui-mixlab-nodes/assets/12645064/e7e77f90-e43e-410a-ab3a-1952b7b4e7da

    ScreenShareNode & FloatingVideoNode

    !! Please use the address with HTTPS (https://127.0.0.1).

    SpeechRecognition & SpeechSynthesis

    Voice + Real-time Face Swap Workflow

  • Preview Audio

    • text-to-audio

    GPT

    Support for calling multiple GPTs.Local LLM 、 ChatGPT、ChatGLM3 、ChatGLM4 , Some code provided by rui. If you are using OpenAI’s service, fill in https://api.openai.com/v1 . If you are using a local LLM service, fill in http://127.0.0.1:xxxx/v1 . Azure OpenAI:https://xxxx.openai.azure.com

    LLM_base_workflow

  • SiliconflowLLM
  • ChatGPTOpenAI

    • randomPrompt

    ClipInterrogator

    add clip-interrogator

    PromptImage & PromptSimplification,Assist in simplifying prompt words, comparing images and prompt word nodes.

    ChinesePrompt && PromptGenerate，中文 prompt 节点，直接用中文书写你的 prompt

    Layers

    A new layer class node has been added, allowing you to separate the image into layers. After merging the images, you can input the controlnet for further processing.

    The composite images node overlays a foreground image onto a background image at specified positions and scales, with optional blending modes and masking capabilities. position : ‘overall’,”center_center”,”left_bottom”,”center_bottom”,”right_bottom”,”left_top”,”center_top”,”right_top”

    3D

    workflow

    workflow

    Image

    LoadImagesToBatch

    Upload multiple images for batch input into the IP adapter.

    LoadImagesFromLocal

    Monitor changes to images in a local folder, and trigger real-time execution of workflows, supporting common image formats, especially PSD format, in conjunction with Photoshop.

    workflow-4

    LoadImagesFromURL

    Conveniently load images from a fixed address on the internet to ensure that default images in the workflow can be executed.

    TextImage

    下载字体放到 custom_nodes/comfyui-mixlab-nodes/assets/fonts

    MiniCPM-VQA Simple

    This is the int4 quantized version of MiniCPM-V 2.6.

    Running with int4 version would use lower GPU memory (about 7GB).

    模型

    Style

    Apply VisualStyle Prompting , Modified from ComfyUI_VisualStylePrompting

    StyleAligned , Modified from style_aligned_comfy

    Utils

    The Color node provides a color picker for easy color selection, the Font node offers built-in font selection for use with TextImage to generate text images, and the DynamicDelayByText node allows delayed execution based on the length of the input text.

  • 添加了 DynamicDelayByText 功能，可以根据输入文本的长度进行延迟执行。

  • Added DynamicDelayByText, enabling delayed execution based on input text length.

  • 使用 CkptNames 对比不同的模型效果

  • CkptNames compare the effects of different models.

    • Other Nodes

  • 增加 Edit Mask，方便在生成的时候手动绘制 mask workflow

    • workflow-1

    TransparentImage

    FeatheredMask、SmoothMask

    Add edges to an image.

    LaMaInpainting（需要手动安装）

  • simple-lama-inpainting 里的 pillow 造成冲突，暂时从依赖里移除，如果有安装 simple-lama-inpainting ，节点会自动添加，没有，则不会自动添加。

    • from simple-lama-inpainting

  • 问题汇总

    • rembgNode

    “briarmbg”,”u2net”,”u2netp”,”u2net_human_seg”,”u2net_cloth_seg”,”silueta”,”isnet-general-use”,”isnet-anime”

    _ briarmbg _ model was developed by BRlA Al and can be used as an open-source model for non-commercial purposes

    Enhancement

  • Direct “Help” option accessible through node context menu.

  • “Nodes Map” feature added to global context menu.

  • An improvement has been made to directly redirect to GitHub to search for missing nodes when loading the graph.

    • *** If not needed, you can comment out “app.showMissingNodesError` in the `ui_mixlab.js“ file.

  • Right-click shortcut

    • 右键菜单支持 text-to-text，方便对 prompt 词补全，支持云LLM或者是本地LLM。

    The right-click menu supports text-to-text conversion, facilitating prompt word completion, and supports cloud LLMs or local LLMs.

    Local LLM API example:“http://localhost:1234/v1“

    Models

  • Download TripoSR and place it in models/triposr

  • Download facebook/dino-vitb16 and place it in models/triposr/facebook/dino-vitb16

    • Download rembg Models,move to:models/rembg

    Download lama, move to : models/lama

    Download Salesforce/blip-image-captioning-base, move to :models/clip_interrogator/Salesforce/blip-image-captioning-base

    Download succinctly/text2image-prompt-generator,move to:models/prompt_generator/text2image-prompt-generator

    Download Helsinki-NLP/opus-mt-zh-en,move to:models/prompt_generator/opus-mt-zh-en

    Installation

    manually install, simply clone the repo into the custom_nodes directory with this command:

    cd ComfyUI/custom_nodes

git clone https://github.com/shadowcz007/comfyui-mixlab-nodes.git

    Install the requirements:

    run directly:

    cd ComfyUI/custom_nodes/comfyui-mixlab-nodes
install.bat

    or install the requirements using:

    ../../../python_embeded/python.exe -s -m pip install -r requirements.txt

    If you are using a venv, make sure you have it activated before installation and use:

    pip3 install -r requirements.txt

    Chinese community

    访问 www.mixcomfy.com，获得更多内测功能，关注微信公众号：Mixlab 无界社区

    File / LoadImagesFromPath SaveImageToLocal LoadImagesFromURL

    discussions:

    discussions

    media=”(prefers-color-scheme: dark)”

    srcset=”

    https://api.star-history.com/svg?repos=shadowcz007/comfyui-mixlab-nodes&type=Date&theme=dark

    “

    />

    media=”(prefers-color-scheme: light)”

    srcset=”

    https://api.star-history.com/svg?repos=shadowcz007/comfyui-mixlab-nodes&type=Date

    “

    />

    alt=”Star History Chart”

    src=”https://api.star-history.com/svg?repos=shadowcz007/comfyui-mixlab-nodes&type=Date”

    />