comfyui-transceiver

comfyui-transceiver
★ 5

共享内存进程间通信numpy数组推理加速
在ComfyUI中通过共享内存高速在进程间传输numpy数组(图像等),避免SaveImage/LoadImage的IO瓶颈,提升AI推理性能。
💡 大量图像推理时避免SaveImage/LoadImage的IO瓶颈。
🍴 2 Forks💻 Python🔄 2024-05-23
📦
网盘下载
复制链接后前往夸克网盘下载
https://pan.quark.cn/s/8b0992d318c3
📦 requirements.txt
transceiver
📄 README

ComfyUI-Transceiver📡

Transceiver is a python library that swiftly exchanges fundamental data structures, specifically numpy arrays, between processes, optimizing AI inference tasks that utilize ComfyUI.

Why?

When processing a large number of requests, the SaveImage and LoadImage nodes may be IO-limited, and using shared memory improves performance by passing images only through memory access, not through IO.

Install as ComfyUI custom nodes

cd /path/to/ComfyUI
source venv/bin/activate
cd custom_nodes
git clone https://github.com/nat-chan/comfyui-transceiver
pip install -r requirements.txt
cd ../.. # cd /path/to/ComfyUI
python main.py # launch

Custom Nodes

Save Image Transceiver📡

save image to shared memory

inputs

  • image: ImageTensor
  • name: str
  • required name is shared memor identical name

    Load Image Transceiver📡

    load image from shared memory

    inputs

  • name: str
  • required name is shared memor identical name