OmniGen-ComfyUI

OmniGen-ComfyUI
★ 209

OmniGenComfyUI 节点模型加载权重合并与 FP8
将 OmniGen 模型集成到 ComfyUI 的自定义节点，便于在界面内加载与运行模型，支持 finetune、权重合并与 fp8 精度，简化工作流。
💡 在 ComfyUI 中加载并运行 OmniGen 模型进行生成与微调
🍴 29 Forks💻 Python🔄 2024-11-14
📦
网盘下载
复制链接后前往夸克网盘下载
https://pan.quark.cn/s/c1eafc754fbb
📦 requirements.txt
datasets
accelerate
pillow
peft
diffusers
timm
📄 README

OmniGen-ComfyUI

A custom node for OmniGen, you can find workflow here

Automatic downloading of the model is no longer performed, since now you have a loader node which will allow for finetunes, merges, as well as fp8 dtypes.

How to Install

  • Create an OmniGen folder the models directory in /ComfyUI/models/Omnigen (this has moved from the older folder location)
  • Within the /ComfyUI/models/Omnigen download all of the files from https://huggingface.co/Shitao/OmniGen-v1 into its own folder.

    • You can also download the models with GIT. First do GIT LFS and afterwards do git clone https://huggingface.co/Shitao/OmniGen-v1. This can take awhile, and may appear as if it is doing nothing for a bit.

  • Install OmniGen-ComfyUI by AIFSH in Comfy Manager. Be sure to select the correct one. Many clones with less functionality have appeared since.

    • Example

    In the prompt text, you only need to use image_1 (for image 1), instead of needing to use <|image_1|>.

    |text|image_1|image_2|image_3|out_img|

    |–|–|–|–|–|

    |A curly-haired man in a red shirt is drinking tea.|–|–|–||

    |The woman in image_1 waves her hand happily in the crowd||–|–||

    Tips

    For out of memory or time cost, you can refer to inference.md#requiremented-resources to select a appropriate setting.

    text2img Example Prompt: "A white cat resting on a picnic table."
Image Editing Example Prompt: "image_1 The umbrella should be red."
Segmentation Example Prompt: "Find lamp in the picture image_1 and color them blue."
Try-On Example Prompt:"image_1 wears image_2."
Pose Example Prompt: "Detect the skeleton of human in image_1."

    Disclaimer / 免责声明

    We do not hold any responsibility for any illegal usage of the codebase. Please refer to your local laws about DMCA and other related laws. 我们不对代码库的任何非法使用承担任何责任. 请参阅您当地关于 DMCA (数字千年法案) 和其他相关法律法规.