ComfyUI Textual Inversion Training

To train textual inversion embedding directly from ComfyUI pipeline.

Training scripts are modified version of diffusers examples: https://github.com/huggingface/diffusers/tree/main/examples/textual_inversion

Install

Follow the installation here:

https://github.com/huggingface/diffusers/tree/main/examples/textual_inversion

Then clone the repository inside custom_nodes:

git clone github.com/mbrostami/ComfyUI-TITrain
cd ComfyUI-TITrain
pip install -r requirements.txt

Restart and refresh the ComfyUI.

Nodes

Textual Inversion Training SD1.5

This node is designed to train SD 1.5 encoder (with progress bar)

([./screenshot.png)[img]

Parameters

train_dir

This is where the input images are going to be stored, if directory doesn’t exist in ComfyUI/output/ it will be created. Consider changing the value if you want to train different embeddings.

extra_prompts

There are list of prompts inside the training script, that is shuffled with each image to be used for training. I added this extra prompts that you can put additional prompt in each line, so randomly selected line from here will be appended to the final prompt. Usually you should put a part of prompt that you don’t want to be considered as the embedding itself. (e.g. white background, close up, tattoo, etc)

Other parameters are explained in diffusers repository:

https://github.com/huggingface/diffusers/tree/main/examples/textual_inversion