comfyui_facetools

These custom nodes provide a rotation aware face extraction, paste back, and various face related masking options.

Patch notes

2024-06-20 – fixed issue 13

2024-06-14 – Sent yolo to cuda device if available (credits: kilroythethird, thanks for the suggestion!)

2024-06-14 – Dropped the requirement from insightface completely.

2024-05-22 – Updated GenderFaceFilter node.

2024-05-19 – Added BiSeNetMask and JonathandinuMask nodes. Careful about JonathandinuMask, it’s more accurate than BiSeNet, but it takes more memory; you can get out of memory more easily with it.

2024-03-10 – Added nodes to detect faces using face_yolov8m instead of insightface.

Example Workflows

Full inpainting workflow with two controlnets which allows to get as high as 1.0 denoise strength without messing things up.

Nodes

AlignFaces

inputs:

insightface: Use the Load InsightFacenode from ComfyUI_IPAdapter_plus

image

threshold: minimal confidence score for detection

min_size: minimum face size for detection

max_size: maximum face size for detection

outputs:

faces

FaceDetails

inputs:

faces

crop_size: size of the square cropped face image

crop_factor: enlarge the context around the face by this factor

mask_type:

simple_square: simple bounding box around the face

convex_hull: convex hull based on the face mesh obtained with MediaPipe

BiSeNet: occlusion aware face segmentation based on face-parsing.PyTorch

outputs:

crops: square cropped face images

masks: masks for each cropped face

warps: 2×3 warp matrix to paste the cropped face back into the original image

WarpFacesBack

input:

images: this is the original image

face

crop: cropped face images

mask: masks for the cropped faces

warp: 2×3 warp matrix

OrderedFaceFilter

works similarly to ImpactSEGSOrderedfilter

GenderFaceFilter

needs more work, as InsightFace gender classifier isn’t very accurate.

MergeWarps

I made some changes in FaceDetailer and WarpFacesBack since I’ve created this one, so it probably doesn’t work anymore. Needs more testing and more work.

Installation

Download bluefoxcreation/FaceAlignment model into ComfyUI/models/landmarks

(Only if you want to use occlusion aware masks) Download BiSeNet model into ComfyUI/models/bisenet

DEPRECATED:

You need ComfyUI-Impact-Pack for Load InsightFace node and comfyui_controlnet_aux for MediaPipe library (which is required for convex_hull masks) and MediaPipe Face Mesh node if you want to use that controlnet.