ComfyUI_HF_Inference

ComfyUI_HF_Inference
★ 5

远程推理Hugging Face模型托管API集成
为ComfyUI提供对Hugging Face托管Inference API的非官方接入,能在UI内远程调用HF模型免本地权重,支持参数配置并使用HF_AUTH_TOKEN。
💡 在ComfyUI中通过HF托管服务远程调用和推理模型。
🍴 3 Forks💻 Python🔄 2024-06-14
📦
网盘下载
复制链接后前往夸克网盘下载
https://pan.quark.cn/s/79aaff81621b
📦 requirements.txt
requests
📄 README

Hugging Face hosted inference nodes for ComfyUI

Unofficial ComfyUI nodes for Hugging Face’s inference API

Visit the official docs for an overview of how the HF inference endpoints work

Find models by task on the official website

Installation

Clone and install dependencies

git clone https://github.com/bitaffinity/ComfyUI_HF_Inference custom_nodes/ComfyUI_HF_Inference
cd custom_nodes/ComfyUI_HF_Inference
pip install -r requirements.txt

Export HF_AUTH_TOKEN with one of your Hugging Face tokens

Run ComfyUI

HF_AUTH_TOKEN=hf_1111111111111111111111111111111111 python main.py

Nodes

[!WARNING]

Inference API (serverless) requires a model 10GB or below and fails for random reasons on different models.

Text

  • Feature Extraction
  • facebook/bart-base
  • Question Answering
  • deepset/roberta-base-squad2
  • Translation
  • google-t5/t5-base
  • Generation
  • HuggingFaceH4/zephyr-7b-beta
  • Image

  • Classification
  • google/vit-base-patch16-224
  • Object Detection
  • facebook/detr-resnet-50
  • Segmentation
  • facebook/detr-resnet-50-panoptic
  • TextToImage
  • sd-community/sdxl-flash