ComfyUI-FunAudioLLM

ComfyUI-FunAudioLLM
★ 93

音频生成语音合成FunAudioLLMComfyUI节点
将FunAudioLLM（含CosyVoice、SenseVoice）作为ComfyUI自定义节点接入，便捷生成与管理语音输出。
💡 在ComfyUI中调用CosyVoice或SenseVoice生成语音并输出。
🍴 11 Forks💻 Python🔄 2024-11-27
📦
网盘下载
复制链接后前往夸克网盘下载
https://pan.quark.cn/s/af9fbf81e746
📦 requirements.txt
conformer
deepspeed;
sys_platform
==
'linux'
diffusers
grpcio
grpcio-tools
hydra-core
HyperPyYAML
inflect
librosa
lightning
matplotlib
modelscope
networkx
omegaconf
onnxruntime-gpu;
sys_platform
==
'linux'
onnxruntime;
sys_platform
==
'darwin'
or
sys_platform
==
'win32'
openai-whisper
protobuf
pydantic
rich
soundfile
tensorboard
wget
gdown
pyarrow
jieba
pypinyin
pydub
audiosegment
srt
ffmpeg-python
WeTextProcessing
funasr>=1.1.3
huggingface
huggingface_hub
📄 README

ComfyUI-FunAudioLLM

Comfyui custom node for FunAudioLLM include CosyVoice and SenseVoice

Features

CosyVoice

  • CosyVoice Version: 2024-10-04
  • Support SFT,Zero-shot,Cross-lingual,Instruct
  • Support CosyVoice-300M-25Hz in zero-shot and cross-lingual
  • Support SFT’s 25Hz(unoffical)

    • Save and load speaker model in zero-shot

    SenseVoice

  • SenseVoice Version: 2024-10-04
  • Support SenseVoice-Small

    • Support Punctuation segment (need turn off use_fast_mode)

    How use

    apt update
apt install ffmpeg

## in ComfyUI/custom_nodes
git clone https://github.com/SpenserCai/ComfyUI-FunAudioLLM
cd ComfyUI-FunAudioLLM
pip install -r requirements.txt

    Windows

    In windows need use conda to install pynini

    conda install -c conda-forge pynini=2.1.6
pip install -r requirements.txt

    MacOS

    If meet error when you install

    brew install openfst
export CPPFLAGS="-I/opt/homebrew/include"
export LDFLAGS="-L/opt/homebrew/lib"
pip install -r requirements.txt

    If your network is unstable, you can pre-download the model from the following sources and place it in the appropriate directory.

  • CosyVoice-300M -> ComfyUI/models/CosyVoice/CosyVoice-300M
  • CosyVoice-300M-25Hz -> ComfyUI/models/CosyVoice/CosyVoice-300M-25Hz
  • CosyVoice-300M-SFT -> ComfyUI/models/CosyVoice/CosyVoice-300M-SFT
  • CosyVoice-300M-SFT-25Hz -> ComfyUI/models/CosyVoice/CosyVoice-300M-SFT-25Hz
  • CosyVoice-300M-Instruct -> ComfyUI/models/CosyVoice/CosyVoice-300M-Instruct
  • SenseVoiceSmall -> ComfyUI/models/SenseVoice/SenseVoiceSmall

    • WorkFlow