accelerate>=0.33.0 bitsandbytes>0.37.0 cached_path click datasets ema_pytorch>=0.5.2 gradio rjieba librosa matplotlib numpy pydub pypinyin safetensors soundfile tomli torchdiffeq tqdm>=4.65.0 transformers vocos wandb x_transformers>=1.31.14 pygit2 omegaconf audiostretchy torch-time-stretch torchcodec
ComfyUI node to make text to speech audio with your own voice.
Using F5-TTS https://github.com/SWivid/F5-TTS
conda install ffmpeginput folder a .wav file of an audio of the voice you’d like to use, remove any background music, noise.input/F5-TTS input/audio folders will also work.You can use the examples here…
You can put the model & vocab txt files into models/checkpoints/F5-TTS folder if you have any more models. Name the .txt vocab file and the .pt model file the same names. Press “refresh” and it should appear under the “model” selection.
Example…
YourLanguage.txt
YourLanguage.safetensors
Custom F5-TTS languages on huggingface
I haven’t tried these…
Use the F5-TTS Audio node(not the “from input” node).
Put your sample voice files into the input folder like…
voice.wav
voice.txt
voice.deep.wav
voice.deep.txt
voice.chipmunk.wav
voice.chipmunk.txt
Then you can use prompts for different voices…
{main} Hello World this is the end
{deep} This is the narrator
{chipmunk} Please, I need more helium
Put a sentence of voice 1 and a sentence from voice 2 into the input audio sample. F5-TTS cuts the audio off at 15 seconds so don’t make it too long.
To use BigVGAN, you have to add a little dot to make it work with ComfyUI…
In the file custom_nodes/ComfyUI-F5-TTS/F5-TTS/src/third_party/BigVGAN/bigvgan.py
Add a little dot on the line at the top that says…
from utils import init_weights, get_padding
so it’s becomes…
from .utils import init_weights, get_padding
It’s best to install from ComfyUI-manager because it will update all your custom\_nodes when you click “update all”. With git, you will have to update manually.
Clone this repository into custom\_nodes and run this to install from git
cd custom_nodes/ComfyUI-F5-TTS
git submodule update --init --recursive
pip install -r requirements.txt
Some versions of git doesn’t handle submodules well. Remove the custom\_nodes/ComfyUI-F5-TTS/F5-TTS folder and clone the F5-TTS repository…
cd ComfyUI/custom\_nodes/ComfyUI-F5-TTS/
rm -rf F5-TTS
rmdir /s F5-TTS
git clone https://github.com/SWivid/F5-TTS.git F5-TTS