I’m wondering if anyone has been able to leverage the xtts v2 model from coqui-tts… I was finally able to get tts-server to work with a fine tuned model + was able to fix some issues that popped up with the MaryTTS endpoint.
It seems like the better route for this would be to stream the chunked audio though (it takes a couple of seconds to gen. the full audio) and that is outside of my abilities.
Has anyone been able to run a fine tuned model with audio streaming?
I’ve just run it, it required minor changes to the server.py file. But it has API GET /api/tts?text=Blabla which I do not know how to connect to HA yet
Yeah it’s running on the GPU. The actual inference is fine, just the pace in which words are spoken seems kind of slow.
The coqui tts docs mention something about a speed parameter but I have no idea how to use it
EDIT: it would be way better to do chunked audio streaming but I have no idea how to do that. I believe xtts-streaming-api allows for that, but I don’t think that is supported in HA
EDIT:
I was wrong, I’ve been having a really hard time trying to get this to pull “speed” from the model config.json… im not a programmer and am having difficulty setting a global variable in the TTS.config module.
For whatever reason, the value I’m trying to set which should be the path of config.json isnt accessible in xtts.py