I am actually pretty dumb. But talking with you I realized that I can use desktop Ollama to help me build a database that I can use in home assistant to do what I want and then apply it to my server and settings without having to integrate AI directly.
I did some of it here and am linking to that micro tutorial WiiM product voice control through speech-to-phrase via api - Configuration / Voice Assistant - Home Assistant Community