For people that have a Nvidia GPU, I made guide to get the Functionary LLM working with the Extended OpenAI HACS integration.
https://community.home-assistant.io/t/ai-voice-control-for-home-assistant-fully-local/
2 Likes