as more providers of LLM are becoming available and use an OpenAI-compatible API it would be great to have a conversation integration that let you use them.
It should be something as simple as letting the user configure the OpenAI-compatible endpoint and would enable home assistant users to leverage different cloud (e.g. openrouter.ai) and local LLM models.
This could open a larger number of models and be more cost effective as cloud providers often have cheaper LLM options than the mainstream OpenAI and Anthropic.
I was kind of surprised that this didn’t exist when I saw a lot of requests for one. I’m working on creating my own conversation integration (that one’s here, but it’s pretty specific to some use cases I have and not really stable enough for others yet) and wanted to start with just an openai-compatible version of the built in agent, so I went ahead and froze that as a repo here, if anyone’s interested.
Yeah, being able to integrate an LLM like ChatGPT or Claude in to my Hass, and be able to ask it for suggestions, improvements, automations and so on would be truly ground breaking!
Thank you very much! Your openai-compatible-conversation works like a charm, but it’s a big bummer having to keep it maintained.
This point frustrates me a lot. I pay for GitHub Copilot, which allows to be used as an OpenAI SDK (here), but I simply cannot leverage it in Home Assistant without this custom component because… because of what? That’s what frustrates me the most. There isn’t even a good reason for not baking this feature by default.
Anyway, openai-compatible-conversation works great with GitHub Copilot models.