Hello,
I have a question about the ChatGPT integration.
In the latest version of HA, I can use ChatGPT as the “brain” of the assistant and also talk to it via voice recognition.
So far it all works, I can use it to switch my lights etc. and I can also simply ask “Who is Bruce Willis” and get a corresponding answer.
What doesn’t work, however, are questions about current affairs, such as “What will the weather be like tomorrow” or “What’s on TV at the moment”.
I don’t get an answer to these questions but an error message.
However, if I ask these questions directly in ChatGPT (with OpenAI), ChatGPT searches the relevant websites and then gives me a correct answer.
Why doesn’t this work with Home Assistant?
I have both ChatGPT Pro and an API access with corresponding credit.
Is there any way I can set this in Home Assistant?
It’s probably because either:
- The required entity/service is not exposed to assist.
- There is no matching HA intent for the action you want.
For getting the weather there is a solution in the release party video for the latest home assistant release.
The problem is not the quality of the results, but that ChatGPT does not provide up-to-date data.
As I said, I can ask for the current TV programme via the ChatGPT homepage, then it searches 2-3 websites and extracts the result.
This also works with other questions, such as share prices etc.
This complete functionality does not seem to be available with CHatGPT in HA.
And the point is not to write custom intents for everything, but that all queries that do not concern HA are forwarded and then answered by ChatGPT as usual.
This also works with the question about Bruce Willis or that a joke should be told to me, I don’t need custom intents for that either
You need a GPT 4 Model (like gpt-4o).
https://help.openai.com/en/articles/8077698-how-do-i-use-chatgpt-browse-with-bing-to-search-the-web
With GPT 3 this function is not available.
I did a Test with gpt-4o and i can get current weather and tv informations back in HA.
Okay, it seems to work with the 4o model.
However, the weather output is somehow terrible because it displays sunshine as “asterisks” 
I think you might be able to fix that in the prompt.
What I’m wondering now is how can I continue a preservation?
I start it with “okay nabu”, then the microphones come on and I can speak and ask my question.
Then the microphone goes off again and the answer is played back.
But sometimes ChatGPT asks a question at the end.
I would then continue typing directly in the chat.
This is not possible with the HA Assistant because the microphones are off until I say the wake word again.
It would be kind of brilliant if you could set it so that HA Assistant switches the microphone on again after the voice output and waits a few seconds for a follow-up question.
If nothing comes for 5 seconds, it switches off again.
But that way you could have a “real” conversation with the assistant.