Use ChatGPT (or other conversation agent) as a backup when the first conversation agent doesn't understand the request

I want to use the HA Cloud option when possible but if I make a request that it doesn’t understand, I want it to pass the request on to ChatGPT. I don’t want to use ChatGPT as the primary CA because of the expense involved.

Of course someone else might want to use something other than ChatGPT. Im just suggesting that a conversation agent could be designated as a backup/fail over in case the primary doesn’t understand the request.

I like the idea but would not fix it for ChatGPT, so suggest to rephrase it something alike: allow to configure other agents that come in place when the primary agent fails to understand

This is already possible.

https://www.home-assistant.io/blog/2025/02/13/voice-chapter-9-speech-to-phrase/#large-language-model-improvements

More here: https://www.home-assistant.io/blog/2024/12/04/release-202412/#let-your-voice-assistant-fall-back-to-an-llm-based-agent