Hi there,
I am using a voice pipeline to talk to Home Assistant. I have a LLM configured but prefer local handling. This is working well in the most cases.
Now I see that some commands are handled by the LLM in case of handled locally. So I deactivated the LLM in the pipeline and set it to “Home Assistant”. After that the same command is handled by HA. So the command is able to be handled by HA but my configuration “prefere locally” doesn’t work (just in some cases).
Is there any other configuration than “prefer locally handling = true” I missed? What am I doing wrong? Cause the LLM is a bit slower and I have to pay for each request, I want to use local handling everytime if its possible. ![]()

Here are my scenarios:
Thanks and kind regards,
Tobias

