You’re assuming that HA is setup to do all those things natively without your intervention.
What inwas able to pull from your Pic was you were arguing with the machine in Dutch.
Yes ha recently added vaccum intent support… BUT your vac must support the room Ids like the Roborock integration does to use the native builtin stuff Else that doesn’t work for your bot. (there’s tons of minor nuances but in most cases… This is a variant of the issue)
HA voice is early. It’s good. And if you know how to write ha scripts (as you apparently do) you can make it do whatever you want. BUT don’t assume everything is 100% built for you already. It’s more platform than finished product and there are things you can do to make your tools work better.
Now back to your screenshot.
LLMs will happily tell you whatever to finish the statement. If you’ve done nothing to tell the system about your tools and it doesn’t understand it will use whatever is available to answer. And.. Wel you see the result.
Id bet this is the result of poor grounding combined with your model choice. Based on what I think it responded it doesn’t understand how to use your tool. (description of tool isn’t sufficient for the llm to know it’s thee right one.) use the debug tool in settings Voice Assistants to see what it thought you said and how it worked out a response.
Im mid write on a series of articles about what it takes to make Ai work in HA. (since you’re using ollama you’re trying to do local inference…)
Maybe some of this can help. I should get to the context chapter today. This is also the ‘grandma’s cardboard box’ problem I list in Fridays Party. But the articles above should be easier to read.