Voice assistant - Does it actually work properly for people?

Ok, so this is my 2nd post about issues with the voice assistant stuff. I’m curious if anyone is running this and getting decent results?

Even when the assist pipeline properly parses the voice command and says it completed the task, it doesn’t. Most of the time, it just says it doesn’t understand anything, even if the extracted STT is correct and coherent. I have followed the FAQs/troubleshooting and best practices guide and setup aliases for floors, areas and exposed devices. Hass says the pipeline will infer things like what area the satellite board is in to “connect the dots”, but that isn’t my experience and there is no clear or documented way to properly interact with a whole floor device domain (i.e. “turn off all lights in basement”, and only have a floor named basement with an assist alias set to basement, no areas are named basement)

As an example of it saying it’s sent a command, when it hasn’t.:

In the raw data it has the proper entity and it says it issued the turn on command, but it didn’t. I tried this several times in a row with the same result. If I go into my dashboard and manually interact with that light group entity, it works fine.

Is this the experience others are having with Hass assist pipelines? I’ve been planning, procuring, designing and now implementing voice assistants assuming that the software side of it (intents, etc.) were working. I’m hoping it’s a configuration issue on my end and not actually how things are.

I am running respeaker lite boards (FW: 1.0.9 non 48khz) with esp32-s3 hosts. The hardware is doing its job, I’m just having issues with hass.

Can anyone chime in with their experiences, good or bad and maybe offer some pointers on things they’ve found and worked around? Like, do I need to create custom sentences for simple turn on and off or white/rgb commands? Things like that.

Sorry if this sounds like I’m complaining, I’m not trying to, but I am very frustrated trying to figure things out. It’s frustrating following the docs and implementing best practices yet getting terrible results.

For the time being I’ve brought all my Google home assistants back out as they give my household the best experience thus far. I do not want to keep feeding google my data though.

Thanks!