I played with llama3.2:3b a bit. It’s recommended to use mistral or llama2:13b models, llama3.2:3b also works. I set it as fallback to Assist and it can control HA. I limit exposed devices to 20.
I wish it could ignore areas, I noticed a lot of problems because of it. It refuses to turn on or off device because you haven’t specifed area.
When i told it to Pause, it paused music, and also turned all my lamps in the room. 