Not sure if you are still having this issue but verify each device and each entity under that device has an unique Name & ID. If you used the Ready-Made-Projects from ESPHome it will name everything the same unless changed when adopted if I remember correctly, it’s been a minute. I have 4 running in my house now but the speaker and microphone leave a lot to be desired so I only use them in the bathrooms where it is quiet. Started building my own instead for normal volume environments. Hope you already figured out your issue if not maybe this will help