2-gang in-wall switch reverse working when switched by zigbee

Hi all. I’m quite new to HA world and need some advice. So far didn’t find anything directly related to my problem.

I have two sets of LED lights in a room, operated by standard double switch. Today I’ve mounted 2-gang zigbee switch to be able to turn on/off lights remotely. Looking like this:

So far, so good. Now I can turn on lights via HA/zigbee or via switch. Only problem is, when for example S1 switch on the wall is turned on (passing 230V) and I send toggle signal via zigbee, lights turn off. From this moment, S1 switch on the wall is working in reverse - when live wire is shorted LEDs turn off. I have to send anothed toggle signal via zigbee to return everything to normal.

Any ideas how to prevent this switch-flip? Easiest way would be to change the switch to smart one, but for now I cannot do this.

If your unit is anything like the one shown in the picture below, it looks like there are couple ways to wire the switches…

And what does it have to do with my problem? Those two pictures show only that you can wire two standard switches, or use straicase ones. I have the upper-right way type (switches passing live 230V when turned on).

I was just asking how you wired your device. Seemed to me like it might factor in and you did not include how you wired the device in your question.
'Any ideas how to prevent this switch-flip? ’
Sorry to bother you, good luck.

There was no question in your post. Besides, there is completly no difference between those two types of connections on how the zigbee switch works. Still it reacts on live wire from the switch(es) passing 230V.

My problem is, when the physical switch is on (passing 230V) and I call zigbee “toggle lights” action, physical switch starts to work in reverse (passing 230V turns off lights). I have to call zigbee “toggle lights” action once again, to reverse-reverse reaction on physical button.