Google Assistant "Unknown error" with certain devices

Hello,
I finally set up the Google assistant integration for Home Assistant.
At the moment every device is working with vocal commands but 3 out of 46 devices have a problem.

Whent I try to turn ON or OFF one of those 3 devices through Google Assistant it says “an unknown error occurred with […]” but the device turns OFF and ON with no real problems.

It doesn’t seem to be a specific problem with the type/brand of those devices (SONOFF and Tuya zigbee 2 gang switches) since the exact same types of devices are working fine and they are very clos to each other.

Is there a way to fix this issue?

Thank you in advance

same here, mostly X10 ,happpens randomly