[XIAOMI_AQARA] Wireless button wait duration

Hi there! I love using xiaomi zigbee devices and homeassistant but I found that if I control my lights using the aqara wireless buttons (remote.b186acn01) to control my tasmota lights, they is almost a second delay between button press and lights turning on. However if I control via HA interface on my mobile phone connected via wifi, I get instant on/off (just like a normal light switch).

After reading a while, I think the problem might be due to the button itself or the xiaomi component waiting to see if I do another press (for double click action) before sending out the command. So I am wondering whether it is the button or the component doing the check? Because if it is the component then may be I can disable it so that I get instant button response.

Thank you in advance,