Slight delay on tasmota devices

Hello,

I’m using a HA with a lot of tasmota flashed sonoff devices.
and on my previous home automation system lights would always turn on and off instantly.
but since I use HA there is always a delay from 1 to 3 seconds the first time I try to turn a light on or off. If then within a couple of minutes I do this again it’s instant. But if I haven’t touched the light for a while there is this delay again.
I don’t know if this is because of MQTT or the tasmota integration or the devices.
but I was wondering if someone experienced the same issue and if it is able to fix it?
it looks like waking up from sleep mode or something.
I use the HA MQTT add on btw.

with kind regards
Bart