ESPHome Proxy slow to respond

I just added an ESP32 board to my home assistant in order to control the GOVEE lights that I have in my room. I flashed the ESP32 board with the installer on the ESPHome website. Got it up and running but it hasn’t been as reliable as I hoped it would be.
I put a supported bluetooth dongle on my HA computer but disabled it so the lights would connect to proxy. The lights sometimes turn on and some times won’t responds for a couple of minutes before turning on or off.
Not sure what else I can do to get it more reliable.

How close is your ESP to your lights? I’ve found the BT range on mine to be quite limited. This is especially noticeable for devices that require an active BT connection, as any delay/drop in connection is quite noticeable (versus say, periodically missing a broadcast from a temp sensor).

In general I’ve had good luck with my BT Proxies, but for super-reliable active connections I’ve found a couple meters with line of sight is needed.