Using ESP-IDF causes HA network disconnects

Got a Screek BP1 bluetooth proxy, installed the vanilla ESPHome BT proxy firmware, device keeps disconnecting from HA.
Tried to create my own BT proxy config, same issue.
Tried to create a does nothing YAML config using ESP-IDF, and same disconnects.
Switched back to Arduino (commented out ESP-IDF) in test config, and all is well.

So something with using ESP-IDF on my network causes issues.

Have several other ESPHome devices that work rock solid, but all using default framework (Arduino), and running Ubiquity AP’s.

Test code: ESPHome-Config/esp32-test.yaml at 44b0bb4938b51a979959e5418a30bc44a19b4283 · ptr727/ESPHome-Config · GitHub

Any ideas?

Per google I found some posts on ESPHome + ESP-IDF + Ubiquity chatting about “power_save_mode” issues, I tested settings “power_save_mode: none”, and the test YAML with ESP-IDF now seems to behave like Arduino with default “power_save_mode”. More testing needed.

Well, power_save_mode NONE is incompatible with esp32_ble. Please remove the power save mode. See also https://github.com/esphome/issues/issues/2141#issuecomment-865688582.

Now what, power save none and esp-idf makes the device work, but then can’t use BT proxy?

Seems to be an issue with my WiFi and ESP-IDF, If I add wifi: fast_connect: true I can use BT and ESP-IDF.

Logged an issue: Using `framework: type: esp-idf` frequently disconnects from WiFi / HA unless using `wifi: power_save_mode: none` or `wifi: fast_connect: true` · Issue #5754 · esphome/issues · GitHub

Would prefer not to use fast connect as I run several AP’s and I want the device to connect to the best signal not the first signal.