I have not tried it. But couldnt you use your ESP32 as bluetooth proxy for home Assistant?
See: Bluetooth Proxy. how to enable device