Room assistant, ProxMox, HassOS and external BLE adapter

Is it possible to run RA on the host, while HassOS runs in the guest? I’ve been trying to get this to work, but RA cannot to the broker running in the guest. I have for other RPi’s running only RA. I want to use Ansible to manage them all, but if I can’t make host->guest communication work. Is this possible to do, or must I use the HA add-on?
Thanks