Personally I would recommend using USB-passthrough to the VM using a very long USB-cable (preferably through a powered USB 2.0 hub), but if USB-passthrough to VM is not possible then instead check Ethernet based Zigbee to network bridges such as ZigStar and Tube’s Zigbee Gateways for a wired connected so the communicatiln is wired (as serial tunneling over WIFi will likley cause issues).
Again, that and more tips here → Zigbee networks: how to guide for avoiding interference and optimize for getting better range + coverage