If you have already configured all the correct settings and permissions to properly enabled USB pass-through to the virtual machine, but this is the wrong place to askj about that, post in the Zigbee2MQTT discussions or forum for your virtual machine manager and operating-system if need further help with such configurations → Koenkk/zigbee2mqtt · Discussions · GitHub
Tip there is that those symptoms are generally likely to be a Zigbee issue which normally means either EMI/RMI/EMF interference or simply having too few Zigbee Router devices (or a combination of both those) is usually the problem. Start by adding a long USB extension cable to the Zigbee Coordinator adapter and connect it either to a USB 2.0 port or via a USB 2.0 hub and then read and try to follow all these other best practice tips which are written to be universal for all Zigbee implementations → Zigbee networks: how to guide for avoiding interference + optimize using Zigbee Router devices (repeaters/extenders) to get a stable mesh network with best possible range and coverage
PS: Note that for Zigbee2MQTT you want to post to their community instead regardless → Koenkk/zigbee2mqtt · Discussions · GitHub