You can setup automatic USB passthrough with VMware. I had this exact setup for about two months working without issue before moving to Proxmox.