Z-wave behavior changed after moving to VM

I just migrated my Hass.io from a Raspberry Pi to a Virtual Machine (Virtualbox running on Debian 9). I am using Aeotec Z-Stick Gen5, Z-Wave Plus USB and everything was working great on the Raspberry.
After migrating Hass.io to Virtualbox It took a little bit of trial and error to get the USB stick to come up in the Virtual Machine, but I finally got all my switches to display.
But the “switches” in HA are acting strange. Sometimes when I turn them off the graphical switch flips back on immediately, but the actual light does turn off. This confuses the heck out of Alexa, so she says the light is malfunctioning even if it does what you tell it.