Yeah, that’s not possible. The likely hood of that working well is low too. I doubt your voice command device would handle hardware connecting and disconnecting well.
I think it handles it quite good and simply says “device not online”. Also one could think of not disabling the component but simply sending all requests to /dev/null of you will. So a device like Alexa wouldn’t even notice that the command wasn’t excecuded. Although I prefer the “device is offline”.