This is also a good tutorial too, I should probably just join them all into one that works from start to finish lol.
It is true that you can only bind by the bus ID, but if you only have one device with this vendor/device ID, you can make things a bit more reliable.
I used systemd-usbip/README.md at master · furbrain/systemd-usbip · GitHub to have reliabiltiy here. Also USB/IP - ArchWiki gives some ideas how to do it.