2 USB headsets -> same HA/Assistant possible?

How can I configure HA to provide each person wearing a USB headset ‘their own’ assistant instance? Is that doable?