so digging though the Google Assistant IFTTT and WebHocks documentation, and checking the headers that are sent by google/IFTTT, there is nothing to determine which device made the IFTTT call.
So, no way to do what I want unless I either hardwire the device to reply on, use broadcast, or include the device in my command.