Shelly with alternative network - unavailable in Hass when on one network

I have a Shelly that’s in a place where the IoT network in my house is a bit dodgy. So I have set it to use the regular house network as an alternative, and it keeps jumping back and forth. But when it’s on the regular network (which the Pi with Hass also has access to) it’s unavailable. If I delete it, it comes back on that network, but will be unavailable when it’s on the IoT network. Is there any way to make Hass recognize the device no matter what network it’s on?