My guess is that you need to setup a static route in HA OS to point traffic for the Wireguard subnet to the Wireguard tunnel.
The problem is that HA OS (assuming that’s your install type on the Pi) is going to use it’s default gateway for all network traffic. And, as you figured out, that means sending all traffic to your router which doesn’t know what to do with it.