I understand you want to use your router for this, but I don’t think it is going to work. There are things that HA needs to work with reverse proxies.
As an example, this config contains a few items that most normal reverse proxies do not.
If the settings of the built in reverse proxy are not capable of meeting these requirements, then it simply will not work.