Google assistant and VPN

This question may be outside the scope of this forum but this seems to be a very active forum so i thought i would try. So I got my VPN up and running so and I can access it external from my network. The problem I have is that if I have the VPN on the Google assistant cannot talk with home assistant however when I turn the VPN off it works. I have even put the Google homes on my ISP WAN while the VPN is on and it still won’t work. As a note I had to turn the VPN off to configure Google assistant with home assistant. Any ideas?

Any advice on this?

What kind of VPN (IPsec, OpenVPN…) are you using? Not that I know if this is relevant, but maybe it is for others looking at this topic.

It is OpenVPN. I use the VPN to mask my IP address not to access my Home Assistant while I am away although I do have DuckDNS and Lets Encrypt setup to be able to do that as well.

Using your VPN, your query appears to come from somewhere else than you normally connect from. Google uses techniques like Credit card companies use for changes in spending patterns to catch fraudulent purchases. I once lost access to one of my Gmail accounts because I connected to Gmail from some other country shortly after I connected from home. It took a lot of work to get my account unlocked.
The problem with masking your IP is that is usually all or nothing. See what control you have for routing in the OVPN. You may be able to add exceptions.