HTTP Secure + Unsecure Access Alongside One Another?

Asking about HTTP - Home Assistant.

I have had secure access setup on my frontend for several years now. It works great. I noticed that the Google Assistant integration complains about having ssl setup - it says it can’t use local access when it is.

I would like to keep my ssl setup for most access while at home. When I am logging in, editing configurations, or otherwise working on hass on my local network, the information transfer should be secure.

However, I am mildly comfortable letting Google Assistant have unsecure access to the api end points that it needs. (I’ve already given google access, how much worse could it be?)

Is there a way to have both?

I do pay for nabu casa integration. That covers some of my question, but I want to ensure that everything connects securely by default except maybe local google devices.