Baseurl and letsencrypt?

Installation Home Assistant OS
1

I have lets encrypt set up like
{
“email”: “[email protected]”,
“domains”: [
“removed.my.domain”
],
“certfile”: “fullchain.pem”,
“keyfile”: “privkey.pem”
}
and in my config file:

api_password: !secret api_pass
  ssl_certificate: /ssl/fullchain.pem
  ssl_key: /ssl/privkey.pem
  base_url: https://removed.my.domain
  server_port: 443
  trusted_networks:
    - 127.0.0.1
    - 192.168.1.0/24
  ip_ban_enabled: True
  login_attempts_threshold: 2

But i can still log in with my external ip addresse and my internal ipadresse instead of domain name
I cannot figure out why