@squirtbrnr is right.
Looks like @Stooovie you are doing the “HomeKit” integration at the moment, where the integration would introduce things from HA into your HomeKit setup, where iPad being the hub at the moment.
This works locally and remotely using the Apple’s Home app and Siri, as long as the hub is charged and stays at home and online all the time.
Now, if you want to remove your iPad from the equation and still control everything remotely, then the “HomeKit” integration you have today is not what you want, because it would still rely on your iPad.
You would want to use the “HomeKit Controller” integration instead, to bring HomeKit-only devices directly into your HA setup.
Doing so, devices that was on HA would still in HA, devices that are HomeKit-protocol-only would now talk to and see your HA as the HomeKit hub. You will have to then (1) setup your HA to be accessible from outside your LAN, (2) use the HA iOS app instead and set it up per #1, (3) give up the home app, (4) live with the fact that Siri might not function as tightly as before, and (5) can remove your iPad from the equation.
Does it make sense? I have links on both of the integrations here.