After an update, yes, because you use a new image, but the installed apk will (or should) stick after a plain restart inside HA, or a “Restart Core” from the supervisor.
Actually, a reboot does not reset the container, either,.
I just tested, just to be sure that the supervisor wouldn’t do something peculiar, but it doesn’t.