Currently I don’t believe the manual alarm_control_panel supports restore_state from the recorder component. That means if HASS restarts in the middle of the night it comes back up with the alarm disabled.
Would be great if someone could look at adding in support!