I’m having the same issue. 
Did you have any luck getting that sorted?
[edit] looks like there’s an issue with logger: ESPHome device does not restart without serial port active (apparently!) - #10 by tom_l
1 Like