Mqtt is another option, Maybe Appdaemon or PyScript works for you?
But yeah, ESPHome is maybe not as difficult as you think it is, and very diverse too I’ve converted many ‘smart’ devices to ESPHome, and also build quite a few of my own
