ESPHome - All devices periodically disconnect (see log details)

Something amiss with your network or the home assistant api. As others are not reporting it my money is on an issue with your network.

Can you set up a ping command on another machine on the network and ping, 1) your router, 2) home assistant?

Check the results around the time your ESPs drop off.