Something amiss with your network or the home assistant api. As others are not reporting it my money is on an issue with your network.
Can you set up a ping command on another machine on the network and ping, 1) your router, 2) home assistant?
Check the results around the time your ESPs drop off.