Without seeing your Z2M logs when this issue happens, it could be either interference, an ethernet issue or a power issue (or a mix of all 3).
Have a look at the Z2M logs and post them here. Read this too, and make sure that you have eliminated interference from Wifi.
If not all devices go unavailable (stuff like the coordinator and a few routers still work), then you may probably need to add more routers.