ZHA - Battery device choose a router far away

If the closer router was added at a later date after the battery sensor then it might not automatically move unless you manually re-paring it again, some devices does that, read:

https://www.home-assistant.io/integrations/zha#best-practices-to-avoid-pairingconnection-difficulties

https://www.home-assistant.io/integrations/zha#using-router-devices

https://www.home-assistant.io/integrations/zha#defining-zigbee-channel-to-use

Also see → https://community.home-assistant.io/t/guide-for-zigbee-interference-avoidance-and-network-range-coverage-optimization/515752