To fully undo a ZHA installation you should also delete the zigbee.db file after removing ZHA integration.
FYI, zigpy developers are working on ConBee/RaspBee backup and restore of Zigbee network so you have the option to do a backup before removing and then restore so no need to repair then, see