If you are using Zigbee2MQTT and not the ZHA integration then you should open a new issue with debug logs to https://github.com/Koenkk/zigbee2mqtt/issues + after consider posting link to issue for zigbee-herdsman’s EZSP developer → https://github.com/Koenkk/zigbee-herdsman/issues/319
Regardless also be sure to read and follow best practices (like using a very long USB extension cable and connecting via USB 2.0 post or hub and not USB 3.0 port), see → Guide for Zigbee interference avoidance and network range/coverage optimization
Personally, I recommend using dedicated adapters for Zigbee and suggest you buy a Texas Instruments CC2652P based adapter for Zigbee2MQTT (since Silicon Labs EZSP support in Z2M is experimental). Ex. ITead's "Sonoff Zigbee 3.0 USB Dongle Plus" (model "ZBDongle-P") based on Texas Instruments CC2652P +20dBm radio SoC/MCU
Understand that not only is Silicon Labs EZSP experimental in Zigbee2MQTT but multi-protocol support is experimental in all applications, even in Home Assistant’s own ZHA integration.
Also, see related discussions in Home Assistant SkyConnect - official radio USB dongle will be compatible with both Zigbee and OpenThread (including Matter/CHIP over Thread)