Devices via HomeKit bridge are not responding on HomePod after HA Core restart

I found a very weird problem in the homekit bridge with homepod.
When I restart the home assistant core or reload the homekit bridge, my Homepod mini cannot control all of the devices via the homekit bridge. The Homepod said “xxx device is not responding”
I need to restart my homepod and everything become normal again.

I don’t want to reboot my HomePod after restarting the home assistant core.

This phenomenon is NOT happening on iPad and iPhone. On every HA core restart or Homekit bridge reload, my iPad and iPhone can still control the device via the homekit bridge after the restart process.

Any solution to this problem? I have already enabled IGMP on my router and pfsense firewall.

I am using the following version:
Homepod: 14.7
Ipad/iPhone: 14.7.1
home-assistant core: 2021.8.2

I rollback the HA core version to 2021.7.4 and everything becomes normal again. My homepod can control all of the devices via homekit bridge after the restart.

Related to this issue: 2021.8.0: HomeKit Integration broken? · Issue #53987 · home-assistant/core · GitHub