Zigbee Problems After Recent Update

I started seeing intermittent problems with zigbee devices after the 2023.12.1 update. All zigbee devices are impacted after 12.2, no change after 12.3. I considered rolling back but haven’t tried that yet. After a home assistant restart or a system reboot everything seems to work ok for a few minutes. Within an hour all zigbee devices are not functional. I do seem to be able to read the state of devices, but can’t change their states. So for a smart outlet, I can see if it’s on, but I can’t turn it on or off.

I’ve got a Nortek HUSBZB-1 on a 2 meter extension up to a point with decent line of site to several nearby devices. ZHA is the integration. HA is on a supervised install.

Some potentially interesting things from my logs. This was after a reboot at about 20:20h. At 20:25 there is an error on a bellows.uart, I don’t know what this is but it’s suspicious. The first definite zigbee problem is at 20:26:59, ‘plug bathroom heater’ is a zigbee device.

Logs:

2023-12-14 20:24:41.709 ERROR (MainThread) [homeassistant.components.sensor] Platform iotawatt does not generate unique IDs. ID 44179308A020-input-14-WattHours already exists - ignoring sensor.a14_wh
2023-12-14 20:25:26.763 WARNING (MainThread) [py.warnings] /usr/local/lib/python3.11/site-packages/turbojpeg.py:901: UserWarning: Corrupt JPEG data: 3 extraneous bytes before marker 0xd5
  warnings.warn(self.__get_error_string(handle))

2023-12-14 20:25:32.157 ERROR (MainThread) [bellows.uart] CRC error in frame b'1157dcb19754ac78b658964d24ab1593499c4e84cded49fd7e' (b'49fd' != b'310e')
2023-12-14 20:25:35.625 WARNING (MainThread) [homeassistant.bootstrap] Waiting on integrations to complete setup: snoo, mobile_app, tts, nest
2023-12-14 20:25:36.734 WARNING (MainThread) [py.warnings] /usr/local/lib/python3.11/site-packages/turbojpeg.py:901: UserWarning: Corrupt JPEG data: 4 extraneous bytes before marker 0xd2
  warnings.warn(self.__get_error_string(handle))

2023-12-14 20:25:40.902 ERROR (MainThread) [bellows.uart] CRC error in frame b'114794b1ed542e14b652954b25ab5592e263f5de6312316f83f7cc688cd56e3f274e7e' (b'274e' != b'8ba9')
2023-12-14 20:25:56.774 WARNING (MainThread) [py.warnings] /usr/local/lib/python3.11/site-packages/turbojpeg.py:901: UserWarning: Corrupt JPEG data: 1 extraneous bytes before marker 0xd0
  warnings.warn(self.__get_error_string(handle))

2023-12-14 20:25:59.372 WARNING (MainThread) [homeassistant.helpers.entity] Update of sensor.plug_bathroom_heater_power is taking over 10 seconds
2023-12-14 20:25:59.372 WARNING (MainThread) [homeassistant.helpers.entity] Update of sensor.plug_water_softener_power is taking over 10 seconds
2023-12-14 20:25:59.373 WARNING (MainThread) [homeassistant.helpers.entity] Update of sensor.plug_swampanator_power is taking over 10 seconds
2023-12-14 20:26:06.795 WARNING (MainThread) [py.warnings] /usr/local/lib/python3.11/site-packages/turbojpeg.py:901: UserWarning: Corrupt JPEG data: 7 extraneous bytes before marker 0xd5
  warnings.warn(self.__get_error_string(handle))

2023-12-14 20:26:16.761 WARNING (MainThread) [py.warnings] /usr/local/lib/python3.11/site-packages/turbojpeg.py:901: UserWarning: Corrupt JPEG data: 6 extraneous bytes before marker 0xd0
  warnings.warn(self.__get_error_string(handle))

2023-12-14 20:26:19.372 WARNING (MainThread) [homeassistant.components.sensor] Updating zha sensor took longer than the scheduled update interval 0:00:30
2023-12-14 20:26:26.754 WARNING (MainThread) [py.warnings] /usr/local/lib/python3.11/site-packages/turbojpeg.py:901: UserWarning: Corrupt JPEG data: 3 extraneous bytes before marker 0xd7
  warnings.warn(self.__get_error_string(handle))

2023-12-14 20:26:36.757 WARNING (MainThread) [py.warnings] /usr/local/lib/python3.11/site-packages/turbojpeg.py:901: UserWarning: Corrupt JPEG data: 8 extraneous bytes before marker 0xd1
  warnings.warn(self.__get_error_string(handle))

2023-12-14 20:26:46.769 WARNING (MainThread) [py.warnings] /usr/local/lib/python3.11/site-packages/turbojpeg.py:901: UserWarning: Corrupt JPEG data: 3 extraneous bytes before marker 0xd1
  warnings.warn(self.__get_error_string(handle))

2023-12-14 20:26:56.778 WARNING (MainThread) [py.warnings] /usr/local/lib/python3.11/site-packages/turbojpeg.py:901: UserWarning: Corrupt JPEG data: 2 extraneous bytes before marker 0xd1
  warnings.warn(self.__get_error_string(handle))

2023-12-14 20:26:59.376 WARNING (MainThread) [homeassistant.helpers.entity] Update of sensor.plug_bathroom_heater_power is taking over 10 seconds
2023-12-14 20:26:59.377 WARNING (MainThread) [homeassistant.helpers.entity] Update of sensor.plug_desk_heater_power is taking over 10 seconds
2023-12-14 20:26:59.377 WARNING (MainThread) [homeassistant.helpers.entity] Update of sensor.plug_water_softener_power is taking over 10 seconds
2023-12-14 20:26:59.377 WARNING (MainThread) [homeassistant.helpers.entity] Update of sensor.plug_swampanator_power is taking over 10 seconds
2023-12-14 20:27:03.741 WARNING (MainThread) [homeassistant.components.zha.core.cluster_handlers] [0x30C9:1:0x0008]: async_initialize: all attempts have failed: [DeliveryError('Failed to deliver message: <EmberStatus.DELIVERY_FAILED: 102>'), DeliveryError('Failed to deliver message: <EmberStatus.DELIVERY_FAILED: 102>'), DeliveryError('Failed to deliver message: <EmberStatus.DELIVERY_FAILED: 102>'), DeliveryError('Failed to deliver message: <EmberStatus.DELIVERY_FAILED: 102>')]
2023-12-14 20:27:04.013 WARNING (MainThread) [homeassistant.components.zha.core.cluster_handlers] [0x30C9:1:0x0702]: async_initialize: all attempts have failed: [DeliveryError('Failed to deliver message: <EmberStatus.DELIVERY_FAILED: 102>'), DeliveryError('Failed to deliver message: <EmberStatus.DELIVERY_FAILED: 102>'), DeliveryError('Failed to deliver message: <EmberStatus.DELIVERY_FAILED: 102>'), DeliveryError('Failed to deliver message: <EmberStatus.DELIVERY_FAILED: 102>')]
2023-12-14 20:27:04.062 WARNING (MainThread) [homeassistant.components.zha.core.cluster_handlers] [0x30C9:1:0x0300]: async_initialize: all attempts have failed: [DeliveryError('Failed to deliver message: <EmberStatus.DELIVERY_FAILED: 102>'), DeliveryError('Failed to deliver message: <EmberStatus.DELIVERY_FAILED: 102>'), DeliveryError('Failed to deliver message: <EmberStatus.DELIVERY_FAILED: 102>'), DeliveryError('Failed to deliver message: <EmberStatus.DELIVERY_FAILED: 102>')]
2023-12-14 20:27:04.168 WARNING (MainThread) [homeassistant.components.zha.core.cluster_handlers] [0x30C9:1:0x0006]: async_initialize: all attempts have failed: [DeliveryError('Failed to deliver message: <EmberStatus.DELIVERY_FAILED: 102>'), DeliveryError('Failed to deliver message: <EmberStatus.DELIVERY_FAILED: 102>'), DeliveryError('Failed to deliver message: <EmberStatus.DELIVERY_FAILED: 102>'), DeliveryError('Failed to deliver message: <EmberStatus.DELIVERY_FAILED: 102>')]
2023-12-14 20:27:04.926 WARNING (MainThread) [homeassistant.components.zha.core.cluster_handlers] [0x6D86:1:0x0006]: async_initialize: all attempts have failed: [DeliveryError('Failed to deliver message: <EmberStatus.DELIVERY_FAILED: 102>'), DeliveryError('Failed to deliver message: <EmberStatus.DELIVERY_FAILED: 102>'), DeliveryError('Failed to deliver message: <EmberStatus.DELIVERY_FAILED: 102>'), DeliveryError('Failed to deliver message: <EmberStatus.DELIVERY_FAILED: 102>')]
2023-12-14 20:27:04.992 WARNING (MainThread) [homeassistant.components.zha.core.cluster_handlers] [0x6D86:1:0x0300]: async_initialize: all attempts have failed: [DeliveryError('Failed to deliver message: <EmberStatus.DELIVERY_FAILED: 102>'), DeliveryError('Failed to deliver message: <EmberStatus.DELIVERY_FAILED: 102>'), DeliveryError('Failed to deliver message: <EmberStatus.DELIVERY_FAILED: 102>'), DeliveryError('Failed to deliver message: <EmberStatus.DELIVERY_FAILED: 102>')]
2023-12-14 20:27:05.050 WARNING (MainThread) [homeassistant.components.zha.core.cluster_handlers] [0x6D86:1:0x0008]: async_initialize: all attempts have failed: [DeliveryError('Failed to deliver message: <EmberStatus.DELIVERY_FAILED: 102>'), DeliveryError('Failed to deliver message: <EmberStatus.DELIVERY_FAILED: 102>'), DeliveryError('Failed to deliver message: <EmberStatus.DELIVERY_FAILED: 102>'), DeliveryError('Failed to deliver message: <EmberStatus.DELIVERY_FAILED: 102>')]
2023-12-14 20:27:06.778 WARNING (MainThread) [py.warnings] /usr/local/lib/python3.11/site-packages/turbojpeg.py:901: UserWarning: Corrupt JPEG data: 3 extraneous bytes before marker 0xd5
  warnings.warn(self.__get_error_string(handle))

2023-12-14 20:27:06.966 WARNING (MainThread) [homeassistant.components.zha.core.cluster_handlers] [0xF674:1:0x0006]: async_initialize: all attempts have failed: [DeliveryError('Failed to deliver message: <EmberStatus.DELIVERY_FAILED: 102>'), DeliveryError('Failed to deliver message: <EmberStatus.DELIVERY_FAILED: 102>'), DeliveryError('Failed to deliver message: <EmberStatus.DELIVERY_FAILED: 102>'), DeliveryError('Failed to deliver message: <EmberStatus.DELIVERY_FAILED: 102>')]
2023-12-14 20:27:08.455 WARNING (MainThread) [homeassistant.components.zha.core.cluster_handlers] [0x6D86:1:0x0702]: async_initialize: all attempts have failed: [DeliveryError('Failed to deliver message: <EmberStatus.DELIVERY_FAILED: 102>'), DeliveryError('Failed to deliver message: <EmberStatus.DELIVERY_FAILED: 102>'), DeliveryError('Failed to deliver message: <EmberStatus.DELIVERY_FAILED: 102>'), DeliveryError('Failed to deliver message: <EmberStatus.DELIVERY_FAILED: 102>')]
2023-12-14 20:27:08.724 WARNING (MainThread) [homeassistant.components.zha.core.cluster_handlers] [0x18F9:1:0x0006]: async_initialize: all attempts have failed: [DeliveryError('Failed to deliver message: <EmberStatus.DELIVERY_FAILED: 102>'), DeliveryError('Failed to deliver message: <EmberStatus.DELIVERY_FAILED: 102>'), DeliveryError('Failed to deliver message: <EmberStatus.DELIVERY_FAILED: 102>'), DeliveryError('Failed to deliver message: <EmberStatus.DELIVERY_FAILED: 102>')]
2023-12-14 20:27:08.778 WARNING (MainThread) [homeassistant.components.zha.core.cluster_handlers] [0xF674:1:0x0702]: async_initialize: all attempts have failed: [DeliveryError('Failed to deliver message: <EmberStatus.DELIVERY_FAILED: 102>'), DeliveryError('Failed to deliver message: <EmberStatus.DELIVERY_FAILED: 102>'), DeliveryError('Failed to deliver message: <EmberStatus.DELIVERY_FAILED: 102>'), DeliveryError('Failed to deliver message: <EmberStatus.DELIVERY_FAILED: 102>')]
2023-12-14 20:27:08.882 WARNING (MainThread) [homeassistant.components.zha.core.cluster_handlers] [0xF674:1:0x0300]: async_initialize: all attempts have failed: [DeliveryError('Failed to deliver message: <EmberStatus.DELIVERY_FAILED: 102>'), DeliveryError('Failed to deliver message: <EmberStatus.DELIVERY_FAILED: 102>'), DeliveryError('Failed to deliver message: <EmberStatus.DELIVERY_FAILED: 102>'), DeliveryError('Failed to deliver message: <EmberStatus.DELIVERY_FAILED: 102>')]
2023-12-14 20:27:09.703 WARNING (MainThread) [homeassistant.components.zha.core.cluster_handlers] [0x18F9:1:0x0008]: async_initialize: all attempts have failed: [DeliveryError('Failed to deliver message: <EmberStatus.DELIVERY_FAILED: 102>'), DeliveryError('Failed to deliver message: <EmberStatus.DELIVERY_FAILED: 102>'), DeliveryError('Failed to deliver message: <EmberStatus.DELIVERY_FAILED: 102>'), DeliveryError('Failed to deliver message: <EmberStatus.DELIVERY_FAILED: 102>')]
2023-12-14 20:27:09.763 WARNING (MainThread) [homeassistant.components.zha.core.cluster_handlers] [0x18F9:1:0x0702]: async_initialize: all attempts have failed: [DeliveryError('Failed to deliver message: <EmberStatus.DELIVERY_FAILED: 102>'), DeliveryError('Failed to deliver message: <EmberStatus.DELIVERY_FAILED: 102>'), DeliveryError('Failed to deliver message: <EmberStatus.DELIVERY_FAILED: 102>'), DeliveryError('Failed to deliver message: <EmberStatus.DELIVERY_FAILED: 102>')]
2023-12-14 20:27:11.674 WARNING (MainThread) [homeassistant.components.zha.core.cluster_handlers] [0xF674:1:0x0008]: async_initialize: all attempts have failed: [DeliveryError('Failed to deliver message: <EmberStatus.DELIVERY_FAILED: 102>'), DeliveryError('Failed to deliver message: <EmberStatus.DELIVERY_FAILED: 102>'), DeliveryError('Failed to deliver message: <EmberStatus.DELIVERY_FAILED: 102>'), DeliveryError('Failed to deliver message: <EmberStatus.DELIVERY_FAILED: 102>')]
2023-12-14 20:27:13.169 WARNING (MainThread) [homeassistant.components.zha.core.cluster_handlers] [0x18F9:1:0x0300]: async_initialize: all attempts have failed: [DeliveryError('Failed to deliver message: <EmberStatus.DELIVERY_FAILED: 102>'), DeliveryError('Failed to deliver message: <EmberStatus.DELIVERY_FAILED: 102>'), DeliveryError('Failed to deliver message: <EmberStatus.DELIVERY_FAILED: 102>'), DeliveryError('Failed to deliver message: <EmberStatus.DELIVERY_FAILED: 102>')]
2023-12-14 20:27:13.436 WARNING (MainThread) [homeassistant.components.zha.core.cluster_handlers] [0xCACB:1:0x0006]: async_initialize: all attempts have failed: [DeliveryError('Failed to deliver message: <EmberStatus.DELIVERY_FAILED: 102>'), DeliveryError('Failed to deliver message: <EmberStatus.DELIVERY_FAILED: 102>'), DeliveryError('Failed to deliver message: <EmberStatus.DELIVERY_FAILED: 102>'), DeliveryError('Failed to deliver message: <EmberStatus.DELIVERY_FAILED: 102>')]
2023-12-14 20:27:13.492 WARNING (MainThread) [homeassistant.components.zha.core.cluster_handlers] [0xCACB:1:0x0008]: async_initialize: all attempts have failed: [DeliveryError('Failed to deliver message: <EmberStatus.DELIVERY_FAILED: 102>'), DeliveryError('Failed to deliver message: <EmberStatus.DELIVERY_FAILED: 102>'), DeliveryError('Failed to deliver message: <EmberStatus.DELIVERY_FAILED: 102>'), DeliveryError('Failed to deliver message: <EmberStatus.DELIVERY_FAILED: 102>')]
2023-12-14 20:27:13.596 WARNING (MainThread) [homeassistant.components.zha.core.cluster_handlers] [0xCACB:1:0x0300]: async_initialize: all attempts have failed: [DeliveryError('Failed to deliver message: <EmberStatus.DELIVERY_FAILED: 102>'), DeliveryError('Failed to deliver message: <EmberStatus.DELIVERY_FAILED: 102>'), DeliveryError('Failed to deliver message: <EmberStatus.DELIVERY_FAILED: 102>'), DeliveryError('Failed to deliver message: <EmberStatus.DELIVERY_FAILED: 102>')]
2023-12-14 20:27:14.346 WARNING (MainThread) [homeassistant.components.zha.core.cluster_handlers] [0x259C:1:0x0006]: async_initialize: all attempts have failed: [DeliveryError('Failed to deliver message: <EmberStatus.DELIVERY_FAILED: 102>'), DeliveryError('Failed to deliver message: <EmberStatus.DELIVERY_FAILED: 102>'), DeliveryError('Failed to deliver message: <EmberStatus.DELIVERY_FAILED: 102>'), DeliveryError('Failed to deliver message: <EmberStatus.DELIVERY_FAILED: 102>')]
2023-12-14 20:27:14.416 WARNING (MainThread) [homeassistant.components.zha.core.cluster_handlers] [0xCACB:1:0x0702]: async_initialize: all attempts have failed: [DeliveryError('Failed to deliver message: <EmberStatus.DELIVERY_FAILED: 102>'), DeliveryError('Failed to deliver message: <EmberStatus.DELIVERY_FAILED: 102>'), DeliveryError('Failed to deliver message: <EmberStatus.DELIVERY_FAILED: 102>'), DeliveryError('Failed to deliver message: <EmberStatus.DELIVERY_FAILED: 102>')]
2023-12-14 20:27:14.477 WARNING (MainThread) [homeassistant.components.zha.core.cluster_handlers] [0x259C:1:0x0300]: async_initialize: all attempts have failed: [DeliveryError('Failed to deliver message: <EmberStatus.DELIVERY_FAILED: 102>'), DeliveryError('Failed to deliver message: <EmberStatus.DELIVERY_FAILED: 102>'), DeliveryError('Failed to deliver message: <EmberStatus.DELIVERY_FAILED: 102>'), DeliveryError('Failed to deliver message: <EmberStatus.DELIVERY_FAILED: 102>')]
2023-12-14 20:27:16.384 WARNING (MainThread) [homeassistant.components.zha.core.cluster_handlers] [0xEEF2:1:0x0008]: async_initialize: all attempts have failed: [DeliveryError('Failed to deliver message: <EmberStatus.DELIVERY_FAILED: 102>'), DeliveryError('Failed to deliver message: <EmberStatus.DELIVERY_FAILED: 102>'), DeliveryError('Failed to deliver message: <EmberStatus.DELIVERY_FAILED: 102>'), DeliveryError('Failed to deliver message: <EmberStatus.DELIVERY_FAILED: 102>')]
2023-12-14 20:27:16.774 WARNING (MainThread) [py.warnings] /usr/local/lib/python3.11/site-packages/turbojpeg.py:901: UserWarning: Corrupt JPEG data: 5 extraneous bytes before marker 0xd5
  warnings.warn(self.__get_error_string(handle))

2023-12-14 20:27:17.879 WARNING (MainThread) [homeassistant.components.zha.core.cluster_handlers] [0xEEF2:1:0x0006]: async_initialize: all attempts have failed: [DeliveryError('Failed to deliver message: <EmberStatus.DELIVERY_FAILED: 102>'), DeliveryError('Failed to deliver message: <EmberStatus.DELIVERY_FAILED: 102>'), DeliveryError('Failed to deliver message: <EmberStatus.DELIVERY_FAILED: 102>'), DeliveryError('Failed to deliver message: <EmberStatus.DELIVERY_FAILED: 102>')]
2023-12-14 20:27:18.153 WARNING (MainThread) [homeassistant.components.zha.core.cluster_handlers] [0xEEF2:1:0x0300]: async_initialize: all attempts have failed: [DeliveryError('Failed to deliver message: <EmberStatus.DELIVERY_FAILED: 102>'), DeliveryError('Failed to deliver message: <EmberStatus.DELIVERY_FAILED: 102>'), DeliveryError('Failed to deliver message: <EmberStatus.DELIVERY_FAILED: 102>'), DeliveryError('Failed to deliver message: <EmberStatus.DELIVERY_FAILED: 102>')]
2023-12-14 20:27:18.203 WARNING (MainThread) [homeassistant.components.zha.core.cluster_handlers] [0x259C:1:0x0008]: async_initialize: all attempts have failed: [DeliveryError('Failed to deliver message: <EmberStatus.DELIVERY_FAILED: 102>'), DeliveryError('Failed to deliver message: <EmberStatus.DELIVERY_FAILED: 102>'), DeliveryError('Failed to deliver message: <EmberStatus.DELIVERY_FAILED: 102>'), DeliveryError('Failed to deliver message: <EmberStatus.DELIVERY_FAILED: 102>')]
2023-12-14 20:27:18.507 WARNING (MainThread) [homeassistant.components.zha.core.cluster_handlers] [0x259C:1:0x0702]: async_initialize: all attempts have failed: [DeliveryError('Failed to deliver message: <EmberStatus.DELIVERY_FAILED: 102>'), DeliveryError('Failed to deliver message: <EmberStatus.DELIVERY_FAILED: 102>'), DeliveryError('Failed to deliver message: <EmberStatus.DELIVERY_FAILED: 102>'), DeliveryError('Failed to deliver message: <EmberStatus.DELIVERY_FAILED: 102>')]
2023-12-14 20:27:19.058 WARNING (MainThread) [homeassistant.components.zha.core.cluster_handlers] [0xC1B6:1:0x0006]: async_initialize: all attempts have failed: [DeliveryError('Failed to deliver message: <EmberStatus.DELIVERY_FAILED: 102>'), DeliveryError('Failed to deliver message: <EmberStatus.DELIVERY_FAILED: 102>'), DeliveryError('Failed to deliver message: <EmberStatus.DELIVERY_FAILED: 102>'), DeliveryError('Failed to deliver message: <EmberStatus.DELIVERY_FAILED: 102>')]
2023-12-14 20:27:19.131 WARNING (MainThread) [homeassistant.components.zha.core.cluster_handlers] [0xC1B6:1:0x0702]: async_initialize: all attempts have failed: [DeliveryError('Failed to deliver message: <EmberStatus.DELIVERY_FAILED: 102>'), DeliveryError('Failed to deliver message: <EmberStatus.DELIVERY_FAILED: 102>'), DeliveryError('Failed to deliver message: <EmberStatus.DELIVERY_FAILED: 102>'), DeliveryError('Failed to deliver message: <EmberStatus.DELIVERY_FAILED: 102>')]
2023-12-14 20:27:19.189 WARNING (MainThread) [homeassistant.components.zha.core.cluster_handlers] [0xE88A:1:0x0006]: async_initialize: all attempts have failed: [DeliveryError('Failed to deliver message: <EmberStatus.DELIVERY_FAILED: 102>'), DeliveryError('Failed to deliver message: <EmberStatus.DELIVERY_FAILED: 102>'), DeliveryError('Failed to deliver message: <EmberStatus.DELIVERY_FAILED: 102>'), DeliveryError('Failed to deliver message: <EmberStatus.DELIVERY_FAILED: 102>')]
2023-12-14 20:27:21.095 WARNING (MainThread) [homeassistant.components.zha.core.cluster_handlers] [0xE88A:1:0x0300]: async_initialize: all attempts have failed: [DeliveryError('Failed to deliver message: <EmberStatus.DELIVERY_FAILED: 102>'), DeliveryError('Failed to deliver message: <EmberStatus.DELIVERY_FAILED: 102>'), DeliveryError('Failed to deliver message: <EmberStatus.DELIVERY_FAILED: 102>'), DeliveryError('Failed to deliver message: <EmberStatus.DELIVERY_FAILED: 102>')]
2023-12-14 20:27:22.591 WARNING (MainThread) [homeassistant.components.zha.core.cluster_handlers] [0xE88A:1:0x0008]: async_initialize: all attempts have failed: [DeliveryError('Failed to deliver message: <EmberStatus.DELIVERY_FAILED: 102>'), DeliveryError('Failed to deliver message: <EmberStatus.DELIVERY_FAILED: 102>'), DeliveryError('Failed to deliver message: <EmberStatus.DELIVERY_FAILED: 102>'), DeliveryError('Failed to deliver message: <EmberStatus.DELIVERY_FAILED: 102>')]
2023-12-14 20:27:22.869 WARNING (MainThread) [homeassistant.components.zha.core.cluster_handlers] [0xEEF2:1:0x0702]: async_initialize: all attempts have failed: [DeliveryError('Failed to deliver message: <EmberStatus.DELIVERY_FAILED: 102>'), DeliveryError('Failed to deliver message: <EmberStatus.DELIVERY_FAILED: 102>'), DeliveryError('Failed to deliver message: <EmberStatus.DELIVERY_FAILED: 102>'), DeliveryError('Failed to deliver message: <EmberStatus.DELIVERY_FAILED: 102>')]
2023-12-14 20:27:22.916 WARNING (MainThread) [homeassistant.components.zha.core.cluster_handlers] [0xC1B6:1:0x0008]: async_initialize: all attempts have failed: [DeliveryError('Failed to deliver message: <EmberStatus.DELIVERY_FAILED: 102>'), DeliveryError('Failed to deliver message: <EmberStatus.DELIVERY_FAILED: 102>'), DeliveryError('Failed to deliver message: <EmberStatus.DELIVERY_FAILED: 102>'), DeliveryError('Failed to deliver message: <EmberStatus.DELIVERY_FAILED: 102>')]
2023-12-14 20:27:23.260 WARNING (MainThread) [homeassistant.components.zha.core.cluster_handlers] [0xC1B6:1:0x0300]: async_initialize: all attempts have failed: [DeliveryError('Failed to deliver message: <EmberStatus.DELIVERY_FAILED: 102>'), DeliveryError('Failed to deliver message: <EmberStatus.DELIVERY_FAILED: 102>'), DeliveryError('Failed to deliver message: <EmberStatus.DELIVERY_FAILED: 102>'), DeliveryError('Failed to deliver message: <EmberStatus.DELIVERY_FAILED: 102>')]
2023-12-14 20:27:23.772 WARNING (MainThread) [homeassistant.components.zha.core.cluster_handlers] [0xE88A:1:0x0702]: async_initialize: all attempts have failed: [DeliveryError('Failed to deliver message: <EmberStatus.DELIVERY_FAILED: 102>'), DeliveryError('Failed to deliver message: <EmberStatus.DELIVERY_FAILED: 102>'), DeliveryError('Failed to deliver message: <EmberStatus.DELIVERY_FAILED: 102>'), DeliveryError('Failed to deliver message: <EmberStatus.DELIVERY_FAILED: 102>')]
2023-12-14 20:27:23.844 WARNING (MainThread) [homeassistant.components.zha.core.cluster_handlers] [0x3834:1:0x0008]: async_initialize: all attempts have failed: [DeliveryError('Failed to deliver message: <EmberStatus.DELIVERY_FAILED: 102>'), DeliveryError('Failed to deliver message: <EmberStatus.DELIVERY_FAILED: 102>'), DeliveryError('Failed to deliver message: <EmberStatus.DELIVERY_FAILED: 102>'), DeliveryError('Failed to deliver message: <EmberStatus.DELIVERY_FAILED: 102>')]
2023-12-14 20:27:23.904 WARNING (MainThread) [homeassistant.components.zha.core.cluster_handlers] [0x3834:1:0x0300]: async_initialize: all attempts have failed: [DeliveryError('Failed to deliver message: <EmberStatus.DELIVERY_FAILED: 102>'), DeliveryError('Failed to deliver message: <EmberStatus.DELIVERY_FAILED: 102>'), DeliveryError('Failed to deliver message: <EmberStatus.DELIVERY_FAILED: 102>'), DeliveryError('Failed to deliver message: <EmberStatus.DELIVERY_FAILED: 102>')]
2023-12-14 20:27:25.806 WARNING (MainThread) [homeassistant.components.zha.core.cluster_handlers] [0xA46C:1:0x0006]: async_initialize: all attempts have failed: [DeliveryError('Failed to deliver message: <EmberStatus.DELIVERY_FAILED: 102>'), DeliveryError('Failed to deliver message: <EmberStatus.DELIVERY_FAILED: 102>'), DeliveryError('Failed to deliver message: <EmberStatus.DELIVERY_FAILED: 102>'), DeliveryError('Failed to deliver message: <EmberStatus.DELIVERY_FAILED: 102>')]
2023-12-14 20:27:26.741 WARNING (MainThread) [py.warnings] /usr/local/lib/python3.11/site-packages/turbojpeg.py:901: UserWarning: Corrupt JPEG data: 2 extraneous bytes before marker 0xd6
  warnings.warn(self.__get_error_string(handle))

2023-12-14 20:27:27.300 WARNING (MainThread) [homeassistant.components.zha.core.cluster_handlers] [0xA46C:1:0x0008]: async_initialize: all attempts have failed: [DeliveryError('Failed to deliver message: <EmberStatus.DELIVERY_FAILED: 102>'), DeliveryError('Failed to deliver message: <EmberStatus.DELIVERY_FAILED: 102>'), DeliveryError('Failed to deliver message: <EmberStatus.DELIVERY_FAILED: 102>'), DeliveryError('Failed to deliver message: <EmberStatus.DELIVERY_FAILED: 102>')]
2023-12-14 20:27:27.618 WARNING (MainThread) [homeassistant.components.zha.core.cluster_handlers] [0xA46C:1:0x0300]: async_initialize: all attempts have failed: [DeliveryError('Failed to deliver message: <EmberStatus.DELIVERY_FAILED: 102>'), DeliveryError('Failed to deliver message: <EmberStatus.DELIVERY_FAILED: 102>'), DeliveryError('Failed to deliver message: <EmberStatus.DELIVERY_FAILED: 102>'), DeliveryError('Failed to deliver message: <EmberStatus.DELIVERY_FAILED: 102>')]
2023-12-14 20:27:27.974 WARNING (MainThread) [homeassistant.components.zha.core.cluster_handlers] [0xA46C:1:0x0702]: async_initialize: all attempts have failed: [DeliveryError('Failed to deliver message: <EmberStatus.DELIVERY_FAILED: 102>'), DeliveryError('Failed to deliver message: <EmberStatus.DELIVERY_FAILED: 102>'), DeliveryError('Failed to deliver message: <EmberStatus.DELIVERY_FAILED: 102>'), DeliveryError('Failed to deliver message: <EmberStatus.DELIVERY_FAILED: 102>')]
2023-12-14 20:27:28.058 WARNING (MainThread) [homeassistant.components.zha.core.cluster_handlers] [0xD814:1:0x0702]: async_initialize: all attempts have failed: [DeliveryError('Failed to deliver message: <EmberStatus.DELIVERY_FAILED: 102>'), DeliveryError('Failed to deliver message: <EmberStatus.DELIVERY_FAILED: 102>'), DeliveryError('Failed to deliver message: <EmberStatus.DELIVERY_FAILED: 102>'), DeliveryError('Failed to deliver message: <EmberStatus.DELIVERY_FAILED: 102>')]
2023-12-14 20:27:28.484 WARNING (MainThread) [homeassistant.components.zha.core.cluster_handlers] [0x3834:1:0x0006]: async_initialize: all attempts have failed: [DeliveryError('Failed to deliver message: <EmberStatus.DELIVERY_FAILED: 102>'), DeliveryError('Failed to deliver message: <EmberStatus.DELIVERY_FAILED: 102>'), DeliveryError('Failed to deliver message: <EmberStatus.DELIVERY_FAILED: 102>'), DeliveryError('Failed to deliver message: <EmberStatus.DELIVERY_FAILED: 102>')]
2023-12-14 20:27:28.555 WARNING (MainThread) [homeassistant.components.zha.core.cluster_handlers] [0xD814:1:0x0008]: async_initialize: all attempts have failed: [DeliveryError('Failed to deliver message: <EmberStatus.DELIVERY_FAILED: 102>'), DeliveryError('Failed to deliver message: <EmberStatus.DELIVERY_FAILED: 102>'), DeliveryError('Failed to deliver message: <EmberStatus.DELIVERY_FAILED: 102>'), DeliveryError('Failed to deliver message: <EmberStatus.DELIVERY_FAILED: 102>')]
2023-12-14 20:27:28.613 WARNING (MainThread) [homeassistant.components.zha.core.cluster_handlers] [0xD814:1:0x0006]: async_initialize: all attempts have failed: [DeliveryError('Failed to deliver message: <EmberStatus.DELIVERY_FAILED: 102>'), DeliveryError('Failed to deliver message: <EmberStatus.DELIVERY_FAILED: 102>'), DeliveryError('Failed to deliver message: <EmberStatus.DELIVERY_FAILED: 102>'), DeliveryError('Failed to deliver message: <EmberStatus.DELIVERY_FAILED: 102>')]
2023-12-14 20:27:30.519 WARNING (MainThread) [home
1 Like

Same here, but I even have installed 12.3, so I can’t yet say if that helps here…

Thanks, I’m following this thread. I have the same hardware. I’ve seen occasional errors like that in the past, especially at start-up, but never that many, and they never seemed to cause problems.

Ok, interesting new behavior: it seems to work in the morning. After a few hours today, everything was back to a mess like last night.

Could his just be a number of devices issue? I did recently add two new smart plugs. There are currently at 53 devices and 407 entities on the zigbee network. Many of them are routers, so I doubt this is the problem, but maybe there are limitations I don’t know about.

I’m far from an expert and have moved away from ZHA to Zigbee2MQTT. However, in both systems on pretty rare occasions doing an upgrade to the Zigbee software that runs above the coordinator device caused the network to not setup properly. I believe I saw this on both ZHA and Zigbee2MQTT, again rare but there.

The solution was to shutdown (if it had not already crashed) the Zigbee stack above the coordinator and then power cycle the coordinator dongle/device. Then restart the Zigbee stack on top of the coordinator device.

Without power cycling the Zigbee device acting as the coordinator, as I understand it the low level Zigbee mesh network is still running. Again, as I understand it, this should not be necessary. However, from my experience either the mesh network was not happy with the new coordinator stack, or the USB interface device to the coordinator (if USB connected) got wonked out.

Good hunting!

When you say “shutdown the Zigbee stack,” what do you mean?

I’ve already attempted both a normal reboot and a shutdown, unplug the dongle, plug it back in, restart of the computer that’s running HA.

Well it sounds like based on the description of the steps you have taken, what I described is not a cause of your issues.

My poor term, “Zigbee stack on top of the coordinator”, refers to, for example, the Zigbee2MQTT node application that talks to the coordinator device, or the ZHA python subsystems in Home Assistant that talk to the coordinator device.

Back to your problem.

  1. Probably not an issue, however, how many devices are directly paired and connected to your coordinator. I am not familiar with your coordinator device, Nortek HUSBZB-1, however you might check it’s limits against what you have. It appears to be an older Zigbee device, a bit of a PIA, however you might consider at some point a coordinator device upgrade. I have had good success with the TI 26xx based devices for my coordinators and routers. Dones not matter if the device directly connected to the coordinator is a router or and end device, coordinator direct connect limit applies to total devices connect to it.

  2. A little googling of ‘EmberStatus.DELIVERY_FAILED: 102’ does return several hits that also reference your coordinator device. However, unfortunately a lot of other stuff as well.

Good hunting!

This set of problems seem to be solved by the HA core 2023.12.4 update.

1 Like