Sensors are added to deConz but are not appearing in HA, not showing in the HA device list

Recently I bumped into a blocking issue. Sensors are added to Phoscone and show up nicely in deConz with links etc., but not appearing in HA devices even if remove and re-add them.

Details.
Several Aqara motion sensors became ‘unavailable’ recently in HA. The batteries are fine. Conbee 2 is on a USB cable plugged into raspberry 3.

Added a Zigbee sensor which shows up in Phoscon/deConz and detects motion. But whatever I try, it does not appear in HA. I tried rebooting it all and upgrading the core, app etc.

There were no major changes to the system that might have caused the error. At some point, before HA became unavailable, but raspberry/linux still worked and restarting the docker helped to make it work. Perhaps it’s some HA SW issue because deconz seems to be functioning fine.

In the attachment, the Stairs Top 2a Motion sensor is not visible in HA but reporting in deconz.

Has anyone bumped into the problem and how can I address this?
Is there a way to force-discover the sensor or manually add it to HA?

Hello! Could you follow the deConz integration documentation instructions for how to enable debug logging in hass and share some logs with me?

@clj-reactor could you exactly how the “solution” solved your problem?

I was recently forced back to deconz in docker on my main host (for reasons I can’t explain).

Most things work fine, all lights, all remotes, all door/window sensors. But only a few of the other types of sensors seem to work. That is, they work fine in Phoscon, I can see them, they update their state as expected, but they just don’t work in HA. Some never show up, others just show as “unavailable” even when they update fine in Phoscon:

HA:

Phoscon:

Like you, I can of course also see them in the deconz UI making connections.

In the HA logs, I see this:

2022-11-07 15:39:11.642 DEBUG (MainThread) [pydeconz.websocket] {"config":{"battery":100,"offset":0,"on":true,"reachable":true},"e":"changed","id":"55","r":"sensors","t":"event","uniqueid":"00:15:8d:00:02:43:78:97-01-0405"}
2022-11-07 15:39:11.644 DEBUG (MainThread) [pydeconz.websocket] {"attr":{"id":"56","lastannounced":null,"lastseen":"2022-11-07T14:39Z","manufacturername":"LUMI","modelid":"lumi.weather","name":"Kitchen Multi Sensor","swversion":"20161129","type":"ZHATemperature","uniqueid":"00:15:8d:00:02:43:78:97-01-0402"},"e":"changed","id":"56","r":"sensors","t":"event","uniqueid":"00:15:8d:00:02:43:78:97-01-0402"}
2022-11-07 15:39:11.647 DEBUG (MainThread) [pydeconz.websocket] {"config":{"battery":100,"offset":0,"on":true,"reachable":true},"e":"changed","id":"56","r":"sensors","t":"event","uniqueid":"00:15:8d:00:02:43:78:97-01-0402"}
2022-11-07 15:39:11.649 DEBUG (MainThread) [pydeconz.websocket] {"attr":{"id":"57","lastannounced":null,"lastseen":"2022-11-07T14:39Z","manufacturername":"LUMI","modelid":"lumi.weather","name":"Kitchen Multi Sensor","swversion":"20161129","type":"ZHAPressure","uniqueid":"00:15:8d:00:02:43:78:97-01-0403"},"e":"changed","id":"57","r":"sensors","t":"event","uniqueid":"00:15:8d:00:02:43:78:97-01-0403"}
2022-11-07 15:39:11.654 DEBUG (MainThread) [pydeconz.websocket] {"config":{"battery":100,"offset":0,"on":true,"reachable":true},"e":"changed","id":"57","r":"sensors","t":"event","uniqueid":"00:15:8d:00:02:43:78:97-01-0403"}

So it seems like HA should see it?

I also see this error; it didn't look immediately relevant (since it mentions `light_level`, which is not included in the sensor in question) but I'll include just in case.
Logger: homeassistant.components.sensor
Source: components/deconz/sensor.py:158
Integration: Sensor (documentation, issues)
First occurred: 15:36:47 (1 occurrences)
Last logged: 15:36:47

Error while setting up deconz platform for sensor
Traceback (most recent call last):
  File "/usr/src/homeassistant/homeassistant/helpers/entity_platform.py", line 281, in _async_setup_platform
    await asyncio.shield(task)
  File "/usr/src/homeassistant/homeassistant/components/deconz/sensor.py", line 300, in async_setup_entry
    gateway.register_platform_add_device_callback(
  File "/usr/src/homeassistant/homeassistant/components/deconz/gateway.py", line 173, in register_platform_add_device_callback
    async_add_device(EventType.ADDED, device_id)
  File "/usr/src/homeassistant/homeassistant/components/deconz/gateway.py", line 163, in async_add_device
    add_device_callback(EventType.ADDED, device_id)
  File "/usr/src/homeassistant/homeassistant/components/deconz/sensor.py", line 271, in async_add_sensor
    if description.value_fn(sensor) is None:
  File "/usr/src/homeassistant/homeassistant/components/deconz/sensor.py", line 158, in <lambda>
    value_fn=lambda device: device.scaled_light_level,
  File "/usr/local/lib/python3.10/site-packages/pydeconz/models/sensor/light_level.py", line 57, in scaled_light_level
    return round(math.pow(10, (self.light_level - 1) / 10000), 1)
TypeError: unsupported operand type(s) for -: 'NoneType' and 'int'

This has been fixed Fix situation where deCONZ sensor platform setup would fail by Kane610 · Pull Request #81629 · home-assistant/core · GitHub and will be released with 2022.11.2

1 Like

Ahh, cool. Thanks!

Just pressed the wrong button:) The issue still stubbornly persists.
I have enabled the logs and will send them tomorrow.
@Robban Which logs do you need besided deConz?

Enable debug logging for the deCONZ integration in home assistant, that’s all I need. I only work on integration side :slight_smile:

You can find example in deCONZ integration documentation.

@Robban , here is a snippet is that what you mean?

127.0.0.1: new handler Process
localhost - - [07/Nov/2022 22:00:08] "GET //core/inflator.js HTTP/1.1" 200 -
127.0.0.1: new handler Process
172.30.32.2 - - [07/Nov/2022:22:00:08 +0100] "GET /novnc/core/inflator.js HTTP/1.1" 200 1178 "http://192.168.1.58:8123/api/hassio_ingress/ig1X7E4O3u83cjkl9TscJymQBogq8nPhrv8XGHTW7YA/novnc/core/rfb.js" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36"
localhost - - [07/Nov/2022 22:00:08] "GET //core/util/polyfill.js HTTP/1.1" 200 -
127.0.0.1: new handler Process
22:00:08:701 Skip idle timer callback, too early: elapsed 896 msec
172.30.32.2 - - [07/Nov/2022:22:00:08 +0100] "GET /novnc/core/util/polyfill.js HTTP/1.1" 200 1871 "http://192.168.1.58:8123/api/hassio_ingress/ig1X7E4O3u83cjkl9TscJymQBogq8nPhrv8XGHTW7YA/novnc/core/rfb.js" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36"
Ignoring interrupted syscall
localhost - - [07/Nov/2022 22:00:08] "GET //core/encodings.js HTTP/1.1" 200 -
172.30.32.2 - - [07/Nov/2022:22:00:08 +0100] "GET /novnc/core/encodings.js HTTP/1.1" 200 1248 "http://192.168.1.58:8123/api/hassio_ingress/ig1X7E4O3u83cjkl9TscJymQBogq8nPhrv8XGHTW7YA/novnc/core/rfb.js" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36"
Ignoring interrupted syscall
localhost - - [07/Nov/2022 22:00:08] "GET //core/base64.js HTTP/1.1" 200 -
172.30.32.2 - - [07/Nov/2022:22:00:08 +0100] "GET /novnc/core/base64.js HTTP/1.1" 200 4349 "http://192.168.1.58:8123/api/hassio_ingress/ig1X7E4O3u83cjkl9TscJymQBogq8nPhrv8XGHTW7YA/novnc/core/display.js" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36"
Ignoring interrupted syscall
127.0.0.1: new handler Process
127.0.0.1: new handler Process
localhost - - [07/Nov/2022 22:00:08] "GET //core/util/events.js HTTP/1.1" 200 -
172.30.32.2 - - [07/Nov/2022:22:00:08 +0100] "GET /novnc/core/util/events.js HTTP/1.1" 200 4220 "http://192.168.1.58:8123/api/hassio_ingress/ig1X7E4O3u83cjkl9TscJymQBogq8nPhrv8XGHTW7YA/novnc/core/input/mouse.js" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36"
127.0.0.1: new handler Process
localhost - - [07/Nov/2022 22:00:08] "GET //core/input/util.js HTTP/1.1" 200 -
127.0.0.1: new handler Process
172.30.32.2 - - [07/Nov/2022:22:00:08 +0100] "GET /novnc/core/input/util.js HTTP/1.1" 200 5327 "http://192.168.1.58:8123/api/hassio_ingress/ig1X7E4O3u83cjkl9TscJymQBogq8nPhrv8XGHTW7YA/novnc/core/input/keyboard.js" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36"
Ignoring interrupted syscall
localhost - - [07/Nov/2022 22:00:08] "GET //vendor/pako/lib/zlib/zstream.js HTTP/1.1" 200 -
localhost - - [07/Nov/2022 22:00:08] "GET //vendor/pako/lib/zlib/inflate.js HTTP/1.1" 200 -
172.30.32.2 - - [07/Nov/2022:22:00:08 +0100] "GET /novnc/vendor/pako/lib/zlib/zstream.js HTTP/1.1" 200 823 "http://192.168.1.58:8123/api/hassio_ingress/ig1X7E4O3u83cjkl9TscJymQBogq8nPhrv8XGHTW7YA/novnc/core/inflator.js" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36"
172.30.32.2 - - [07/Nov/2022:22:00:08 +0100] "GET /novnc/vendor/pako/lib/zlib/inflate.js HTTP/1.1" 200 47128 "http://192.168.1.58:8123/api/hassio_ingress/ig1X7E4O3u83cjkl9TscJymQBogq8nPhrv8XGHTW7YA/novnc/core/inflator.js" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36"
Ignoring interrupted syscall
Ignoring interrupted syscall
127.0.0.1: new handler Process
127.0.0.1: new handler Process
localhost - - [07/Nov/2022 22:00:08] "GET //core/input/keysymdef.js HTTP/1.1" 200 -
172.30.32.2 - - [07/Nov/2022:22:00:09 +0100] "GET /novnc/core/input/keysymdef.js HTTP/1.1" 200 25381 "http://192.168.1.58:8123/api/hassio_ingress/ig1X7E4O3u83cjkl9TscJymQBogq8nPhrv8XGHTW7YA/novnc/core/input/util.js" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36"
127.0.0.1: new handler Process
127.0.0.1: new handler Process
localhost - - [07/Nov/2022 22:00:09] "GET //core/input/vkeys.js HTTP/1.1" 200 -
172.30.32.2 - - [07/Nov/2022:22:00:09 +0100] "GET /novnc/core/input/vkeys.js HTTP/1.1" 200 2519 "http://192.168.1.58:8123/api/hassio_ingress/ig1X7E4O3u83cjkl9TscJymQBogq8nPhrv8XGHTW7YA/novnc/core/input/util.js" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36"
localhost - - [07/Nov/2022 22:00:09] "GET //core/input/fixedkeys.js HTTP/1.1" 200 -
127.0.0.1: new handler Process
127.0.0.1: new handler Process
172.30.32.2 - - [07/Nov/2022:22:00:09 +0100] "GET /novnc/core/input/fixedkeys.js HTTP/1.1" 200 3780 "http://192.168.1.58:8123/api/hassio_ingress/ig1X7E4O3u83cjkl9TscJymQBogq8nPhrv8XGHTW7YA/novnc/core/input/util.js" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36"
Ignoring interrupted syscall
localhost - - [07/Nov/2022 22:00:09] "GET //core/input/domkeytable.js HTTP/1.1" 200 -
localhost - - [07/Nov/2022 22:00:09] "GET //vendor/pako/lib/zlib/adler32.js HTTP/1.1" 200 -
localhost - - [07/Nov/2022 22:00:09] "GET //vendor/pako/lib/utils/common.js HTTP/1.1" 200 -
172.30.32.2 - - [07/Nov/2022:22:00:09 +0100] "GET /novnc/core/input/domkeytable.js HTTP/1.1" 200 11338 "http://192.168.1.58:8123/api/hassio_ingress/ig1X7E4O3u83cjkl9TscJymQBogq8nPhrv8XGHTW7YA/novnc/core/input/util.js" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36"
172.30.32.2 - - [07/Nov/2022:22:00:09 +0100] "GET /novnc/vendor/pako/lib/zlib/adler32.js HTTP/1.1" 200 666 "http://192.168.1.58:8123/api/hassio_ingress/ig1X7E4O3u83cjkl9TscJymQBogq8nPhrv8XGHTW7YA/novnc/vendor/pako/lib/zlib/inflate.js" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36"
127.0.0.1: new handler Process
127.0.0.1: new handler Process
172.30.32.2 - - [07/Nov/2022:22:00:09 +0100] "GET /novnc/vendor/pako/lib/utils/common.js HTTP/1.1" 200 1062 "http://192.168.1.58:8123/api/hassio_ingress/ig1X7E4O3u83cjkl9TscJymQBogq8nPhrv8XGHTW7YA/novnc/vendor/pako/lib/zlib/inflate.js" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36"
Ignoring interrupted syscall
127.0.0.1: new handler Process
localhost - - [07/Nov/2022 22:00:09] "GET //vendor/pako/lib/zlib/crc32.js HTTP/1.1" 200 -
localhost - - [07/Nov/2022 22:00:09] "GET //vendor/pako/lib/zlib/inffast.js HTTP/1.1" 200 -
172.30.32.2 - - [07/Nov/2022:22:00:09 +0100] "GET /novnc/vendor/pako/lib/zlib/crc32.js HTTP/1.1" 200 764 "http://192.168.1.58:8123/api/hassio_ingress/ig1X7E4O3u83cjkl9TscJymQBogq8nPhrv8XGHTW7YA/novnc/vendor/pako/lib/zlib/inflate.js" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36"
172.30.32.2 - - [07/Nov/2022:22:00:09 +0100] "GET /novnc/vendor/pako/lib/zlib/inffast.js HTTP/1.1" 200 11690 "http://192.168.1.58:8123/api/hassio_ingress/ig1X7E4O3u83cjkl9TscJymQBogq8nPhrv8XGHTW7YA/novnc/vendor/pako/lib/zlib/inflate.js" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36"
Ignoring interrupted syscall
localhost - - [07/Nov/2022 22:00:09] "GET //vendor/pako/lib/zlib/inftrees.js HTTP/1.1" 200 -
172.30.32.2 - - [07/Nov/2022:22:00:09 +0100] "GET /novnc/vendor/pako/lib/zlib/inftrees.js HTTP/1.1" 200 11527 "http://192.168.1.58:8123/api/hassio_ingress/ig1X7E4O3u83cjkl9TscJymQBogq8nPhrv8XGHTW7YA/novnc/vendor/pako/lib/zlib/inflate.js" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36"
Ignoring interrupted syscall
127.0.0.1: new handler Process
localhost - - [07/Nov/2022 22:00:09] "GET //websockify HTTP/1.1" 101 -
localhost - - [07/Nov/2022 22:00:09] 127.0.0.1: Plain non-SSL (ws://) WebSocket connection
localhost - - [07/Nov/2022 22:00:09] 127.0.0.1: Version hybi-13, base64: 'False'
localhost - - [07/Nov/2022 22:00:09] 127.0.0.1: Path: '//websockify'
localhost - - [07/Nov/2022 22:00:09] connecting to: 127.0.0.1:5900
22:00:18:578 Unhandled node key 16777251
22:00:21:055 0x0017880104FF9679 error APSDE-DATA.confirm: 0xE9 on task
22:00:22:761 0x0017880104FF9679 error APSDE-DATA.confirm: 0xE9 on task
22:00:23:451 0x0017880104FF9679 error APSDE-DATA.confirm: 0xE9 on task
22:00:25:449 0x0017880104FF9679 error APSDE-DATA.confirm: 0xE9 on task
22:00:58:459 0x0017880104FF9679 error APSDE-DATA.confirm: 0xE9 on task
22:01:04:354 0x0017880104FF9679 error APSDE-DATA.confirm: 0xE9 on task
22:01:05:753 0x0017880104ff9679 found group 0xFFF0
22:01:06:249 0x0017880104FF9679 error APSDE-DATA.confirm: 0xE9 on task
22:01:06:491 0x680AE2FFFE43FF47 error APSDE-DATA.confirm: 0xE9 on task
22:01:21:851 0x0017880104FF9679 error APSDE-DATA.confirm: 0xE9 on task
22:01:30:701 GW firmware version shall be updated to: 0x26720700
localhost - - [07/Nov/2022 22:01:40] 127.0.0.1:5900: Client closed connection
localhost - - [07/Nov/2022 22:01:40] 127.0.0.1:5900: Closed target
172.30.32.2 - - [07/Nov/2022:22:01:40 +0100] "GET /novnc/websockify HTTP/1.1" 101 561326 "-" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36"
Ignoring interrupted syscall
22:02:02:649 0x0017880104FF9679 error APSDE-DATA.confirm: 0xE9 on task
22:03:00:880 ZCL attribute report 0x00158D0002B73095 for cluster: 0x0000, ep: 0x01, frame control: 0x1C, mfcode: 0x115F 
22:03:15:824 SC tick --> StateRead
22:03:15:837 ZCL attribute report 0x0017880104E63FD2 for cluster: 0x0001, ep: 0x02, frame control: 0x18, mfcode: 0x0000 
22:03:20:845 SC tick --> StateRead
22:03:20:873 SC config/allowtouchlink: synced
22:03:20:874 SC --> StateFinished
22:03:20:875 SC state change finished: 00:17:88:01:04:e6:3f:d2-02-fc00
22:03:40:701 GW firmware version shall be updated to: 0x26720700
22:03:53:853 0x0017880104FF9679 error APSDE-DATA.confirm: 0xE9 on task
22:04:39:113 ZCL attribute report 0x00158D0002F9937D for cluster: 0x0406, ep: 0x01, frame control: 0x18, mfcode: 0x0000 
22:04:39:700 Set sensor check interval to 100 milliseconds
22:04:44:845 ZCL attribute report 0x00158D0002F0BDFA for cluster: 0x0406, ep: 0x01, frame control: 0x18, mfcode: 0x0000 
22:04:48:625 ZCL attribute report 0x00158D00058A83BA for cluster: 0x0400, ep: 0x01, frame control: 0x18, mfcode: 0x0000 
22:04:48:658 ZCL attribute report 0x00158D00058A83BA for cluster: 0x0406, ep: 0x01, frame control: 0x18, mfcode: 0x0000 
22:04:49:149 ZCL attribute report 0x00158D00058A8655 for cluster: 0x0400, ep: 0x01, frame control: 0x18, mfcode: 0x0000 
22:04:49:188 ZCL attribute report 0x00158D00058A8655 for cluster: 0x0406, ep: 0x01, frame control: 0x18, mfcode: 0x0000 

I think those logs are from hassos. It should from the home assistant core

I’ve sent you the full logs in a pm.

The logs look alright, which version of home assistant are you running?

Thanks for looking at the logs.
The HA version 2022.10.5

Now the repeater 5 has fallen out the network and won’t come back even when I re-plug it.
There’s smth fundamentally wrong with my HA deployment

There are no similar issues reported previously on the deConz integration for 2022.10 so I think it’s something in your system or on deconz side. Have you perhaps disabled automatic adding of entities in the deConz integration?

It’ seems to be in order:

So I take it’s on the HA side or deconzes. I gues I am past troubleshooting now, this setup is too unstable anyway.
How can I reset deconz ?

It typically is really stable. I’ve been running out for five years. It’s not always the easiest to debug though

I does work for some people. I my case it lasted about one year before running into issue, and was not touching it in the mean time…

But how I solve my issue? It’ sbarely usable now. Devices keep fallinh out and I cannot re-add them.

How can I reset deconz / HA to accept the devices or add all them anew?

I can’t really help with deconz side of things, I only know the integration. Start by upgrading to 2022.11 so we’re on the latest :slight_smile:

Is there a deconz slack or forum or support i can ask.
There were not many reactions on my post (

You have Discord or Forums

1 Like

Hi

I have exactly the same problem. Hassio version is 2022.11.4 in Phoscon all sensors are displayed. IN HA these are absent.

Has anyone already found a solution to this?