Armageddon for z-wave

Woke up this morning, back to stone age. No lights turn on, floor slowly cooled down.
Check log and found error on all event when trigged. Also not able to communicate to any light-switch or lock, etc.
ERROR ZWAVE: Failed to send the message after 3 attempts (ZW0202)

Restarted Host, and everything start working for app 15-20 minutes, before same error appeared…

What I did yesterday:

  • Added couple of new device.
  • Heal network
  • Update HA Core to 2022.3.2

System worked great from app. 18.00 to 2300 (yesterday)

What I have done today:

  • Restart host x10.
  • Restore system back to 2022.2.9
  • Restart host and core several time.

Z-Wave JS is connected, now 4 dead node (yesterday none). Unable to see what’s node that’s dead because if unknown info. But its seems to me most of my light switch and dimmer is present.(first I react on today, because lights not turn on)

Debug logg from Zwave To MQTT:

2022-03-07T07:10:19.552Z CNTRLR Failed to execute controller command after 1/3 attempts. Scheduling next try i
n 100 ms.
2022-03-07T07:10:19.653Z CNTRLR Failed to execute controller command after 2/3 attempts. Scheduling next try i
n 1100 ms.
2022-03-07T07:10:20.756Z CNTRLR [Node 105] requesting the node neighbors failed: Failed to send the message af
ter 3 attempts (ZW0202)
2022-03-07 08:10:20.756 ERROR ZWAVE: Failed to send the message after 3 attempts (ZW0202)
2022-03-07T07:10:20.757Z CNTRLR » [Node 106] requesting node neighbors...
2022-03-07T07:10:20.759Z CNTRLR Failed to execute controller command after 1/3 attempts. Scheduling next try i
n 100 ms.
2022-03-07T07:10:20.860Z CNTRLR Failed to execute controller command after 2/3 attempts. Scheduling next try i
n 1100 ms.
2022-03-07T07:10:21.962Z CNTRLR [Node 106] requesting the node neighbors failed: Failed to send the message af
ter 3 attempts (ZW0202)
2022-03-07 08:10:21.962 ERROR ZWAVE: Failed to send the message after 3 attempts (ZW0202)
2022-03-07T07:10:21.962Z CNTRLR » [Node 109] requesting node neighbors...
2022-03-07T07:10:21.967Z CNTRLR Failed to execute controller command after 1/3 attempts. Scheduling next try i
n 100 ms.
2022-03-07T07:10:22.069Z CNTRLR Failed to execute controller command after 2/3 attempts. Scheduling next try i
n 1100 ms.
2022-03-07T07:10:23.172Z CNTRLR [Node 109] requesting the node neighbors failed: Failed to send the message af
ter 3 attempts (ZW0202)
2022-03-07 08:10:23.173 ERROR ZWAVE: Failed to send the message after 3 attempts (ZW0202)
2022-03-07T07:10:23.173Z CNTRLR » [Node 111] requesting node neighbors...
2022-03-07T07:10:23.176Z CNTRLR Failed to execute controller command after 1/3 attempts. Scheduling next try i
n 100 ms.
2022-03-07T07:10:23.277Z CNTRLR Failed to execute controller command after 2/3 attempts. Scheduling next try i
n 1100 ms.
2022-03-07T07:10:24.380Z CNTRLR [Node 111] requesting the node neighbors failed: Failed to send the message af
ter 3 attempts (ZW0202)
2022-03-07 08:10:24.380 ERROR ZWAVE: Failed to send the message after 3 attempts (ZW0202)
2022-03-07T07:10:24.381Z CNTRLR » [Node 113] requesting node neighbors...
2022-03-07T07:10:24.384Z CNTRLR Failed to execute controller command after 1/3 attempts. Scheduling next try i
n 100 ms.
2022-03-07T07:10:24.485Z CNTRLR Failed to execute controller command after 2/3 attempts. Scheduling next try i
n 1100 ms.
2022-03-07T07:10:25.588Z CNTRLR [Node 113] requesting the node neighbors failed: Failed to send the message af
ter 3 attempts (ZW0202)
2022-03-07 08:10:25.589 ERROR ZWAVE: Failed to send the message after 3 attempts (ZW0202)
2022-03-07T07:10:25.589Z CNTRLR » [Node 114] requesting node neighbors...
2022-03-07T07:10:25.592Z CNTRLR Failed to execute controller command after 1/3 attempts. Scheduling next try i
n 100 ms.
2022-03-07T07:10:25.693Z CNTRLR Failed to execute controller command after 2/3 attempts. Scheduling next try i
n 1100 ms.
2022-03-07T07:10:26.796Z CNTRLR [Node 114] requesting the node neighbors failed: Failed to send the message af
ter 3 attempts (ZW0202)
2022-03-07 08:10:26.797 ERROR ZWAVE: Failed to send the message after 3 attempts (ZW0202)
2022-03-07T07:10:26.797Z CNTRLR » [Node 115] requesting node neighbors...
2022-03-07T07:10:26.801Z CNTRLR Failed to execute controller command after 1/3 attempts. Scheduling next try i
n 100 ms.
2022-03-07T07:10:26.902Z CNTRLR Failed to execute controller command after 2/3 attempts. Scheduling next try i
n 1100 ms.
2022-03-07T07:10:28.004Z CNTRLR [Node 115] requesting the node neighbors failed: Failed to send the message af
ter 3 attempts (ZW0202)
2022-03-07 08:10:28.005 ERROR ZWAVE: Failed to send the message after 3 attempts (ZW0202)
2022-03-07T07:10:28.005Z CNTRLR » [Node 117] requesting node neighbors...
2022-03-07T07:10:28.008Z CNTRLR Failed to execute controller command after 1/3 attempts. Scheduling next try i
n 100 ms.
2022-03-07T07:10:28.110Z CNTRLR Failed to execute controller command after 2/3 attempts. Scheduling next try i
n 1100 ms.
2022-03-07T07:10:29.211Z CNTRLR [Node 117] requesting the node neighbors failed: Failed to send the message af
ter 3 attempts (ZW0202)
2022-03-07 08:10:29.212 ERROR ZWAVE: Failed to send the message after 3 attempts (ZW0202)
2022-03-07T07:10:29.212Z CNTRLR » [Node 118] requesting node neighbors...
2022-03-07T07:10:29.214Z CNTRLR Failed to execute controller command after 1/3 attempts. Scheduling next try i
n 100 ms.
2022-03-07T07:10:29.315Z CNTRLR Failed to execute controller command after 2/3 attempts. Scheduling next try i
n 1100 ms.
2022-03-07T07:10:30.417Z CNTRLR [Node 118] requesting the node neighbors failed: Failed to send the message af
ter 3 attempts (ZW0202)
2022-03-07 08:10:30.418 ERROR ZWAVE: Failed to send the message after 3 attempts (ZW0202)
2022-03-07T07:10:30.418Z CNTRLR » [Node 119] requesting node neighbors...
2022-03-07T07:10:30.420Z CNTRLR Failed to execute controller command after 1/3 attempts. Scheduling next try i
n 100 ms.
2022-03-07T07:10:30.521Z CNTRLR Failed to execute controller command after 2/3 attempts. Scheduling next try i
n 1100 ms.
2022-03-07T07:10:31.624Z CNTRLR [Node 119] requesting the node neighbors failed: Failed to send the message af
ter 3 attempts (ZW0202)
2022-03-07 08:10:31.624 ERROR ZWAVE: Failed to send the message after 3 attempts (ZW0202)
2022-03-07T07:10:31.625Z CNTRLR » [Node 121] requesting node neighbors...
2022-03-07T07:10:31.627Z CNTRLR Failed to execute controller command after 1/3 attempts. Scheduling next try i
n 100 ms.
2022-03-07T07:10:31.728Z CNTRLR Failed to execute controller command after 2/3 attempts. Scheduling next try i
n 1100 ms.
2022-03-07T07:10:32.830Z CNTRLR [Node 121] requesting the node neighbors failed: Failed to send the message af
ter 3 attempts (ZW0202)
2022-03-07 08:10:32.832 ERROR ZWAVE: Failed to send the message after 3 attempts (ZW0202)
2022-03-07T07:10:32.832Z CNTRLR » [Node 122] requesting node neighbors...
2022-03-07T07:10:32.835Z CNTRLR Failed to execute controller command after 1/3 attempts. Scheduling next try i
n 100 ms.
2022-03-07T07:10:32.936Z CNTRLR Failed to execute controller command after 2/3 attempts. Scheduling next try i
n 1100 ms.
2022-03-07T07:10:34.040Z CNTRLR [Node 122] requesting the node neighbors failed: Failed to send the message af
ter 3 attempts (ZW0202)
2022-03-07 08:10:34.040 ERROR ZWAVE: Failed to send the message after 3 attempts (ZW0202)
2022-03-07T07:10:34.040Z CNTRLR » [Node 123] requesting node neighbors...
2022-03-07T07:10:34.043Z CNTRLR Failed to execute controller command after 1/3 attempts. Scheduling next try i
n 100 ms.
2022-03-07T07:10:34.144Z CNTRLR Failed to execute controller command after 2/3 attempts. Scheduling next try i
n 1100 ms.
2022-03-07T07:10:35.246Z CNTRLR [Node 123] requesting the node neighbors failed: Failed to send the message af
ter 3 attempts (ZW0202)
2022-03-07 08:10:35.247 ERROR ZWAVE: Failed to send the message after 3 attempts (ZW0202)
2022-03-07T07:10:35.247Z CNTRLR » [Node 124] requesting node neighbors...
2022-03-07T07:10:35.249Z CNTRLR Failed to execute controller command after 1/3 attempts. Scheduling next try i
n 100 ms.
2022-03-07T07:10:35.351Z CNTRLR Failed to execute controller command after 2/3 attempts. Scheduling next try i
n 1100 ms.
2022-03-07T07:10:36.452Z CNTRLR [Node 124] requesting the node neighbors failed: Failed to send the message af
ter 3 attempts (ZW0202)
2022-03-07 08:10:36.452 ERROR ZWAVE: Failed to send the message after 3 attempts (ZW0202)
2022-03-07T07:10:36.453Z CNTRLR » [Node 126] requesting node neighbors...
2022-03-07T07:10:36.458Z CNTRLR Failed to execute controller command after 1/3 attempts. Scheduling next try i
n 100 ms.
2022-03-07T07:10:36.560Z CNTRLR Failed to execute controller command after 2/3 attempts. Scheduling next try i
n 1100 ms.
2022-03-07T07:10:37.663Z CNTRLR [Node 126] requesting the node neighbors failed: Failed to send the message af
ter 3 attempts (ZW0202)
2022-03-07 08:10:37.663 ERROR ZWAVE: Failed to send the message after 3 attempts (ZW0202)
2022-03-07T07:10:37.664Z CNTRLR » [Node 127] requesting node neighbors...
2022-03-07T07:10:37.666Z CNTRLR Failed to execute controller command after 1/3 attempts. Scheduling next try i
n 100 ms.
2022-03-07T07:10:37.767Z CNTRLR Failed to execute controller command after 2/3 attempts. Scheduling next try i
n 1100 ms.
2022-03-07T07:10:38.869Z CNTRLR [Node 127] requesting the node neighbors failed: Failed to send the message af
ter 3 attempts (ZW0202)
2022-03-07 08:10:38.870 ERROR ZWAVE: Failed to send the message after 3 attempts (ZW0202)
2022-03-07T07:10:38.870Z CNTRLR » [Node 133] requesting node neighbors...
2022-03-07T07:10:38.873Z CNTRLR Failed to execute controller command after 1/3 attempts. Scheduling next try i
n 100 ms.
2022-03-07T07:10:38.974Z CNTRLR Failed to execute controller command after 2/3 attempts. Scheduling next try i
n 1100 ms.
2022-03-07T07:10:40.076Z CNTRLR [Node 133] requesting the node neighbors failed: Failed to send the message af
ter 3 attempts (ZW0202)
2022-03-07 08:10:40.076 ERROR ZWAVE: Failed to send the message after 3 attempts (ZW0202)
2022-03-07T07:10:40.076Z CNTRLR » [Node 134] requesting node neighbors...
2022-03-07T07:10:40.079Z CNTRLR Failed to execute controller command after 1/3 attempts. Scheduling next try i
n 100 ms.
2022-03-07T07:10:40.180Z CNTRLR Failed to execute controller command after 2/3 attempts. Scheduling next try i
n 1100 ms.
2022-03-07T07:10:41.282Z CNTRLR [Node 134] requesting the node neighbors failed: Failed to send the message af
ter 3 attempts (ZW0202)
2022-03-07 08:10:41.282 ERROR ZWAVE: Failed to send the message after 3 attempts (ZW0202)
2022-03-07T07:10:41.283Z CNTRLR » [Node 135] requesting node neighbors...
2022-03-07T07:10:41.285Z CNTRLR Failed to execute controller command after 1/3 attempts. Scheduling next try i
n 100 ms.
2022-03-07T07:10:41.386Z CNTRLR Failed to execute controller command after 2/3 attempts. Scheduling next try i
n 1100 ms.
2022-03-07T07:10:42.488Z CNTRLR [Node 135] requesting the node neighbors failed: Failed to send the message af
ter 3 attempts (ZW0202)
2022-03-07 08:10:42.488 ERROR ZWAVE: Failed to send the message after 3 attempts (ZW0202)
2022-03-07T07:10:42.488Z CNTRLR » [Node 136] requesting node neighbors...
2022-03-07T07:10:42.491Z CNTRLR Failed to execute controller command after 1/3 attempts. Scheduling next try i
n 100 ms.
2022-03-07T07:10:42.592Z CNTRLR Failed to execute controller command after 2/3 attempts. Scheduling next try i
n 1100 ms.
2022-03-07T07:10:43.694Z CNTRLR [Node 136] requesting the node neighbors failed: Failed to send the message af
ter 3 attempts (ZW0202)
2022-03-07 08:10:43.695 ERROR ZWAVE: Failed to send the message after 3 attempts (ZW0202)
2022-03-07T07:10:43.695Z CNTRLR » [Node 137] requesting node neighbors...
2022-03-07T07:10:43.697Z CNTRLR Failed to execute controller command after 1/3 attempts. Scheduling next try i
n 100 ms.
2022-03-07T07:10:43.797Z CNTRLR Failed to execute controller command after 2/3 attempts. Scheduling next try i
n 1100 ms.
2022-03-07T07:10:44.900Z CNTRLR [Node 137] requesting the node neighbors failed: Failed to send the message af
ter 3 attempts (ZW0202)
2022-03-07 08:10:44.900 ERROR ZWAVE: Failed to send the message after 3 attempts (ZW0202)
2022-03-07T07:10:44.901Z CNTRLR » [Node 138] requesting node neighbors...
2022-03-07T07:10:44.903Z CNTRLR Failed to execute controller command after 1/3 attempts. Scheduling next try i
n 100 ms.
2022-03-07T07:10:45.003Z CNTRLR Failed to execute controller command after 2/3 attempts. Scheduling next try i
n 1100 ms.
2022-03-07T07:10:46.106Z CNTRLR [Node 138] requesting the node neighbors failed: Failed to send the message af
ter 3 attempts (ZW0202)
2022-03-07 08:10:46.107 ERROR ZWAVE: Failed to send the message after 3 attempts (ZW0202)
2022-03-07T07:10:46.107Z CNTRLR » [Node 139] requesting node neighbors...
2022-03-07T07:10:46.113Z CNTRLR Failed to execute controller command after 1/3 attempts. Scheduling next try i
n 100 ms.
2022-03-07T07:10:46.213Z CNTRLR Failed to execute controller command after 2/3 attempts. Scheduling next try i
n 1100 ms.
2022-03-07T07:10:47.315Z CNTRLR [Node 139] requesting the node neighbors failed: Failed to send the message af
ter 3 attempts (ZW0202)
2022-03-07 08:10:47.316 ERROR ZWAVE: Failed to send the message after 3 attempts (ZW0202)
2022-03-07T07:10:47.316Z CNTRLR » [Node 140] requesting node neighbors...
2022-03-07T07:10:47.318Z CNTRLR Failed to execute controller command after 1/3 attempts. Scheduling next try i
n 100 ms.
2022-03-07T07:10:47.422Z CNTRLR Failed to execute controller command after 2/3 attempts. Scheduling next try i
n 1100 ms.
2022-03-07T07:10:48.524Z CNTRLR [Node 140] requesting the node neighbors failed: Failed to send the message af
ter 3 attempts (ZW0202)
2022-03-07 08:10:48.525 ERROR ZWAVE: Failed to send the message after 3 attempts (ZW0202)
2022-03-07T07:10:48.525Z CNTRLR » [Node 141] requesting node neighbors...
2022-03-07T07:10:48.528Z CNTRLR Failed to execute controller command after 1/3 attempts. Scheduling next try i
n 100 ms.
2022-03-07T07:10:48.629Z CNTRLR Failed to execute controller command after 2/3 attempts. Scheduling next try i
n 1100 ms.
2022-03-07T07:10:49.731Z CNTRLR [Node 141] requesting the node neighbors failed: Failed to send the message af
ter 3 attempts (ZW0202)
2022-03-07 08:10:49.731 ERROR ZWAVE: Failed to send the message after 3 attempts (ZW0202)
2022-03-07T07:10:49.734Z CNTRLR » [Node 142] requesting node neighbors...
2022-03-07T07:10:49.737Z CNTRLR Failed to execute controller command after 1/3 attempts. Scheduling next try i
n 100 ms.
2022-03-07T07:10:49.837Z CNTRLR Failed to execute controller command after 2/3 attempts. Scheduling next try i
n 1100 ms.
2022-03-07T07:10:50.939Z CNTRLR [Node 142] requesting the node neighbors failed: Failed to send the message af
ter 3 attempts (ZW0202)
2022-03-07 08:10:50.940 ERROR ZWAVE: Failed to send the message after 3 attempts (ZW0202)
2022-03-07T07:10:50.940Z CNTRLR » [Node 143] requesting node neighbors...
2022-03-07T07:10:50.943Z CNTRLR Failed to execute controller command after 1/3 attempts. Scheduling next try i
n 100 ms.
2022-03-07T07:10:51.044Z CNTRLR Failed to execute controller command after 2/3 attempts. Scheduling next try i
n 1100 ms.
2022-03-07T07:10:52.146Z CNTRLR [Node 143] requesting the node neighbors failed: Failed to send the message af
ter 3 attempts (ZW0202)
2022-03-07 08:10:52.146 ERROR ZWAVE: Failed to send the message after 3 attempts (ZW0202)
2022-03-07T07:10:52.149Z CNTRLR » [Node 144] requesting node neighbors...
2022-03-07T07:10:52.153Z CNTRLR Failed to execute controller command after 1/3 attempts. Scheduling next try i
n 100 ms.
2022-03-07T07:10:52.254Z CNTRLR Failed to execute controller command after 2/3 attempts. Scheduling next try i
n 1100 ms.
2022-03-07T07:10:53.356Z CNTRLR [Node 144] requesting the node neighbors failed: Failed to send the message af
ter 3 attempts (ZW0202)
2022-03-07 08:10:53.357 ERROR ZWAVE: Failed to send the message after 3 attempts (ZW0202)
2022-03-07T07:10:53.357Z CNTRLR » [Node 145] requesting node neighbors...
2022-03-07T07:10:53.359Z CNTRLR Failed to execute controller command after 1/3 attempts. Scheduling next try i
n 100 ms.
2022-03-07T07:10:53.461Z CNTRLR Failed to execute controller command after 2/3 attempts. Scheduling next try i
n 1100 ms.
2022-03-07T07:10:54.562Z CNTRLR [Node 145] requesting the node neighbors failed: Failed to send the message af
ter 3 attempts (ZW0202)
2022-03-07 08:10:54.563 ERROR ZWAVE: Failed to send the message after 3 attempts (ZW0202)
2022-03-07T07:10:54.563Z CNTRLR » [Node 147] requesting node neighbors...
2022-03-07T07:10:54.566Z CNTRLR Failed to execute controller command after 1/3 attempts. Scheduling next try i
n 100 ms.
2022-03-07T07:10:54.667Z CNTRLR Failed to execute controller command after 2/3 attempts. Scheduling next try i
n 1100 ms.
2022-03-07T07:10:55.769Z CNTRLR [Node 147] requesting the node neighbors failed: Failed to send the message af
ter 3 attempts (ZW0202)
2022-03-07 08:10:55.770 ERROR ZWAVE: Failed to send the message after 3 attempts (ZW0202)
2022-03-07T07:10:55.770Z CNTRLR » [Node 148] requesting node neighbors...
2022-03-07T07:10:55.772Z CNTRLR Failed to execute controller command after 1/3 attempts. Scheduling next try i
n 100 ms.
2022-03-07T07:10:55.873Z CNTRLR Failed to execute controller command after 2/3 attempts. Scheduling next try i
n 1100 ms.
2022-03-07T07:10:56.975Z CNTRLR [Node 148] requesting the node neighbors failed: Failed to send the message af
ter 3 attempts (ZW0202)
2022-03-07 08:10:56.976 ERROR ZWAVE: Failed to send the message after 3 attempts (ZW0202)
2022-03-07T07:10:56.976Z CNTRLR » [Node 149] requesting node neighbors...
2022-03-07T07:10:56.978Z CNTRLR Failed to execute controller command after 1/3 attempts. Scheduling next try i
n 100 ms.
2022-03-07T07:10:57.079Z CNTRLR Failed to execute controller command after 2/3 attempts. Scheduling next try i
n 1100 ms.
2022-03-07T07:10:58.183Z CNTRLR [Node 149] requesting the node neighbors failed: Failed to send the message af
ter 3 attempts (ZW0202)
2022-03-07 08:10:58.184 ERROR ZWAVE: Failed to send the message after 3 attempts (ZW0202)
2022-03-07T07:10:58.184Z CNTRLR » [Node 150] requesting node neighbors...
2022-03-07T07:10:58.186Z CNTRLR Failed to execute controller command after 1/3 attempts. Scheduling next try i
n 100 ms.
2022-03-07T07:10:58.287Z CNTRLR Failed to execute controller command after 2/3 attempts. Scheduling next try i
n 1100 ms.
2022-03-07 08:10:58.589 INFO APP: GET /health/zwave 200 0.551 ms - 1873
2022-03-07T07:10:59.388Z CNTRLR [Node 150] requesting the node neighbors failed: Failed to send the message af
ter 3 attempts (ZW0202)
2022-03-07 08:10:59.388 ERROR ZWAVE: Failed to send the message after 3 attempts (ZW0202)
2022-03-07T07:10:59.388Z CNTRLR » [Node 153] requesting node neighbors...
2022-03-07T07:10:59.391Z CNTRLR Failed to execute controller command after 1/3 attempts. Scheduling next try i
n 100 ms.
2022-03-07T07:10:59.492Z CNTRLR Failed to execute controller command after 2/3 attempts. Scheduling next try i
n 1100 ms.
2022-03-07T07:11:00.593Z CNTRLR [Node 153] requesting the node neighbors failed: Failed to send the message af
ter 3 attempts (ZW0202)
2022-03-07 08:11:00.593 ERROR ZWAVE: Failed to send the message after 3 attempts (ZW0202)
2022-03-07T07:11:00.594Z CNTRLR » [Node 154] requesting node neighbors...
2022-03-07T07:11:00.596Z CNTRLR Failed to execute controller command after 1/3 attempts. Scheduling next try i
n 100 ms.
2022-03-07T07:11:00.697Z CNTRLR Failed to execute controller command after 2/3 attempts. Scheduling next try i
n 1100 ms.
2022-03-07T07:11:01.798Z CNTRLR [Node 154] requesting the node neighbors failed: Failed to send the message af
ter 3 attempts (ZW0202)
2022-03-07 08:11:01.799 ERROR ZWAVE: Failed to send the message after 3 attempts (ZW0202)
2022-03-07T07:11:01.799Z CNTRLR » [Node 155] requesting node neighbors...
2022-03-07T07:11:01.801Z CNTRLR Failed to execute controller command after 1/3 attempts. Scheduling next try i
n 100 ms.
2022-03-07T07:11:01.902Z CNTRLR Failed to execute controller command after 2/3 attempts. Scheduling next try i
n 1100 ms.
2022-03-07T07:11:03.004Z CNTRLR [Node 155] requesting the node neighbors failed: Failed to send the message af
ter 3 attempts (ZW0202)
2022-03-07 08:11:03.004 ERROR ZWAVE: Failed to send the message after 3 attempts (ZW0202)
2022-03-07T07:11:03.005Z CNTRLR » [Node 156] requesting node neighbors...
2022-03-07T07:11:03.007Z CNTRLR Failed to execute controller command after 1/3 attempts. Scheduling next try i
n 100 ms.
2022-03-07T07:11:03.108Z CNTRLR Failed to execute controller command after 2/3 attempts. Scheduling next try i
n 1100 ms.
2022-03-07T07:11:04.209Z CNTRLR [Node 156] requesting the node neighbors failed: Failed to send the message af
ter 3 attempts (ZW0202)
2022-03-07 08:11:04.209 ERROR ZWAVE: Failed to send the message after 3 attempts (ZW0202)
2022-03-07T07:11:04.209Z CNTRLR » [Node 157] requesting node neighbors...
2022-03-07T07:11:04.213Z CNTRLR Failed to execute controller command after 1/3 attempts. Scheduling next try i
n 100 ms.
2022-03-07T07:11:04.314Z CNTRLR Failed to execute controller command after 2/3 attempts. Scheduling next try i
n 1100 ms.
2022-03-07T07:11:05.416Z CNTRLR [Node 157] requesting the node neighbors failed: Failed to send the message af
ter 3 attempts (ZW0202)
2022-03-07 08:11:05.417 ERROR ZWAVE: Failed to send the message after 3 attempts (ZW0202)
2022-03-07T07:11:05.417Z CNTRLR » [Node 158] requesting node neighbors...
2022-03-07T07:11:05.419Z CNTRLR Failed to execute controller command after 1/3 attempts. Scheduling next try i
n 100 ms.
2022-03-07T07:11:05.520Z CNTRLR Failed to execute controller command after 2/3 attempts. Scheduling next try i
n 1100 ms.
2022-03-07T07:11:06.624Z CNTRLR [Node 158] requesting the node neighbors failed: Failed to send the message af
ter 3 attempts (ZW0202)
2022-03-07 08:11:06.624 ERROR ZWAVE: Failed to send the message after 3 attempts (ZW0202)
2022-03-07T07:11:06.624Z CNTRLR » [Node 159] requesting node neighbors...
2022-03-07T07:11:06.627Z CNTRLR Failed to execute controller command after 1/3 attempts. Scheduling next try i
n 100 ms.
2022-03-07T07:11:06.728Z CNTRLR Failed to execute controller command after 2/3 attempts. Scheduling next try i
n 1100 ms.
2022-03-07T07:11:07.828Z CNTRLR [Node 159] requesting the node neighbors failed: Failed to send the message af
ter 3 attempts (ZW0202)
2022-03-07 08:11:07.829 ERROR ZWAVE: Failed to send the message after 3 attempts (ZW0202)
2022-03-07T07:11:07.829Z CNTRLR » [Node 160] requesting node neighbors...
2022-03-07T07:11:07.831Z CNTRLR Failed to execute controller command after 1/3 attempts. Scheduling next try i
n 100 ms.
2022-03-07T07:11:07.931Z CNTRLR Failed to execute controller command after 2/3 attempts. Scheduling next try i
n 1100 ms.
2022-03-07T07:11:09.033Z CNTRLR [Node 160] requesting the node neighbors failed: Failed to send the message af
ter 3 attempts (ZW0202)
2022-03-07 08:11:09.033 ERROR ZWAVE: Failed to send the message after 3 attempts (ZW0202)
2022-03-07T07:11:09.033Z CNTRLR » [Node 161] requesting node neighbors...
2022-03-07T07:11:09.036Z CNTRLR Failed to execute controller command after 1/3 attempts. Scheduling next try i
n 100 ms.
2022-03-07T07:11:09.136Z CNTRLR Failed to execute controller command after 2/3 attempts. Scheduling next try i
n 1100 ms.
2022-03-07T07:11:10.236Z CNTRLR [Node 161] requesting the node neighbors failed: Failed to send the message af
ter 3 attempts (ZW0202)
2022-03-07 08:11:10.237 ERROR ZWAVE: Failed to send the message after 3 attempts (ZW0202)
2022-03-07T07:11:10.237Z CNTRLR » [Node 162] requesting node neighbors...
2022-03-07T07:11:10.239Z CNTRLR Failed to execute controller command after 1/3 attempts. Scheduling next try i
n 100 ms.
2022-03-07T07:11:10.340Z CNTRLR Failed to execute controller command after 2/3 attempts. Scheduling next try i
n 1100 ms.
2022-03-07T07:11:11.442Z CNTRLR [Node 162] requesting the node neighbors failed: Failed to send the message af
ter 3 attempts (ZW0202)
2022-03-07 08:11:11.442 ERROR ZWAVE: Failed to send the message after 3 attempts (ZW0202)
2022-03-07T07:11:11.442Z CNTRLR » [Node 167] requesting node neighbors...
2022-03-07T07:11:11.445Z CNTRLR Failed to execute controller command after 1/3 attempts. Scheduling next try i
n 100 ms.
2022-03-07T07:11:11.545Z CNTRLR Failed to execute controller command after 2/3 attempts. Scheduling next try i
n 1100 ms.
2022-03-07T07:11:12.647Z CNTRLR [Node 167] requesting the node neighbors failed: Failed to send the message af
ter 3 attempts (ZW0202)
2022-03-07 08:11:12.647 ERROR ZWAVE: Failed to send the message after 3 attempts (ZW0202)
2022-03-07T07:11:12.648Z CNTRLR » [Node 168] requesting node neighbors...
2022-03-07T07:11:12.650Z CNTRLR Failed to execute controller command after 1/3 attempts. Scheduling next try i
n 100 ms.
2022-03-07T07:11:12.750Z CNTRLR Failed to execute controller command after 2/3 attempts. Scheduling next try i
n 1100 ms.
2022-03-07T07:11:13.852Z CNTRLR [Node 168] requesting the node neighbors failed: Failed to send the message af
ter 3 attempts (ZW0202)
2022-03-07 08:11:13.853 ERROR ZWAVE: Failed to send the message after 3 attempts (ZW0202)
2022-03-07T07:11:13.854Z CNTRLR » [Node 169] requesting node neighbors...
2022-03-07T07:11:13.857Z CNTRLR Failed to execute controller command after 1/3 attempts. Scheduling next try i
n 100 ms.
2022-03-07T07:11:13.957Z CNTRLR Failed to execute controller command after 2/3 attempts. Scheduling next try i
n 1100 ms.
2022-03-07T07:11:15.058Z CNTRLR [Node 169] requesting the node neighbors failed: Failed to send the message af
ter 3 attempts (ZW0202)
2022-03-07 08:11:15.058 ERROR ZWAVE: Failed to send the message after 3 attempts (ZW0202)
2022-03-07T07:11:15.058Z CNTRLR » [Node 170] requesting node neighbors...
2022-03-07T07:11:15.066Z CNTRLR Failed to execute controller command after 1/3 attempts. Scheduling next try i
n 100 ms.
2022-03-07T07:11:15.166Z CNTRLR Failed to execute controller command after 2/3 attempts. Scheduling next try i
n 1100 ms.
2022-03-07T07:11:16.267Z CNTRLR [Node 170] requesting the node neighbors failed: Failed to send the message af
ter 3 attempts (ZW0202)
2022-03-07 08:11:16.268 ERROR ZWAVE: Failed to send the message after 3 attempts (ZW0202)
2022-03-07T07:11:16.268Z CNTRLR Turning RF on...
2022-03-07T07:11:16.270Z CNTRLR Failed to execute controller command after 1/3 attempts. Scheduling next try i
n 100 ms.
2022-03-07T07:11:16.371Z CNTRLR Failed to execute controller command after 2/3 attempts. Scheduling next try i
n 1100 ms.
2022-03-07T07:11:17.473Z CNTRLR Error turning RF on: Failed to send the message after 3 attempts (ZW0202)
2022-03-07 08:11:17.474 INFO ZWAVE: Success zwave api call refreshNeighbors {
'1': [ [length]: 0 ],
'6': [ [length]: 0 ],
'7': [ [length]: 0 ],
'8': [ [length]: 0 ],
'9': [ [length]: 0 ],
'10': [ [length]: 0 ],
'11': [ [length]: 0 ],
'12': [ [length]: 0 ],
'13': [ [length]: 0 ],
'14': [ [length]: 0 ],
'15': [ [length]: 0 ],
'18': [ [length]: 0 ],
'19': [ [length]: 0 ],
'20': [ [length]: 0 ],
'22': [ [length]: 0 ],
'23': [ [length]: 0 ],
'24': [ [length]: 0 ],
'25': [ [length]: 0 ],
'26': [ [length]: 0 ],
'27': [ [length]: 0 ],
'28': [ [length]: 0 ],
'29': [ [length]: 0 ],
'30': [ [length]: 0 ],
'31': [ [length]: 0 ],
'32': [ [length]: 0 ],
'33': [ [length]: 0 ],
'34': [ [length]: 0 ],
'35': [ [length]: 0 ],
'36': [ [length]: 0 ],
'37': [ [length]: 0 ],
'38': [ [length]: 0 ],
'41': [ [length]: 0 ],
'42': [ [length]: 0 ],
'43': [ [length]: 0 ],
'44': [ [length]: 0 ],
'45': [ [length]: 0 ],
'46': [ [length]: 0 ],
'47': [ [length]: 0 ],
'49': [ [length]: 0 ],
'50': [ [length]: 0 ],
'51': [ [length]: 0 ],
'52': [ [length]: 0 ],
'57': [ [length]: 0 ],
'60': [ [length]: 0 ],
'62': [ [length]: 0 ],
'64': [ [length]: 0 ],
'68': [ [length]: 0 ],
'69': [ [length]: 0 ],
'70': [ [length]: 0 ],
'72': [ [length]: 0 ],
'73': [ [length]: 0 ],
'74': [ [length]: 0 ],
'75': [ [length]: 0 ],
'76': [ [length]: 0 ],
'77': [ [length]: 0 ],
'78': [ [length]: 0 ],
'79': [ [length]: 0 ],
'81': [ [length]: 0 ],
'82': [ [length]: 0 ],
'83': [ [length]: 0 ],
'84': [ [length]: 0 ],
'85': [ [length]: 0 ],
'86': [ [length]: 0 ],
'87': [ [length]: 0 ],
'88': [ [length]: 0 ],
'89': [ [length]: 0 ],
'90': [ [length]: 0 ],
'92': [ [length]: 0 ],
'93': [ [length]: 0 ],
'94': [ [length]: 0 ],
'95': [ [length]: 0 ],
'97': [ [length]: 0 ],
'99': [ [length]: 0 ],
'100': [ [length]: 0 ],
'101': [ [length]: 0 ],
'102': [ [length]: 0 ],
'103': [ [length]: 0 ],
'105': [ [length]: 0 ],
'106': [ [length]: 0 ],
'109': [ [length]: 0 ],
'111': [ [length]: 0 ],
'113': [ [length]: 0 ],
'114': [ [length]: 0 ],
'115': [ [length]: 0 ],
'117': [ [length]: 0 ],
'118': [ [length]: 0 ],
'119': [ [length]: 0 ],
'121': [ [length]: 0 ],
'122': [ [length]: 0 ],
'123': [ [length]: 0 ],
'124': [ [length]: 0 ],
'126': [ [length]: 0 ],
'127': [ [length]: 0 ],
'133': [ [length]: 0 ],
'134': [ [length]: 0 ],
'135': [ [length]: 0 ],
'136': [ [length]: 0 ],
'137': [ [length]: 0 ],
'138': [ [length]: 0 ],
'139': [ [length]: 0 ],
'140': [ [length]: 0 ],
'141': [ [length]: 0 ],
'142': [ [length]: 0 ],
'143': [ [length]: 0 ],
'144': [ [length]: 0 ],
'145': [ [length]: 0 ],
'147': [ [length]: 0 ],
'148': [ [length]: 0 ],
'149': [ [length]: 0 ],
'150': [ [length]: 0 ],
'153': [ [length]: 0 ],
'154': [ [length]: 0 ],
'155': [ [length]: 0 ],
'156': [ [length]: 0 ],
'157': [ [length]: 0 ],
'158': [ [length]: 0 ],
'159': [ [length]: 0 ],
'160': [ [length]: 0 ],
'161': [ [length]: 0 ],
'162': [ [length]: 0 ],
'167': [ [length]: 0 ],
'168': [ [length]: 0 ],
'169': [ [length]: 0 ],
'170': [ [length]: 0 ]
}
2022-03-07 08:12:58.593 INFO APP: GET /health/zwave 200 0.635 ms - 1873
2022-03-07 08:14:58.598 INFO APP: GET /health/zwave 200 0.564 ms - 1873
2022-03-07 08:16:58.603 INFO APP: GET /health/zwave 200 0.472 ms - 1873
2022-03-07T07:18:21.939Z CNTRLR Failed to execute controller command after 1/3 attempts. Scheduling next try i
n 100 ms.
2022-03-07T07:18:22.041Z CNTRLR Failed to execute controller command after 2/3 attempts. Scheduling next try i
n 1100 ms.
2022-03-07T07:18:23.142Z CNTRLR [Node 095] did not respond after 1/3 attempts. Scheduling next try in 500 ms.
2022-03-07T07:18:23.643Z CNTRLR Failed to execute controller command after 1/3 attempts. Scheduling next try i
n 100 ms.
2022-03-07T07:18:23.745Z CNTRLR Failed to execute controller command after 2/3 attempts. Scheduling next try i
n 1100 ms.
2022-03-07T07:18:24.846Z CNTRLR [Node 095] did not respond after 2/3 attempts. Scheduling next try in 500 ms.
2022-03-07T07:18:25.348Z CNTRLR Failed to execute controller command after 1/3 attempts. Scheduling next try i
n 100 ms.
2022-03-07T07:18:25.451Z CNTRLR Failed to execute controller command after 2/3 attempts. Scheduling next try i
n 1100 ms.
2022-03-07 08:18:26.554 ERROR ZWAVE-SERVER: Failed to send the message after 3 attempts (ZW0202)
ZWaveError: Failed to send the message after 3 attempts (ZW0202)
at Driver.sendMessage (/opt/node_modules/zwave-js/src/lib/driver/Driver.ts:3390:23)
at Driver.sendCommand (/opt/node_modules/zwave-js/src/lib/driver/Driver.ts:3567:28)
at Driver.trySendCommandSupervised (/opt/node_modules/zwave-js/src/lib/driver/Driver.ts:3662:15)
at MultilevelSwitchCCAPI.set (/opt/node_modules/zwave-js/src/lib/commandclass/MultilevelSwitchCC.ts:173:47)
at Proxy.MultilevelSwitchCCAPI.<computed> (/opt/node_modules/zwave-js/src/lib/commandclass/MultilevelSwitchCC.ts:323:33)
at ZWaveNode.setValue (/opt/node_modules/zwave-js/src/lib/node/Node.ts:867:14)
at Function.handle (/opt/node_modules/@zwave-js/server/dist/lib/node/message_handler.js:23:44)
at Object.node (/opt/node_modules/@zwave-js/server/dist/lib/server.js:39:91)
at Client.receiveMessage (/opt/node_modules/@zwave-js/server/dist/lib/server.js:95:99)
at WebSocket.<anonymous> (/opt/node_modules/@zwave-js/server/dist/lib/server.js:48:45)

What kind of ZWave controller stick are you using?

Try to disconnect Zwave stick from HA physically for 10 seconds. Sometimes controller also need sort of soft-restart as well… Restarting the HA instance itself does not affect controller. I had such case few times with Aeotec Gen 5 in the past.

I had about the same in the past with Zigbee.
I turned to be bad connection in USB dongle.
Used contact spray and cleaning connection did fix the problem

Appreciate all comment on this issue!

The Zwave controller is Aeotec gen5.

After restarting HA in Proxmox, the system have now been stable for last 1-2 hours.
From log, I can see z-Wave JS have start optimize network (healing network).
I have not request it, is it a self-repair action from JS ? Due to heling network, some device respond late (1-2 sec), that’s is expected.

If I lost connection with device, I will try as Mirek Malinowski mention; take out controller for some time and try age.

Yes, you did…

It may not be finished - an entire network can take a day to finish - especially if you have a lot of battery devices… Mine takes at LEAST 18 hrs, so I never run a heal entire network…

Hehe, okay. I might. I had the understanding that’s it was already don by HA UI. (not Z-wave JS).

Anyhow, the controller lost connection again to the nodes.
ERROR ZWAVE: Failed to send the message after 3 attempts (ZW0202) …

Try as you mention, everything start up and running smooth (as normal when rebooting vm). Its start all over again with healing network…

From what I can understand, its look like its’s stop in the middle of the process. No more logging from JS. It’s seem to be “dead” and not responding.
I have 124 device on z-wave network, a lot is battery devices…

I have made a new windows and can follow the process during work. Just wondering why it’s hang/stop responding/dead and what to do next. Most likely is the optimize network casing the problem, but its not good when its stop responding…

Have another z-wave controller available, but there is lack of good information regarding transferring nodes between controller…

Then the heal is going to take forever, even if it does finish. Battery devices have to wake up before they can respond to a heal and depending on their config, this could take a while. I agree the UI for Z-Wave JS is lacking. The Z-Wave to MQTT is better but that’s a decision you have to make up front. I wish I had. In the absence of a good UI, you can look at the Z-Wave JS logs. There you can see the heal messages and when devices respond.

As a first step I would look at all the powered devices and try to find out if they are all responding and try to get a picture of how the mesh is built. If a number of the battery devices were routing through a now dead powered node then that would cause a significant problem. You can also manually wake up the battery devices. Don’t assume that a node is OK just because the local control works OK. Over the past 5 years I have had a couple of Z-wave modules where local control worked fine but the radio side had died.

Last thing. I would not expect a different controller to have better reliability results. With Z-Wave it’s a mesh and the controller is just one device that joins the mesh. If you don’t have a string mesh then any controller will have issues.

The controller stop healing network and lost communication with nodes again.
If i turning on a light, i get his form log:

2022-03-07T12:29:47.159Z CNTRLR Failed to execute controller command after 1/3 attempts. Scheduling next try i
n 100 ms.
2022-03-07T12:29:47.260Z CNTRLR Failed to execute controller command after 2/3 attempts. Scheduling next try i
n 1100 ms.
2022-03-07T12:29:48.362Z CNTRLR [Node 018] did not respond after 1/3 attempts. Scheduling next try in 500 ms.
2022-03-07T12:29:48.863Z CNTRLR Failed to execute controller command after 1/3 attempts. Scheduling next try i
n 100 ms.
2022-03-07T12:29:48.963Z CNTRLR Failed to execute controller command after 2/3 attempts. Scheduling next try i
n 1100 ms.
2022-03-07T12:29:50.065Z CNTRLR [Node 018] did not respond after 2/3 attempts. Scheduling next try in 500 ms.
2022-03-07T12:29:50.567Z CNTRLR Failed to execute controller command after 1/3 attempts. Scheduling next try i
n 100 ms.
2022-03-07T12:29:50.668Z CNTRLR Failed to execute controller command after 2/3 attempts. Scheduling next try i
n 1100 ms.
2022-03-07 13:29:51.770 ERROR ZWAVE-SERVER: Failed to send the message after 3 attempts (ZW0202)
ZWaveError: Failed to send the message after 3 attempts (ZW0202)
at Driver.sendMessage (/opt/node_modules/zwave-js/src/lib/driver/Driver.ts:3390:23)
at Driver.sendCommand (/opt/node_modules/zwave-js/src/lib/driver/Driver.ts:3567:28)
at Driver.trySendCommandSupervised (/opt/node_modules/zwave-js/src/lib/driver/Driver.ts:3662:15)
at MultilevelSwitchCCAPI.set (/opt/node_modules/zwave-js/src/lib/commandclass/MultilevelSwitchCC.ts:173:47)
at Proxy.MultilevelSwitchCCAPI.<computed> (/opt/node_modules/zwave-js/src/lib/commandclass/MultilevelSwitchCC.ts:323:33)
at ZWaveNode.setValue (/opt/node_modules/zwave-js/src/lib/node/Node.ts:867:14)
at Function.handle (/opt/node_modules/@zwave-js/server/dist/lib/node/message_handler.js:23:44)
at Object.node (/opt/node_modules/@zwave-js/server/dist/lib/server.js:39:91)
at Client.receiveMessage (/opt/node_modules/@zwave-js/server/dist/lib/server.js:95:99)
at WebSocket.<anonymous> (/opt/node_modules/@zwave-js/server/dist/lib/server.js:48:45)

The problem is the controller lost communication with all nodes. Nothing working, but the controller is not dead. Its pushing out “INFO APP: GET /health/zwave 200…” message now and then.

To get the nodes alive, I need to restart system. I was planning to let it run so it could complete the most of healing process, but that’s processes seem to me has stop.

Its not a good way to troubleshoot.
The huge mistake I have done, is not to run “healing network” now and then, so new device can take advantage of each other and make a mesh with sense. Now have a lot of device been added and they respond or late.

Hi There,

I have the same issue… After upgrading to 2022.3.2…

ERROR ZWAVE: Failed to send the message after 3 attempts (ZW0202)

I also have / run the Aeotec Gen 5 USB dongle…

Before never had issues with the ZWAVE network… now after few hours running HA… ZWAVE stops working…

Reboot the entire system and everything runs again… till a few hours and same issue appears…

ERROR ZWAVE: Failed to send the message after 3 attempts (ZW0202)

From stable HA to … no more stable HA in a few minutes upgrading…

I’m Glad you mentioned this issue cause i knew i could not be the only one out there experiencing this.

Latest HA.
Latest ZWAVE MQTT

Hope someone can fix this cause this is NOT workable…

Greetz Alex

Not sure what’s made the actual result. Now its working and stable for 4 hours.

Remove the USB stick and connect it up with laptop and took backup from Aeotec tool. (Just to be sure…)
Connected backup to HA and restart Z-wave JS to MQTT.
I have to see during evening and night, if everything is ok.

If Alexander de Boer had same issue after updating, it’s might be something there….

Let me know if you have it working or not… This afternoon i rebooted at 15:00 and now at 19:30 same errors appear…

Just rebooted again… removed extra USB cable…
You start trying everyting to get it stable once more…

That doesn’t mean the controller is not sick, GET messages are web requests that the App is serving (it even says APP in capital letters). The message has nothing to do with the connected controller.

Mine has been playing up since I updated LAST MONTH, I haven’t even updated to the latest version yet. Sometimes it runs for days, and sometimes it runs for less than an hour. Checking the log shows that it doesn’t matter how many times I try and turn something on or off, there are no messages appearing in the log to suggest it will even attempt to perform the action.

So you are saying that suddenly all our Aeotec Gen 5 USB dongles are dying on us this month?

Now that you mention, have rebooted my system cause of ZWAVE error last month but that was once i beleave… But now every few hours?

So far i have never seen this issue with HA and my ZWAVE equipment.

Not necessarily dying no - we need to find a pattern.
For example - who has updated the Firmware in the Gen5 stick? I haven’t got round to it yet - so it’s still what it shipped with I think (hang on let me check)

Firmware 1.0 according to Home Assistant.

I keep meaning to update it, but I haven’t got round to it yet (if it’s not broke etc). So who HAS updated?

How can I check it? and how can I update it?

Found it… i have Firmware: 1.1

Aeotec Z-Stick Gen5 Firmware 1.1 connected via USB extension lead to USB2 port on Raspberry Pi4 2Gb
OS loaded on 64Gb USB stick
core-2022.2.5
supervisor-2022.01.1
Home Assistant OS 7.4
J-Wave JS 0.1.54

Last reboot February 11th

Its fuckt. Working good for 6 hours, after that, its has been a nightmare. Need to restart proxmox and Z-wave JS to MQTT module.
Aeotec Z-Stick Gen5 Firmware 4.54

Do you have the Aeotec connected to a hub and is it powered?

Aeotec is connected to a Lenovo ThinkCenter thats run proxmox.
Version : core-2022.2.9
Operating System Family Linux
Operating System Version 5.10.98
Host Operating System: Home Assistant OS 7.4
Supervisor Version: supervisor-2022.01.1
Docker Version 20.10.9
Disk Total: 99.3 GB
Disk Used 10.8 GB
Installed Add-ons
Z-Wave JS to MQTT (0.35.2), Studio Code Server (4.1.0), Node-RED (11.0.3), File editor (5.3.3), AppDaemon 4 (0.8.1), Samba share (9.5.1), Terminal & SSH (9.3.0), Home Assistant Google Drive Backup (0.105.2), Duck DNS (1.14.0), Dnsmasq (1.4.4), Mosquitto broker (6.0.1)