Huge aeotec usb gen 5 issues

MarkR · January 1, 2018, 5:52pm

Hello

I’ve been having problems when i reboot HA that Z-wave stops or behaves very strangely, i.e won’t loads etc. So I have just reset the whole z-wave equipment. I excluded each device and then factory reset the stick by pressing the reset button for 20 seconds and it indicated it worked. So I plug back in and HA finds the stick again, 1 more reboot… it vanishes… same as it used to. This is the OZW log file… anyone have any idea please? it has a line og NULLS as well

2018-01-01 17:45:43.038 Always, OpenZwave Version 1.4.2586 Starting Up
2018-01-01 17:45:50.338 Info, Setting Up Provided Network Key for Secure Communications
2018-01-01 17:45:50.338 Info, mgr,     Added driver for controller /dev/zwave
2018-01-01 17:45:50.338 Info,   Opening controller /dev/zwave
2018-01-01 17:45:50.338 Info, Trying to open serial port /dev/zwave (attempt 1)
2018-01-01 17:45:50.343 Info, Serial port /dev/zwave opened (attempt 1)
2018-01-01 17:45:50.343 Detail, contrlr, Queuing (Command) FUNC_ID_ZW_GET_VERSION: 0x01, 0x03, 0x00, 0x15, 0xe9
2018-01-01 17:45:50.343 Detail, contrlr, Queuing (Command) FUNC_ID_ZW_MEMORY_GET_ID: 0x01, 0x03, 0x00, 0x20, 0xdc
2018-01-01 17:45:50.343 Detail, contrlr, Queuing (Command) FUNC_ID_ZW_GET_CONTROLLER_CAPABILITIES: 0x01, 0x03, 0x00, 0x05, 0xf9
2018-01-01 17:45:50.343 Detail, contrlr, Queuing (Command) FUNC_ID_SERIAL_API_GET_CAPABILITIES: 0x01, 0x03, 0x00, 0x07, 0xfb
2018-01-01 17:45:50.343 Detail, contrlr, Queuing (Command) FUNC_ID_ZW_GET_SUC_NODE_ID: 0x01, 0x03, 0x00, 0x56, 0xaa
2018-01-01 17:45:50.343 Detail, 
2018-01-01 17:45:50.343 Info, contrlr, Sending (Command) message (Callback ID=0x00, Expected Reply=0x15) - FUNC_ID_ZW_GET_VERSION: 0x01, 0x03, 0x00, 0x15, 0xe9
2018-01-01 17:45:50.348 Detail, contrlr,   Received: 0x01, 0x10, 0x01, 0x15, 0x5a, 0x2d, 0x57, 0x61, 0x76, 0x65, 0x20, 0x33, 0x2e, 0x39, 0x35, 0x00, 0x01, 0x99
2018-01-01 17:45:50.348 Detail, 
2018-01-01 17:45:50.348 Info, contrlr, Received reply to FUNC_ID_ZW_GET_VERSION:
2018-01-01 17:45:50.348 Info, contrlr,     Static Controller library, version Z-Wave 3.95
2018-01-01 17:45:50.348 Detail, Node045,   Expected reply was received
2018-01-01 17:45:50.348 Detail, Node045,   Message transaction complete
2018-01-01 17:45:50.348 Detail, 
2018-01-01 17:45:50.348 Detail, contrlr, Removing current message
2018-01-01 17:45:50.349 Detail, 
2018-01-01 17:45:50.349 Info, contrlr, Sending (Command) message (Callback ID=0x00, Expected Reply=0x20) - FUNC_ID_ZW_MEMORY_GET_ID: 0x01, 0x03, 0x00, 0x20, 0xdc
2018-01-01 17:45:50.352 Detail, Unsolicited message received while waiting for ACK.
2018-01-01 17:45:50.354 Detail, contrlr,   Received: 0x01, 0x08, 0x01, 0x20, 0xd8, 0x04, 0x85, 0xeb, 0x01, 0x01
2018-01-01 17:45:50.354 Warning, contrlr, WARNING: Checksum incorrect - sending NAK
2018-01-01 17:45:50.356 Detail, Unsolicited message received while waiting for ACK.
2018-01-01 17:45:50.356 Detail, contrlr,   Received: 0x01, 0x08, 0x01, 0x20, 0xd8, 0x04, 0x85, 0xeb, 0x01, 0x65
2018-01-01 17:45:50.356 Detail, 
2018-01-01 17:45:50.356 Info, contrlr, Received reply to FUNC_ID_ZW_MEMORY_GET_ID. Home ID = 0xd80485eb.  Our node ID = 1
2018-01-01 17:45:50.356 Detail, Node004,   Expected reply was received
2018-01-01 17:45:50.356 Detail, Node004,   Message transaction complete
2018-01-01 17:45:50.356 Detail, 
2018-01-01 17:45:50.356 Detail, contrlr, Removing current message
2018-01-01 17:45:50.356 Detail, 
2018-01-01 17:45:50.356 Info, contrlr, Sending (Command) message (Callback ID=0x00, Expected Reply=0x05) - FUNC_ID_ZW_GET_CONTROLLER_CAPABILITIES: 0x01, 0x03, 0x00, 0x05, 0xf9
2018-01-01 17:45:50.360 Warning, WARNING: Out of frame flow! (0x04).  Sending NAK.
2018-01-01 17:45:51.361 Error, contrlr, ERROR: Dropping command, expected response not received after 1 attempt(s)
2018-01-01 17:45:51.361 Detail, contrlr, Removing current message
2018-01-01 17:45:51.361 Detail, contrlr, Notification: Notification - TimeOut
2018-01-01 17:45:51.363 Detail, 
2018-01-01 17:45:51.363 Info, contrlr, Sending (Command) message (Callback ID=0x00, Expected Reply=0x07) - FUNC_ID_SERIAL_API_GET_CAPABILITIES: 0x01, 0x03, 0x00, 0x07, 0xfb
2018-01-01 17:45:51.365 Detail, Unsolicited message received while waiting for ACK.
2018-01-01 17:45:51.374 Detail, contrlr,   Received: 0x01, 0x2b, 0x01, 0x07, 0x01, 0x00, 0x00, 0x86, 0x00, 0x01, 0x00, 0x5a, 0xfe, 0x81, 0xff, 0x88, 0x01, 0x2b, 0x01, 0x07, 0x01, 0x00, 0x00, 0x86, 0x00, 0x01, 0x00, 0x5a, 0xfe, 0x81, 0xff, 0x01, 0x2b, 0x01, 0x07, 0x01, 0x00, 0x00, 0x86, 0x00, 0x01, 0x00, 0x5a, 0xfe, 0x01
2018-01-01 17:45:51.374 Warning, contrlr, WARNING: Checksum incorrect - sending NAK
2018-01-01 17:45:51.376 Warning, WARNING: Out of frame flow! (0x00).  Sending NAK.
2018-01-01 17:45:52.376 Error, contrlr, ERROR: Dropping command, expected response not received after 1 attempt(s)
2018-01-01 17:45:52.376 Detail, contrlr, Removing current message
2018-01-01 17:45:52.376 Detail, contrlr, Notification: Notification - TimeOut
2018-01-01 17:45:52.378 Detail, 
2018-01-01 17:45:52.378 Info, contrlr, Sending (Command) message (Callback ID=0x00, Expected Reply=0x56) - FUNC_ID_ZW_GET_SUC_NODE_ID: 0x01, 0x03, 0x00, 0x56, 0xaa
2018-01-01 17:45:53.379 Error, contrlr, ERROR: Dropping command, expected response not received after 1 attempt(s)
2018-01-01 17:45:53.379 Detail, contrlr, Removing current message
2018-01-01 17:45:53.379 Detail, contrlr, Notification: Notification - TimeOut
                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                       2018-01-01 17:45:50.346 Warning, WARNING: Out of frame flow! (0x61).  Sending NAK.
2018-01-01 17:45:50.351 Detail,   Received: 0x01, 0x10, 0x01, 0x15, 0x5a, 0x2d, 0x57, 0x06, 0x01, 0x08, 0x01, 0x20, 0xd8, 0x04, 0x85, 0xeb, 0x01, 0x65
2018-01-01 17:45:50.351 Warning, WARNING: Checksum incorrect - sending NAK
2018-01-01 17:45:50.353 Warning, WARNING: Out of frame flow! (0x65).  Sending NAK.
2018-01-01 17:45:50.855 Warning, WARNING: 500ms passed without reading the rest of the frame...aborting frame read
2018-01-01 17:45:50.855 Detail,   Received: 0x01, 0x01, 0x04
2018-01-01 17:45:50.855 Warning, WARNING: Checksum incorrect - sending NAK
2018-01-01 17:45:50.857 Detail,   Received: 0x01, 0x04, 0x01, 0x05, 0x28, 0xd7
2018-01-01 17:45:50.858 Detail, 
2018-01-01 17:45:50.858 Info, Received reply to FUNC_ID_ZW_GET_CONTROLLER_CAPABILITIES:
2018-01-01 17:45:50.858 Info,     There is no SUC ID Server (SIS) in this network.
2018-01-01 17:45:50.858 Info,     The PC controller is a primary controller.
2018-01-01 17:45:51.366 Warning, WARNING: Out of frame flow! (0x4f).  Sending NAK.
2018-01-01 17:45:51.368 Warning, WARNING: Out of frame flow! (0x00).  Sending NAK.
2018-01-01 17:45:51.369 Warning, WARNING: Out of frame flow! (0x88).  Sending NAK.
2018-01-01 17:45:51.370 Warning, WARNING: Out of frame flow! (0x00).  Sending NAK.
2018-01-01 17:45:51.372 Warning, WARNING: Out of frame flow! (0x81).  Sending NAK.
2018-01-01 17:45:51.373 Warning, WARNING: Out of frame flow! (0x80).  Sending NAK.
2018-01-01 17:45:51.375 Detail,   Received: 0x01, 0x00
2018-01-01 17:45:51.375 Warning, WARNING: Checksum incorrect - sending NAK
2018-01-01 17:45:51.377 Warning, WARNING: Out of frame flow! (0x00).  Sending NAK.
2018-01-01 17:45:52.380 Detail,   Received: 0x01, 0x04, 0x01, 0x56, 0x00, 0xac
2018-01-01 17:45:52.380 Detail, 
2018-01-01 17:45:52.380 Info, Received reply to GET_SUC_NODE_ID.  Node ID = 0
2018-01-01 17:45:52.380 Info, Controller Does not Support SUC - Cannot Setup Controller as SUC Node

kirichkov · January 2, 2018, 6:42am

This usually means your z-wave coverage is insufficient and there’s a problem communicating with your devices. Try moving your devices closer to the hub where the z-wave stick is, or adding repeater devices between the failing device and the z-wave stick.

MarkR · January 2, 2018, 7:37am

thanks, but this is even when the stick has been reset to default and has nothing connected to it yet.

MarkR · January 2, 2018, 8:38am

I got it to work by resetting again, rebooting etc. So then I reboot again or restart HA and it has gone and the these errors have happened.

2018-01-02 08:29:46.048 Info, contrlr, Received reply to GET_SUC_NODE_ID.  Node ID = 0
2018-01-02 08:29:46.048 Info, Controller Does not Support SUC - Cannot Setup Controller as SUC Node
2018-01-02 08:29:46.048 Detail, Node172,   Expected reply was received
2018-01-02 08:29:46.048 Detail, Node172,   Message transaction complete
2018-01-02 08:29:46.048 Detail, 
2018-01-02 08:29:46.048 Detail, contrlr, Removing current message
                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                     2018-01-02 08:29:33.035 Detail,   Received: 0x01, 0x10, 0x01, 0x15, 0x5a, 0x2d, 0x57, 0x61, 0x76, 0x65, 0x20, 0x33, 0x2e, 0x39, 0x35, 0x00, 0x01, 0x99
2018-01-02 08:29:33.035 Detail, 
2018-01-02 08:29:33.035 Info, Received reply to FUNC_ID_ZW_GET_VERSION:
2018-01-02 08:29:33.035 Info,     Static Controller library, version Z-Wave 3.95
2018-01-02 08:29:34.041 Detail,   Received: 0x01, 0x08, 0x01, 0x20, 0xe2, 0x09, 0x19, 0x38, 0x01, 0x1d
2018-01-02 08:29:34.041 Detail, 
2018-01-02 08:29:34.041 Info, Received reply to FUNC_ID_ZW_MEMORY_GET_ID. Home ID = 0xe2091938.  Our node ID = 1
2018-01-02 08:29:35.043 Detail,   Received: 0x01, 0x04, 0x01, 0x05, 0x28, 0xd7
2018-01-02 08:29:35.043 Detail, 
2018-01-02 08:29:35.043 Info, Received reply to FUNC_ID_ZW_GET_CONTROLLER_CAPABILITIES:
2018-01-02 08:29:35.043 Info,     There is no SUC ID Server (SIS) in this network.
2018-01-02 08:29:35.043 Info,     The PC controller is a primary controller.
2018-01-02 08:29:36.045 Warning, WARNING: Out of frame flow! (0x00).  Sending NAK.
2018-01-02 08:29:36.046 Warning, WARNING: Out of frame flow! (0x00).  Sending NAK.
2018-01-02 08:29:36.048 Warning, WARNING: Out of frame flow! (0x00).  Sending NAK.

Any ideas please? has my stick gone to z wave heaven?

MarkR · January 2, 2018, 1:12pm

ok so I am getting pig sick now. I have fully reset everything yet again and no joy. So nothing has been included in the mesh, just the stick

I currently have the aeotec usb stick gen5 in the PC and it is detected by HA as Node 1, no manufacturers details loaded yet. So I did a heal as described in the docs, nothing… so restart HA from inside HA, zwave controller vanishes. 2x full system reboots later, it is back… as Node 1 and no other details loaded and the zwcfg_xml keeps getting over written with a blank one.

help please?

Cheers
Mark

Tinkerer · January 2, 2018, 1:20pm

It sounds like it could be a faulty stick.

MarkR · January 2, 2018, 3:32pm

Can this thread be deleted please? I am such an idiot (I must say that 20 times a day). I upgraded to 0.60 in a new docker… thought I had deleted it, but I had just stopped it, so when I restarted the PC, it started, so I had 2 instances of HA trying to use the USB stick… I wanted to reset my z-wave and mesh anyway, but this was several hours wasted for no reason, troubleshooting something that should have been needed

I need a drink

matust · January 2, 2018, 11:36pm

I had a similar issue using mosquitto. Two ha instances using the same username so I would only get some mqtt messages and it drove me crazy trouble shooting trying to find the issue. I was ready to throw it in the bin and when I found the issue it was a real duh I’m an idiot moment

anderson110 · January 9, 2018, 6:42pm

Yes, the “out of frame flow” errors have nothing to do with zwave radio communications, range, etc.

It means the local comm to the serial port is very confused, and the most likely culprit is two programs both trying to read from the same device, each getting only partial information.

Don’t delete, this is important information and you will definitely not be the only one to run into this!

mconnolly · April 29, 2019, 12:52am

I hate to dig up an ancient thread but I think I’m having the same exact issue. Same Aeotec stick, similar issues upon restarting HA. About 40% of the time I get the same error messages about “out of frame flow” and it usually requires I restore to a recent snapshot to get it back up and running. I’m run-ing Hassio in Docker on Ubuntu. Is there a way to identify what other program might be trying to read from the Aeotec stick so I can address it?

Thanks in advance…

gerdesj · May 21, 2019, 5:00pm

lsof (List Open Files) should help here. You could try something like:

# lsof /dev/ttyACM0

wrkn · May 25, 2019, 1:32am

Also having the same problem for a while now. I have major HA restart anxiety. There is something about Ubuntu/Docker/Hass.io combination that is causing this to happen, but I don’t know how to debug it. Here’s what I know:

I get the same behavior with Aeotec and Zooz sticks, so it’s not the controller hardware.
Thought maybe my powered USB hub was bad, because when I removed it and plugged the stick directly into my NUC, I had several solid restarts in a row with no errors in the OZW log. Turns out, that was just coincidence. A week later with the next HA update, I was back to flaky startups.
Made sure the stick is in my always-on USB port (yellow one on the NUC), no difference.
One clue is that Hass.io allows all docker containers access to the USB ports. Maybe an addon with serial connectivity (e.g. Node-RED) was misbehaving? I disabled all my addons except for HA and the supervisor. Same flakiness. And I don’t have any non-Hassio containers running on this machine.
Looked at lsof output but didn’t see anything strange.

So far, evidence suggests to me that the Hassio supervisor and/or HA is getting in the way of OZW USB access during the start sequence. Did you ever figure anything out?

Also, a pro-tip, you don’t have to restore everything from snapshot if OZW hoses your device configs after a bad startup/shutdown. I’ve found that just replacing the zwcfg XML file with the last good backup is a much less disruptive step. Keep in mind this only works when HA is stopped, since OZW overwrites this XML file during shutdown. So, stop HA, replace the zwcfg file, and start HA again (with fingers crossed).

Tinkerer · May 25, 2019, 10:48am

Over on the Discord server I’ve seen similar reports on and off for the last year or so. There’s been nothing solid, nothing to point a finger at, just that Hass.io users are more likely to have a problem like this.

mconnolly · May 26, 2019, 6:16pm

Thanks for the detailed reply. What you’re describing is exactly what I’m experiencing – definitely agree there’s something up with the Hass.io-Docker-Ubuntu combo. I actually got so frustrated I bought a Vera Plus on a whim and migrated all my z-wave devices over to it and connect it to HA with the Vera component. While it’s relieved my HA restart anxiety entirely, the Vera has some shortcomings of its own (seemingly limited device support, mostly) and I’d probably want to go back to a Z-stick solution at some point.

wrkn · February 8, 2020, 9:05pm

Following up here in case others are still stuck with flakiness. I’ve 100% resolved my Zwave startup reliability issues on NUC/Docker/Hass.io setup by disabling & removing ModemManager. See https://www.home-assistant.io/hassio/installation/#debianubuntu