Z-wave nodes disappeared after upgrade

[backisen (Andreas Back)]

After update from raspbian + home assistant to the latest hass.io (0.95.4) most of my z-wave nodes disappeared. There is only 3 nodes remaining; the Razzberry controller and two Fibaro smoke detectors. The log files (both home assistant and z-wave) outputs a lot of errors. I have tried integreating the z-wave controller again from the config menu but with no luch. Same errors persist.

home-assistant.log:

2019-07-13 15:20:18 WARNING (MainThread) [homeassistant.loader] You are using a custom integration for volkswagen_carnet which has not been tested by Home Assistant. This component might cause stability problems, be sure to disable it if you do experience issues with Home Assistant.
2019-07-13 15:20:19 WARNING (MainThread) [homeassistant.components.http] Configuring api_password via the http component has been deprecated. Use the legacy api password auth provider instead. For instructions, see https://www.home-assistant.io/docs/authentication/providers/#legacy-api-password
2019-07-13 15:20:19 WARNING (MainThread) [homeassistant.components.http.auth] legacy_api_password support has been enabled.
2019-07-13 15:20:25 WARNING (SyncWorker_11) [custom_components.volkswagen_carnet] Could not login to carnet
2019-07-13 15:20:26 WARNING (SyncWorker_11) [custom_components.volkswagen_carnet] Could not login to carnet
2019-07-13 15:20:30 WARNING (MainThread) [homeassistant.setup] Setup of group is taking over 10 seconds.
2019-07-13 15:20:31 WARNING (MainThread) [homeassistant.setup] Setup of google is taking over 10 seconds.
2019-07-13 15:20:32 WARNING (MainThread) [homeassistant.loader] You are using a custom integration for krisinformation which has not been tested by Home Assistant. This component might cause stability problems, be sure to disable it if you do experience issues with Home Assistant.
2019-07-13 15:20:32 WARNING (MainThread) [homeassistant.loader] You are using a custom integration for kodi_recently_added which has not been tested by Home Assistant. This component might cause stability problems, be sure to disable it if you do experience issues with Home Assistant.
2019-07-13 15:20:35 WARNING (MainThread) [homeassistant.components.kodi.media_player] TransportError trying to run API method None.VideoLibrary.GetRecentlyAddedEpisodes({'properties': ['art', 'dateadded', 'episode', 'fanart', 'firstaired', 'playcount', 'rating', 'runtime', 'season', 'showtitle', 'title']})
2019-07-13 15:20:35 WARNING (MainThread) [homeassistant.components.kodi.media_player] TransportError trying to run API method None.VideoLibrary.GetRecentlyAddedMovies({'properties': ['art', 'dateadded', 'genre', 'playcount', 'premiered', 'rating', 'runtime', 'studio', 'title']})
2019-07-13 15:20:35 ERROR (MainThread) [homeassistant.core] Error doing job: Task exception was never retrieved
Traceback (most recent call last):
  File "/usr/src/homeassistant/homeassistant/helpers/entity_platform.py", line 357, in _async_add_entity
    raise HomeAssistantError(msg)
homeassistant.exceptions.HomeAssistantError: Entity id already exists: calendar.contacts
2019-07-13 15:20:39 WARNING (MainThread) [homeassistant.components.binary_sensor] Setup of platform ping is taking over 10 seconds.
2019-07-13 15:21:06 WARNING (MainThread) [homeassistant.components.kodi.media_player] TransportError trying to run API method None.VideoLibrary.GetRecentlyAddedEpisodes({'properties': ['art', 'dateadded', 'episode', 'fanart', 'firstaired', 'playcount', 'rating', 'runtime', 'season', 'showtitle', 'title']})
2019-07-13 15:21:06 WARNING (MainThread) [homeassistant.components.kodi.media_player] TransportError trying to run API method None.VideoLibrary.GetRecentlyAddedMovies({'properties': ['art', 'dateadded', 'genre', 'playcount', 'premiered', 'rating', 'runtime', 'studio', 'title']})
2019-07-13 15:21:23 WARNING (MainThread) [homeassistant.components.zwave] Z-Wave node 8 not ready after 30 seconds, continuing anyway
2019-07-13 15:21:23 WARNING (MainThread) [homeassistant.components.zwave] Z-Wave entity Unknown Node 8 Level (node_id: 8) not ready after 30 seconds, continuing anyway
2019-07-13 15:21:23 WARNING (MainThread) [homeassistant.components.zwave] Z-Wave node 9 not ready after 30 seconds, continuing anyway
2019-07-13 15:21:23 WARNING (MainThread) [homeassistant.components.zwave] Z-Wave entity Unknown Node 9 Level (node_id: 9) not ready after 30 seconds, continuing anyway
2019-07-13 15:21:23 WARNING (MainThread) [homeassistant.components.zwave] Z-Wave node 15 not ready after 30 seconds, continuing anyway
2019-07-13 15:21:23 WARNING (MainThread) [homeassistant.components.zwave] Z-Wave entity Unknown Node 15 Switch (node_id: 15) not ready after 30 seconds, continuing anyway
2019-07-13 15:21:23 WARNING (MainThread) [homeassistant.components.zwave] Z-Wave node 18 not ready after 30 seconds, continuing anyway
2019-07-13 15:21:23 WARNING (MainThread) [homeassistant.components.zwave] Z-Wave entity Unknown Node 18 Level (node_id: 18) not ready after 30 seconds, continuing anyway
2019-07-13 15:21:23 WARNING (MainThread) [homeassistant.components.zwave] Z-Wave node 21 not ready after 30 seconds, continuing anyway
2019-07-13 15:21:23 WARNING (MainThread) [homeassistant.components.zwave] Z-Wave entity Unknown Node 21 Switch (node_id: 21) not ready after 30 seconds, continuing anyway
2019-07-13 15:21:23 WARNING (MainThread) [homeassistant.components.zwave] Z-Wave node 22 not ready after 30 seconds, continuing anyway
2019-07-13 15:21:23 WARNING (MainThread) [homeassistant.components.zwave] Z-Wave entity Unknown Node 22 Switch (node_id: 22) not ready after 30 seconds, continuing anyway
2019-07-13 15:21:23 WARNING (MainThread) [homeassistant.components.zwave] Z-Wave node 23 not ready after 30 seconds, continuing anyway
2019-07-13 15:21:23 WARNING (MainThread) [homeassistant.components.zwave] Z-Wave entity Unknown Node 23 Switch (node_id: 23) not ready after 30 seconds, continuing anyway
2019-07-13 15:21:23 WARNING (MainThread) [homeassistant.components.zwave] Z-Wave node 24 not ready after 30 seconds, continuing anyway
2019-07-13 15:21:23 WARNING (MainThread) [homeassistant.components.zwave] Z-Wave entity Unknown Node 24 Switch (node_id: 24) not ready after 30 seconds, continuing anyway
2019-07-13 15:21:26 WARNING (MainThread) [homeassistant.components.zwave] Z-Wave node 27 not ready after 30 seconds, continuing anyway
2019-07-13 15:21:26 WARNING (MainThread) [homeassistant.components.zwave] Z-Wave entity Unknown Node 27 Level (node_id: 27) not ready after 30 seconds, continuing anyway
2019-07-13 15:21:26 WARNING (MainThread) [homeassistant.components.zwave] Z-Wave node 29 not ready after 30 seconds, continuing anyway
2019-07-13 15:21:26 WARNING (MainThread) [homeassistant.components.zwave] Z-Wave entity Unknown Node 29 Switch (node_id: 29) not ready after 30 seconds, continuing anyway
2019-07-13 15:21:26 WARNING (MainThread) [homeassistant.components.zwave] Z-Wave node 30 not ready after 30 seconds, continuing anyway
2019-07-13 15:21:26 WARNING (MainThread) [homeassistant.components.zwave] Z-Wave node 31 not ready after 30 seconds, continuing anyway
2019-07-13 15:21:26 WARNING (MainThread) [homeassistant.components.zwave] Z-Wave entity Unknown Node 31 Switch (node_id: 31) not ready after 30 seconds, continuing anyway
2019-07-13 15:21:26 WARNING (MainThread) [homeassistant.components.zwave] Z-Wave node 32 not ready after 30 seconds, continuing anyway
2019-07-13 15:21:38 WARNING (MainThread) [homeassistant.components.kodi.media_player] TransportError trying to run API method None.VideoLibrary.GetRecentlyAddedEpisodes({'properties': ['art', 'dateadded', 'episode', 'fanart', 'firstaired', 'playcount', 'rating', 'runtime', 'season', 'showtitle', 'title']})
2019-07-13 15:21:38 WARNING (MainThread) [homeassistant.components.kodi.media_player] TransportError trying to run API method None.VideoLibrary.GetRecentlyAddedMovies({'properties': ['art', 'dateadded', 'genre', 'playcount', 'premiered', 'rating', 'runtime', 'studio', 'title']})
2019-07-13 15:22:10 WARNING (MainThread) [homeassistant.components.kodi.media_player] TransportError trying to run API method None.VideoLibrary.GetRecentlyAddedMovies({'properties': ['art', 'dateadded', 'genre', 'playcount', 'premiered', 'rating', 'runtime', 'studio', 'title']})
2019-07-13 15:22:10 WARNING (MainThread) [homeassistant.components.kodi.media_player] TransportError trying to run API method None.VideoLibrary.GetRecentlyAddedEpisodes({'properties': ['art', 'dateadded', 'episode', 'fanart', 'firstaired', 'playcount', 'rating', 'runtime', 'season', 'showtitle', 'title']})
2019-07-13 15:22:41 WARNING (MainThread) [homeassistant.components.kodi.media_player] TransportError trying to run API method None.VideoLibrary.GetRecentlyAddedEpisodes({'properties': ['art', 'dateadded', 'episode', 'fanart', 'firstaired', 'playcount', 'rating', 'runtime', 'season', 'showtitle', 'title']})
2019-07-13 15:22:41 WARNING (MainThread) [homeassistant.components.kodi.media_player] TransportError trying to run API method None.VideoLibrary.GetRecentlyAddedMovies({'properties': ['art', 'dateadded', 'genre', 'playcount', 'premiered', 'rating', 'runtime', 'studio', 'title']})
2019-07-13 15:23:12 WARNING (MainThread) [homeassistant.components.kodi.media_player] TransportError trying to run API method None.VideoLibrary.GetRecentlyAddedMovies({'properties': ['art', 'dateadded', 'genre', 'playcount', 'premiered', 'rating', 'runtime', 'studio', 'title']})
2019-07-13 15:23:12 WARNING (MainThread) [homeassistant.components.kodi.media_player] TransportError trying to run API method None.VideoLibrary.GetRecentlyAddedEpisodes({'properties': ['art', 'dateadded', 'episode', 'fanart', 'firstaired', 'playcount', 'rating', 'runtime', 'season', 'showtitle', 'title']})

z-wave log:
https://paste.ubuntu.com/p/rWqc5zmrfN/

I would gladly appreciate if someone could help me with this.

[walrus_parka]

What version of Home Assistant were you running before switching?

[backisen (Andreas Back)]

I think it was 0.89.x.

[walrus_parka]

When I moved from raspbian to docker I had a similar issue. It culminated in deleting zwave references in the main config yaml and adding zwave as an integration.

Was your home assistant zwave config under the integrations menu or referenced in your config?

Make sure to backup!!!

[backisen (Andreas Back)]

It was in config before but that didn’t work after upgrade. So I tried deleting it from there and adding it from integrations instead, but same result.

I’m thinking it might have something to do with network key. I had no key in config but it seems one was created when creating the integration. Can this cause the problem? And if so, how can it be solved?

I have everything backed up, so no worries

[walrus_parka]

If you didn’t have a network key before, then the devices could not be added as a secure device. I don’t think that would be causing the issue, but not willing to put money on it.

It’s still a pretty decent jump from 89 to 95. I would almost try a new database with default_config to see it does anything different.

[Akriss (kris)]

This post may shed some light on “network key” confusion.

Setting the network key for secure devices

If you setup configuration.yaml originally without a network_key, a random one would have been generated for you. Once the key is generated, it cannot be changed unless you delete the integration from the UI. Setting it in configuration.yaml after already configuring it will have no effect, only the usb_path will override the integration value. If you look in the file .storage/core.config_entries you will probably see an network key that does not match the one you are using.

Hope it’s of help.

[backisen (Andreas Back)]

What do you mean by new database and default_config?

The nodes are not added as secure nodes so the network key might not be the problem, but I will look into it.

[backisen (Andreas Back)]

I have looked into this now. In my old backuped config, from when z-wave was working, network_key was “null”. In the new config there is a network_key.

Not sure what to do with this information?

[walrus_parka]

Did some google-fu and found a similar situation on github, maybe it can be of use. Mentions deleting a couple of the .core files and letting HA read the zwave stick again.

Z-wave nodes does not load in 0.87