2021.9.0: More energy, USB discovery, template ❤️

[multia (PVH)]

I’m running supervised on rp4b-8G on Ubuntu 21.04 (with nothing else), and with core 2021.9.[2,3] , the homeassistant container stays up for only about 15 minutes and then just quits without any error. I tried to restart it a few times (ha core start), which brings it back, but not for long. Reverting to 2021.8.8 made it stable again.

ha core update --version 2021.8.8

don’t mind the custom_component loglines, that’s some custom fiddled component, that I’m running for ages, so it’s no error indication.

pvh@rp4:~$ docker logs -f homeassistant
...
2021-09-05 00:06:44 DEBUG (MainThread) [custom_components.tasmota_zigbee] Updating subdevice [wleak_veranda] sensor [Endpoint] to value [1] entity [sensor.tzb_wleak_veranda_Endpoint]
2021-09-05 00:06:44 DEBUG (MainThread) [custom_components.tasmota_zigbee] Updating subdevice [wleak_veranda] sensor [LinkQuality] to value [89] entity [sensor.tzb_wleak_veranda_LinkQuality]
[cont-finish.d] executing container finish scripts...
[cont-finish.d] done.
[s6-finish] waiting for services.
[s6-finish] sending all processes the TERM signal.
[s6-finish] sending all processes the KILL signal and exiting.
pvh@rp4:~$ 

[multia (PVH)]

I’m sorry I don’t have a solution, but a question. This is so beautiful, what did you draw that with ?

[jivesinger]

Same, numbers are back !!
Thanks for the walkthrough

[claudiovillani58]

Hello after updating Home Assistant already from version 2021.9.1, but also going with version 2021.9.2 and 2021.9.3 the “device tracker” function that works on the IP address and MAC address of my and my wife’s mobile phones and that it let you know when you and / or I were in the house that everything was working and that if we both left the house it allowed the automatic shutdown of all the lights in the house and when one of the two or both returned home it automatically turned on two lights as an entrance and salon, it no longer works !!! In order for everything to work again I had to go back to version 2021.8.8

Could you check if in the new versions of Home Assistant any changes have caused errors that make the device traker function no longer work?

Thanks for the attention

[francisp (Francis)]

Ubuntu has not been supported for over a year. Maybe time to switch to the supported Debian ?

[francisp (Francis)]

@claudiovillani58

the “device tracker” function that works on the IP address and MAC address

If you are talking about the nmap tracker, yes, a new one has been created and the old one no longer works. It was in the release notes. Just update ‘person’ to use the new one.

[claudiovillani58]

Thank You Francis, Can you help me or direct what to do or read the info you told me to find?

[francisp (Francis)]

configuration → people

[maxym]

In case this question has been missed by the one you has the anwer

@maxym

@system

Home Assistant can now discover USB devices and the integrations that work with that device.

I’m curious how does it work if more integrations can use the USB device. Will connecting Conbee2 result in choice between zha and z2m? If I already use z2m, will it still still offer zha?

[claudiovillani58]

Thank you Francis
Best Regard
Claudio

[stephack]

Zha is the only officially supported zigbee integration so it will be the only option presented by default.

[maxym]

I though, that addons are also official.
Anyway, I’m mostly interested if this option can be somehow hidden if I decide to use another integration

[stephack]

Probably going to use bad terminology here but hopefully you get the gist of it.
Zha is the only officially supported direct integration (addons are just that…addons…usually docker containers that extend functionality of the core HAOS). The z2m addons is not listed as an official addon either. The fact that it requires you to manually add an outside repository to install it, should reinforce this. Hopefully this helps clarify.

[yousaf465]

I had similar problem Unable to access lovelace after upgrade to 2021.9.x
ha core info revealed wrong ip

➜  ~ ha core info                                                               arch: armv7
audio_input: None
audio_output: None
boot: true
image: ghcr.io/home-assistant/raspberrypi4-homeassistant
ip_address: 172.30.32.1
last_version: 2021.9.3
machine: raspberrypi4
port: 8123
ssl: false
update_available: false
version: 2021.9.3
version_latest: 2021.9.3
wait_boot: 600
watchdog: true
➜  ~

ha core check

command completed successfully

ha core logs revealed following

~ ha core logs   
[s6-init] making user provided files available at /var/run/s6/etc...exited 0.
[s6-init] ensuring user provided files have correct perms...exited 0.
[fix-attrs.d] applying ownership & permissions fixes...
[fix-attrs.d] done.
[cont-init.d] executing container initialization scripts...
[cont-init.d] done.
[services.d] starting services
[services.d] done.
2021-09-05 19:43:52 WARNING (SyncWorker_0) [homeassistant.loader] We found a custom integration huawei_solar which has not been tested by Home Assistant. This component might cause stability problems, be sure to disable it if you experience issues with Home Assistant
2021-09-05 19:43:52 WARNING (SyncWorker_1) [homeassistant.loader] We found a custom integration tplink_router which has not been tested by Home Assistant. This component might cause stability problems, be sure to disable it if you experience issues with Home Assistant
2021-09-05 19:43:52 ERROR (SyncWorker_1) [homeassistant.loader] The custom integration 'tplink_router' does not have a valid version key (None) in the manifest file and was blocked from loading. See https://developers.home-assistant.io/blog/2021/01/29/custom-integration-changes#versions for more details
2021-09-05 19:43:52 WARNING (SyncWorker_0) [homeassistant.loader] We found a custom integration scheduler which has not been tested by Home Assistant. This component might cause stability problems, be sure to disable it if you experience issues with Home Assistant
2021-09-05 19:43:52 WARNING (SyncWorker_2) [homeassistant.loader] We found a custom integration localtuya which has not been tested by Home Assistant. This component might cause stability problems, be sure to disable it if you experience issues with Home Assistant
2021-09-05 19:43:52 WARNING (SyncWorker_0) [homeassistant.loader] We found a custom integration ble_monitor which has not been tested by Home Assistant. This component might cause stability problems, be sure to disable it if you experience issues with Home Assistant
2021-09-05 19:43:52 WARNING (SyncWorker_4) [homeassistant.loader] We found a custom integration hacs which has not been tested by Home Assistant. This component might cause stability problems, be sure to disable it if you experience issues with Home Assistant
2021-09-05 19:43:52 WARNING (SyncWorker_3) [homeassistant.loader] We found a custom integration sonoff which has not been tested by Home Assistant. This component might cause stability problems, be sure to disable it if you experience issues with Home Assistant
2021-09-05 19:44:04 WARNING (MainThread) [homeassistant.components.webhook] Received message for unregistered webhook 223e9a991af2ca5a73854309b692710fd11810d0ea52d65d86497022a51bd8ed from 192.168.18.157
2021-09-05 19:44:19 WARNING (MainThread) [homeassistant.components.webhook] Received message for unregistered webhook 223e9a991af2ca5a73854309b692710fd11810d0ea52d65d86497022a51bd8ed from 192.168.18.157
2021-09-05 19:46:11 WARNING (MainThread) [homeassistant.bootstrap] Waiting on integrations to complete setup: met, openuv, hacs
2021-09-05 19:47:16 WARNING (MainThread) [homeassistant.bootstrap] Waiting on integrations to complete setup: gree, co2signal, forecast_solar, switch.gree, iperf3, device_tracker.ble_monitor
2021-09-05 19:47:20 WARNING (MainThread) [homeassistant.components.energy.sensor] Found unexpected state_class measurement for sensor.today_consumption
2021-09-05 19:47:20 WARNING (MainThread) [homeassistant.components.energy.sensor] Found unexpected state_class measurement for sensor.grid_exported_energy
2021-09-05 19:47:20 ERROR (MainThread) [homeassistant.components.sensor] Platform esphome does not generate unique IDs. ID esp-web-tools-esp32-e94da0sensorroom_temperature already exists - ignoring sensor.room_temperature
2021-09-05 19:47:20 ERROR (MainThread) [homeassistant.components.sensor] Platform esphome does not generate unique IDs. ID esp-web-tools-esp32-e94da0sensorroom_humidity already exists - ignoring sensor.room_humidity
2021-09-05 19:47:20 ERROR (MainThread) [homeassistant.components.sensor] Platform esphome does not generate unique IDs. ID esp-web-tools-esp32-e94da0sensorroom_battery_level already exists - ignoring sensor.room_battery_level
2021-09-05 19:47:20 ERROR (MainThread) [homeassistant.components.pvoutput.sensor] Unable to fetch data from PVOutput. Unauthorized 401: Disabled API Key
2021-09-05 19:47:20 WARNING (MainThread) [homeassistant.config_entries] Config entry '192.168.18.29' for synology_dsm integration not ready yet: {'api': None, 'code': -1, 'reason': 'Unknown', 'details': 'ConnectionError = <urllib3.connection.HTTPSConnection object at 0xa97cff28>: Failed to establish a new connection: [Errno 113] Host is unreachable'}; Retrying in background
2021-09-05 19:47:30 WARNING (MainThread) [homeassistant.config_entries] Config entry 'FreshTomato Router' for upnp integration not ready yet; Retrying in background
2021-09-05 19:47:32 WARNING (MainThread) [homeassistant.helpers.template] Template variable warning: None has no element 0 when rendering '{{ state_attr('switch.sonoff_100123b0a9', 'consumption').0 }}'
2021-09-05 19:47:32 WARNING (MainThread) [homeassistant.helpers.template] Template variable warning: None has no element 0 when rendering '{{ state_attr('switch.sonoff_100123b0a9', 'consumption').0 }}'
2021-09-05 19:47:36 WARNING (Recorder) [homeassistant.components.sensor.recorder] sensor.sun2000_10ktl_m1 has unknown unit W
[cont-finish.d] executing container finish scripts...
[cont-finish.d] done.
[s6-finish] waiting for services.
[s6-finish] sending all processes the TERM signal.
[s6-finish] sending all processes the KILL signal and exiting.

ha core stats

➜  ~ ha core stats   
blk_read: 0
blk_write: 0
cpu_percent: 0
memory_limit: 0
memory_percent: 0
memory_usage: 0
network_rx: 0
network_tx: 0

while Supervisor logs doesn’t reveal any errors

➜  ~ ha supervisor logs
21-09-05 19:23:40 INFO (SyncWorker_6) [supervisor.docker.addon] Starting Docker add-on homeassistant/armv7-addon-configurator with version 5.3.3
21-09-05 19:23:44 INFO (SyncWorker_1) [supervisor.docker.addon] Starting Docker add-on sabeechen/hassio-google-drive-backup-armv7 with version 0.104.3
21-09-05 19:23:45 INFO (SyncWorker_6) [supervisor.docker.addon] Starting Docker add-on esphome/esphome-hassio-armv7 with version 2021.8.2
21-09-05 19:23:50 INFO (SyncWorker_3) [supervisor.docker.addon] Starting Docker add-on ghcr.io/hassio-addons/log-viewer/armv7 with version 0.11.1
21-09-05 19:23:53 INFO (MainThread) [supervisor.api.middleware.security] /core/info access from cebe7a76_hassio_google_drive_backup
21-09-05 19:23:53 INFO (MainThread) [supervisor.api.middleware.security] /supervisor/info access from cebe7a76_hassio_google_drive_backup
21-09-05 19:23:53 INFO (MainThread) [supervisor.api.middleware.security] /snapshots access from cebe7a76_hassio_google_drive_backup
21-09-05 19:23:53 INFO (MainThread) [supervisor.api.middleware.security] /snapshots/98cf66a4/info access from cebe7a76_hassio_google_drive_backup
21-09-05 19:23:53 INFO (MainThread) [supervisor.api.middleware.security] /snapshots/2b95b31e/info access from cebe7a76_hassio_google_drive_backup
21-09-05 19:23:53 INFO (MainThread) [supervisor.api.middleware.security] /snapshots/6b97ccbe/info access from cebe7a76_hassio_google_drive_backup
21-09-05 19:23:53 INFO (MainThread) [supervisor.api.middleware.security] /snapshots/7e729a17/info access from cebe7a76_hassio_google_drive_backup
21-09-05 19:23:55 INFO (SyncWorker_1) [supervisor.docker.addon] Starting Docker add-on ghcr.io/hassio-addons/tautulli/armv7 with version 2.3.0
21-09-05 19:24:00 INFO (MainThread) [supervisor.misc.tasks] All core tasks are scheduled
21-09-05 19:24:00 INFO (MainThread) [supervisor.core] Supervisor is up and running
21-09-05 19:24:00 INFO (MainThread) [supervisor.host.info] Updating local host information
21-09-05 19:24:00 INFO (MainThread) [supervisor.updater] Fetching update data from https://version.home-assistant.io/stable.json
21-09-05 19:24:00 INFO (MainThread) [supervisor.resolution.check] Starting system checks with state CoreState.RUNNING
21-09-05 19:24:00 INFO (MainThread) [supervisor.resolution.checks.base] Run check for IssueType.FREE_SPACE/ContextType.SYSTEM
21-09-05 19:24:00 INFO (MainThread) [supervisor.resolution.checks.base] Run check for IssueType.PWNED/ContextType.ADDON
21-09-05 19:24:00 WARNING (MainThread) [supervisor.addons.options] Option 'interface' does not exist in the schema for Samba share (core_samba)
21-09-05 19:24:01 INFO (MainThread) [supervisor.resolution.checks.base] Run check for IssueType.SECURITY/ContextType.CORE
21-09-05 19:24:01 INFO (MainThread) [supervisor.resolution.checks.base] Run check for IssueType.TRUST/ContextType.SUPERVISOR
21-09-05 19:24:02 INFO (MainThread) [supervisor.host.services] Updating service information
21-09-05 19:24:02 INFO (MainThread) [supervisor.host.network] Updating local network information
21-09-05 19:24:05 INFO (MainThread) [supervisor.resolution.checks.base] Run check for IssueType.TRUST/ContextType.CORE
21-09-05 19:24:08 INFO (MainThread) [supervisor.host.sound] Updating PulseAudio information
21-09-05 19:24:08 INFO (MainThread) [supervisor.host.manager] Host information reload completed
21-09-05 19:24:09 INFO (MainThread) [supervisor.resolution.checks.base] Run check for IssueType.TRUST/ContextType.PLUGIN
21-09-05 19:24:25 INFO (MainThread) [supervisor.resolution.check] System checks complete
21-09-05 19:24:25 INFO (MainThread) [supervisor.resolution.evaluate] Starting system evaluation with state CoreState.RUNNING
21-09-05 19:24:29 INFO (MainThread) [supervisor.resolution.evaluate] System evaluation complete
21-09-05 19:24:29 INFO (MainThread) [supervisor.resolution.fixup] Starting system autofix at state CoreState.RUNNING
21-09-05 19:24:29 INFO (MainThread) [supervisor.resolution.fixup] System autofix complete
21-09-05 19:32:40 INFO (MainThread) [supervisor.backups.manager] Creating new partial backup with slug 4a2bc94e
21-09-05 19:32:40 INFO (MainThread) [supervisor.backups.manager] Backing up 4a2bc94e store folders
21-09-05 19:32:40 INFO (SyncWorker_3) [supervisor.backups.backup] Backing up folder homeassistant
21-09-05 19:35:20 INFO (SyncWorker_3) [supervisor.backups.backup] Backup folder homeassistant done
21-09-05 19:35:47 INFO (MainThread) [supervisor.api.middleware.security] /snapshots access from cebe7a76_hassio_google_drive_backup
21-09-05 19:35:55 INFO (MainThread) [supervisor.backups.manager] Creating partial backup with slug 4a2bc94e completed
21-09-05 19:35:56 INFO (MainThread) [supervisor.homeassistant.core] Updating Home Assistant to version 2021.9.3
21-09-05 19:35:56 INFO (SyncWorker_6) [supervisor.docker.interface] Updating image ghcr.io/home-assistant/raspberrypi4-homeassistant:2021.8.8 to ghcr.io/home-assistant/raspberrypi4-homeassistant:2021.9.3
21-09-05 19:35:56 INFO (SyncWorker_6) [supervisor.docker.interface] Downloading docker image ghcr.io/home-assistant/raspberrypi4-homeassistant with tag 2021.9.3.
21-09-05 19:36:00 INFO (MainThread) [supervisor.api.middleware.security] /snapshots access from cebe7a76_hassio_google_drive_backup
21-09-05 19:36:00 INFO (MainThread) [supervisor.api.middleware.security] /snapshots/4a2bc94e/info access from cebe7a76_hassio_google_drive_backup
21-09-05 19:36:01 INFO (MainThread) [supervisor.api.middleware.security] /snapshots/7e729a17/remove access from cebe7a76_hassio_google_drive_backup
21-09-05 19:36:01 INFO (MainThread) [supervisor.backups.manager] Removed backup file 7e729a17
21-09-05 19:36:01 INFO (MainThread) [supervisor.api.middleware.security] /snapshots/4a2bc94e/download access from cebe7a76_hassio_google_drive_backup
21-09-05 19:36:01 INFO (MainThread) [supervisor.api.backups] Downloading backup 4a2bc94e
21-09-05 19:42:16 WARNING (MainThread) [supervisor.misc.tasks] Watchdog/Application found a problem with observer plugin!
21-09-05 19:42:16 INFO (SyncWorker_1) [supervisor.docker.interface] Stopping hassio_observer application
21-09-05 19:42:42 INFO (SyncWorker_1) [supervisor.docker.interface] Cleaning hassio_observer application
21-09-05 19:42:42 INFO (MainThread) [supervisor.plugins.observer] Starting observer plugin
21-09-05 19:42:47 INFO (SyncWorker_3) [supervisor.docker.observer] Starting Observer ghcr.io/home-assistant/armv7-hassio-observer with version 2021.06.0 - 172.30.32.6
21-09-05 19:43:26 INFO (SyncWorker_6) [supervisor.docker.interface] Stopping homeassistant application
21-09-05 19:43:38 INFO (SyncWorker_6) [supervisor.docker.interface] Cleaning homeassistant application
21-09-05 19:43:39 INFO (MainThread) [supervisor.homeassistant.module] Update pulse/client.config: /data/tmp/homeassistant_pulse
21-09-05 19:43:40 INFO (SyncWorker_7) [supervisor.docker.homeassistant] Starting Home Assistant ghcr.io/home-assistant/raspberrypi4-homeassistant with version 2021.9.3
21-09-05 19:43:40 INFO (MainThread) [supervisor.homeassistant.core] Wait until Home Assistant is ready
21-09-05 19:43:56 INFO (MainThread) [supervisor.resolution.evaluate] Starting system evaluation with state CoreState.RUNNING
21-09-05 19:43:57 INFO (MainThread) [supervisor.resolution.evaluate] System evaluation complete
21-09-05 19:44:54 INFO (MainThread) [supervisor.api.middleware.security] /snapshots access from cebe7a76_hassio_google_drive_backup
21-09-05 19:44:56 INFO (MainThread) [supervisor.api.middleware.security] /snapshots access from cebe7a76_hassio_google_drive_backup
21-09-05 19:47:35 INFO (MainThread) [supervisor.homeassistant.core] Detect a running Home Assistant instance
21-09-05 19:47:35 INFO (MainThread) [supervisor.homeassistant.core] Successful started Home Assistant 2021.9.3
21-09-05 19:47:35 INFO (SyncWorker_7) [supervisor.docker.interface] Cleanup images: ['ghcr.io/home-assistant/raspberrypi4-homeassistant:2021.8.8']
21-09-05 19:48:49 INFO (MainThread) [supervisor.api.middleware.security] /network/info access from a0d7b954_ssh
21-09-05 19:48:49 INFO (MainThread) [supervisor.api.middleware.security] /network/info access from a0d7b954_ssh
21-09-05 19:48:49 INFO (MainThread) [supervisor.api.middleware.security] /host/info access from a0d7b954_ssh
21-09-05 19:48:49 INFO (MainThread) [supervisor.api.middleware.security] /core/info access from a0d7b954_ssh
21-09-05 19:57:25 INFO (MainThread) [supervisor.api.middleware.security] /network/info access from a0d7b954_ssh
21-09-05 19:57:25 INFO (MainThread) [supervisor.api.middleware.security] /network/info access from a0d7b954_ssh
21-09-05 19:57:25 INFO (MainThread) [supervisor.api.middleware.security] /host/info access from a0d7b954_ssh
21-09-05 19:57:25 INFO (MainThread) [supervisor.api.middleware.security] /core/info access from a0d7b954_ssh
21-09-05 19:57:40 INFO (MainThread) [supervisor.api.middleware.security] /core/info access from a0d7b954_ssh
21-09-05 19:59:41 INFO (MainThread) [supervisor.api.middleware.security] /network/info access from a0d7b954_ssh
21-09-05 19:59:41 INFO (MainThread) [supervisor.api.middleware.security] /network/info access from a0d7b954_ssh
21-09-05 19:59:41 INFO (MainThread) [supervisor.api.middleware.security] /host/info access from a0d7b954_ssh
21-09-05 19:59:41 INFO (MainThread) [supervisor.api.middleware.security] /core/info access from a0d7b954_ssh
21-09-05 19:59:59 INFO (MainThread) [supervisor.api.middleware.security] /core/check access from a0d7b954_ssh
21-09-05 19:59:59 INFO (SyncWorker_2) [supervisor.docker] Runing command 'python3 -m homeassistant -c /config --script check_config' on ghcr.io/home-assistant/raspberrypi4-homeassistant
21-09-05 20:06:13 INFO (MainThread) [supervisor.homeassistant.core] Home Assistant config is valid
21-09-05 20:08:14 INFO (MainThread) [supervisor.api.middleware.security] /network/info access from a0d7b954_ssh
21-09-05 20:08:14 INFO (MainThread) [supervisor.api.middleware.security] /network/info access from a0d7b954_ssh
21-09-05 20:08:14 INFO (MainThread) [supervisor.api.middleware.security] /host/info access from a0d7b954_ssh
21-09-05 20:08:14 INFO (MainThread) [supervisor.api.middleware.security] /core/info access from a0d7b954_ssh
21-09-05 20:08:47 INFO (MainThread) [supervisor.api.middleware.security] /core/logs access from a0d7b954_ssh
21-09-05 20:11:49 INFO (MainThread) [supervisor.api.middleware.security] /core/options access from a0d7b954_ssh
21-09-05 20:12:10 INFO (MainThread) [supervisor.api.middleware.security] /core/stats access from a0d7b954_ssh
21-09-05 20:15:01 INFO (MainThread) [supervisor.api.middleware.security] /supervisor/info access from a0d7b954_ssh
21-09-05 20:15:27 INFO (MainThread) [supervisor.api.middleware.security] /supervisor/logs access from a0d7b954_ssh
➜  ~ 

[yousaf465]

I have same issue but with HA OS.

[Koen22]

My personal hero and favourite is Luke Vink were my floorplan is based on. You can find his full configuration on github (https://github.com/lukevink/hass-config-lajv).

Layout is drawn with sweethome 3D.

For my floorplan, I have over 70 layers, so it takes a bit to build. I do not see any new errors that causes this reloading, but maybe I can disable some parts to find the issue → I use custom:config-template-card and as soon as I remove the entities to update this card when they change, it become solid, but of course not up to date. → Another test shows that any sensor/switch change will full reload the floorplan card

Any help is welcome.

My floorplan looks like this:

[nordeep]

After update doesn’t calculate cost of energy. Even set a static price of kWh or use entity with current price. Unit of measurment of Entity of current price was changed to RUB/kWh.
Any suggestions?

[jivesinger]

@nordeep

Following the instructions below fixed the issue for me.

2021.9.0: More energy, USB discovery, template

@MartinB @jivesinger @gulli Think I have fixed the issue with energy not calculating costs anymore after the update. EDIT: WARNING - MY DB DIED the next day with errors; Error executing query: (sqlite3.DatabaseError) database disk image is malformed [SQL: DELETE FROM events WHERE events.event_id IN Unrecoverable sqlite3 database corruption detected: (sqlite3.DatabaseError) database disk image is malformed [SQL: DELETE FROM events WHERE events.event_id IN The system will rename the corrupt …

[majkers]

Hey guys. To be 100% sure anyone reading this topic. Is fixing https://github.com/home-assistant/core/issues/55541 once and for all closes the subject of HA 2019 version causing restarts on RPi3? Ie. all users of this hardware can update from 2018 version? Sorry for that but having read this topis, most of the comments are regarding wrong testing and I do not see any clear message…

[nordeep]

Doesn’t seem to be the same issue. All my energy consumtion entities have correct kWh units. But I found a strange thing sensor.energy_meter_d_main_cost - entity which must contain sum of calculatation has EUR currency although I have RUB as main currency. Changed it to the right one through phpMyAdmin - will watch for changes.