2021.9.0: More energy, USB discovery, template ❤️

In case this question has been missed by the one you has the anwer

1 Like

Thank you Francis
Best Regard
Claudio

Zha is the only officially supported zigbee integration so it will be the only option presented by default.

1 Like

I though, that addons are also official.
Anyway, I’m mostly interested if this option can be somehow hidden if I decide to use another integration

Probably going to use bad terminology here but hopefully you get the gist of it.
Zha is the only officially supported direct integration (addons are just that…addons…usually docker containers that extend functionality of the core HAOS). The z2m addons is not listed as an official addon either. The fact that it requires you to manually add an outside repository to install it, should reinforce this. Hopefully this helps clarify.

I had similar problem Unable to access lovelace after upgrade to 2021.9.x
ha core info revealed wrong ip

➜  ~ ha core info                                                               arch: armv7
audio_input: None
audio_output: None
boot: true
image: ghcr.io/home-assistant/raspberrypi4-homeassistant
ip_address: 172.30.32.1
last_version: 2021.9.3
machine: raspberrypi4
port: 8123
ssl: false
update_available: false
version: 2021.9.3
version_latest: 2021.9.3
wait_boot: 600
watchdog: true
➜  ~

ha core check

command completed successfully

ha core logs revealed following

~ ha core logs   
[s6-init] making user provided files available at /var/run/s6/etc...exited 0.
[s6-init] ensuring user provided files have correct perms...exited 0.
[fix-attrs.d] applying ownership & permissions fixes...
[fix-attrs.d] done.
[cont-init.d] executing container initialization scripts...
[cont-init.d] done.
[services.d] starting services
[services.d] done.
2021-09-05 19:43:52 WARNING (SyncWorker_0) [homeassistant.loader] We found a custom integration huawei_solar which has not been tested by Home Assistant. This component might cause stability problems, be sure to disable it if you experience issues with Home Assistant
2021-09-05 19:43:52 WARNING (SyncWorker_1) [homeassistant.loader] We found a custom integration tplink_router which has not been tested by Home Assistant. This component might cause stability problems, be sure to disable it if you experience issues with Home Assistant
2021-09-05 19:43:52 ERROR (SyncWorker_1) [homeassistant.loader] The custom integration 'tplink_router' does not have a valid version key (None) in the manifest file and was blocked from loading. See https://developers.home-assistant.io/blog/2021/01/29/custom-integration-changes#versions for more details
2021-09-05 19:43:52 WARNING (SyncWorker_0) [homeassistant.loader] We found a custom integration scheduler which has not been tested by Home Assistant. This component might cause stability problems, be sure to disable it if you experience issues with Home Assistant
2021-09-05 19:43:52 WARNING (SyncWorker_2) [homeassistant.loader] We found a custom integration localtuya which has not been tested by Home Assistant. This component might cause stability problems, be sure to disable it if you experience issues with Home Assistant
2021-09-05 19:43:52 WARNING (SyncWorker_0) [homeassistant.loader] We found a custom integration ble_monitor which has not been tested by Home Assistant. This component might cause stability problems, be sure to disable it if you experience issues with Home Assistant
2021-09-05 19:43:52 WARNING (SyncWorker_4) [homeassistant.loader] We found a custom integration hacs which has not been tested by Home Assistant. This component might cause stability problems, be sure to disable it if you experience issues with Home Assistant
2021-09-05 19:43:52 WARNING (SyncWorker_3) [homeassistant.loader] We found a custom integration sonoff which has not been tested by Home Assistant. This component might cause stability problems, be sure to disable it if you experience issues with Home Assistant
2021-09-05 19:44:04 WARNING (MainThread) [homeassistant.components.webhook] Received message for unregistered webhook 223e9a991af2ca5a73854309b692710fd11810d0ea52d65d86497022a51bd8ed from 192.168.18.157
2021-09-05 19:44:19 WARNING (MainThread) [homeassistant.components.webhook] Received message for unregistered webhook 223e9a991af2ca5a73854309b692710fd11810d0ea52d65d86497022a51bd8ed from 192.168.18.157
2021-09-05 19:46:11 WARNING (MainThread) [homeassistant.bootstrap] Waiting on integrations to complete setup: met, openuv, hacs
2021-09-05 19:47:16 WARNING (MainThread) [homeassistant.bootstrap] Waiting on integrations to complete setup: gree, co2signal, forecast_solar, switch.gree, iperf3, device_tracker.ble_monitor
2021-09-05 19:47:20 WARNING (MainThread) [homeassistant.components.energy.sensor] Found unexpected state_class measurement for sensor.today_consumption
2021-09-05 19:47:20 WARNING (MainThread) [homeassistant.components.energy.sensor] Found unexpected state_class measurement for sensor.grid_exported_energy
2021-09-05 19:47:20 ERROR (MainThread) [homeassistant.components.sensor] Platform esphome does not generate unique IDs. ID esp-web-tools-esp32-e94da0sensorroom_temperature already exists - ignoring sensor.room_temperature
2021-09-05 19:47:20 ERROR (MainThread) [homeassistant.components.sensor] Platform esphome does not generate unique IDs. ID esp-web-tools-esp32-e94da0sensorroom_humidity already exists - ignoring sensor.room_humidity
2021-09-05 19:47:20 ERROR (MainThread) [homeassistant.components.sensor] Platform esphome does not generate unique IDs. ID esp-web-tools-esp32-e94da0sensorroom_battery_level already exists - ignoring sensor.room_battery_level
2021-09-05 19:47:20 ERROR (MainThread) [homeassistant.components.pvoutput.sensor] Unable to fetch data from PVOutput. Unauthorized 401: Disabled API Key
2021-09-05 19:47:20 WARNING (MainThread) [homeassistant.config_entries] Config entry '192.168.18.29' for synology_dsm integration not ready yet: {'api': None, 'code': -1, 'reason': 'Unknown', 'details': 'ConnectionError = <urllib3.connection.HTTPSConnection object at 0xa97cff28>: Failed to establish a new connection: [Errno 113] Host is unreachable'}; Retrying in background
2021-09-05 19:47:30 WARNING (MainThread) [homeassistant.config_entries] Config entry 'FreshTomato Router' for upnp integration not ready yet; Retrying in background
2021-09-05 19:47:32 WARNING (MainThread) [homeassistant.helpers.template] Template variable warning: None has no element 0 when rendering '{{ state_attr('switch.sonoff_100123b0a9', 'consumption').0 }}'
2021-09-05 19:47:32 WARNING (MainThread) [homeassistant.helpers.template] Template variable warning: None has no element 0 when rendering '{{ state_attr('switch.sonoff_100123b0a9', 'consumption').0 }}'
2021-09-05 19:47:36 WARNING (Recorder) [homeassistant.components.sensor.recorder] sensor.sun2000_10ktl_m1 has unknown unit W
[cont-finish.d] executing container finish scripts...
[cont-finish.d] done.
[s6-finish] waiting for services.
[s6-finish] sending all processes the TERM signal.
[s6-finish] sending all processes the KILL signal and exiting.

ha core stats

➜  ~ ha core stats   
blk_read: 0
blk_write: 0
cpu_percent: 0
memory_limit: 0
memory_percent: 0
memory_usage: 0
network_rx: 0
network_tx: 0

while Supervisor logs doesn’t reveal any errors

➜  ~ ha supervisor logs
21-09-05 19:23:40 INFO (SyncWorker_6) [supervisor.docker.addon] Starting Docker add-on homeassistant/armv7-addon-configurator with version 5.3.3
21-09-05 19:23:44 INFO (SyncWorker_1) [supervisor.docker.addon] Starting Docker add-on sabeechen/hassio-google-drive-backup-armv7 with version 0.104.3
21-09-05 19:23:45 INFO (SyncWorker_6) [supervisor.docker.addon] Starting Docker add-on esphome/esphome-hassio-armv7 with version 2021.8.2
21-09-05 19:23:50 INFO (SyncWorker_3) [supervisor.docker.addon] Starting Docker add-on ghcr.io/hassio-addons/log-viewer/armv7 with version 0.11.1
21-09-05 19:23:53 INFO (MainThread) [supervisor.api.middleware.security] /core/info access from cebe7a76_hassio_google_drive_backup
21-09-05 19:23:53 INFO (MainThread) [supervisor.api.middleware.security] /supervisor/info access from cebe7a76_hassio_google_drive_backup
21-09-05 19:23:53 INFO (MainThread) [supervisor.api.middleware.security] /snapshots access from cebe7a76_hassio_google_drive_backup
21-09-05 19:23:53 INFO (MainThread) [supervisor.api.middleware.security] /snapshots/98cf66a4/info access from cebe7a76_hassio_google_drive_backup
21-09-05 19:23:53 INFO (MainThread) [supervisor.api.middleware.security] /snapshots/2b95b31e/info access from cebe7a76_hassio_google_drive_backup
21-09-05 19:23:53 INFO (MainThread) [supervisor.api.middleware.security] /snapshots/6b97ccbe/info access from cebe7a76_hassio_google_drive_backup
21-09-05 19:23:53 INFO (MainThread) [supervisor.api.middleware.security] /snapshots/7e729a17/info access from cebe7a76_hassio_google_drive_backup
21-09-05 19:23:55 INFO (SyncWorker_1) [supervisor.docker.addon] Starting Docker add-on ghcr.io/hassio-addons/tautulli/armv7 with version 2.3.0
21-09-05 19:24:00 INFO (MainThread) [supervisor.misc.tasks] All core tasks are scheduled
21-09-05 19:24:00 INFO (MainThread) [supervisor.core] Supervisor is up and running
21-09-05 19:24:00 INFO (MainThread) [supervisor.host.info] Updating local host information
21-09-05 19:24:00 INFO (MainThread) [supervisor.updater] Fetching update data from https://version.home-assistant.io/stable.json
21-09-05 19:24:00 INFO (MainThread) [supervisor.resolution.check] Starting system checks with state CoreState.RUNNING
21-09-05 19:24:00 INFO (MainThread) [supervisor.resolution.checks.base] Run check for IssueType.FREE_SPACE/ContextType.SYSTEM
21-09-05 19:24:00 INFO (MainThread) [supervisor.resolution.checks.base] Run check for IssueType.PWNED/ContextType.ADDON
21-09-05 19:24:00 WARNING (MainThread) [supervisor.addons.options] Option 'interface' does not exist in the schema for Samba share (core_samba)
21-09-05 19:24:01 INFO (MainThread) [supervisor.resolution.checks.base] Run check for IssueType.SECURITY/ContextType.CORE
21-09-05 19:24:01 INFO (MainThread) [supervisor.resolution.checks.base] Run check for IssueType.TRUST/ContextType.SUPERVISOR
21-09-05 19:24:02 INFO (MainThread) [supervisor.host.services] Updating service information
21-09-05 19:24:02 INFO (MainThread) [supervisor.host.network] Updating local network information
21-09-05 19:24:05 INFO (MainThread) [supervisor.resolution.checks.base] Run check for IssueType.TRUST/ContextType.CORE
21-09-05 19:24:08 INFO (MainThread) [supervisor.host.sound] Updating PulseAudio information
21-09-05 19:24:08 INFO (MainThread) [supervisor.host.manager] Host information reload completed
21-09-05 19:24:09 INFO (MainThread) [supervisor.resolution.checks.base] Run check for IssueType.TRUST/ContextType.PLUGIN
21-09-05 19:24:25 INFO (MainThread) [supervisor.resolution.check] System checks complete
21-09-05 19:24:25 INFO (MainThread) [supervisor.resolution.evaluate] Starting system evaluation with state CoreState.RUNNING
21-09-05 19:24:29 INFO (MainThread) [supervisor.resolution.evaluate] System evaluation complete
21-09-05 19:24:29 INFO (MainThread) [supervisor.resolution.fixup] Starting system autofix at state CoreState.RUNNING
21-09-05 19:24:29 INFO (MainThread) [supervisor.resolution.fixup] System autofix complete
21-09-05 19:32:40 INFO (MainThread) [supervisor.backups.manager] Creating new partial backup with slug 4a2bc94e
21-09-05 19:32:40 INFO (MainThread) [supervisor.backups.manager] Backing up 4a2bc94e store folders
21-09-05 19:32:40 INFO (SyncWorker_3) [supervisor.backups.backup] Backing up folder homeassistant
21-09-05 19:35:20 INFO (SyncWorker_3) [supervisor.backups.backup] Backup folder homeassistant done
21-09-05 19:35:47 INFO (MainThread) [supervisor.api.middleware.security] /snapshots access from cebe7a76_hassio_google_drive_backup
21-09-05 19:35:55 INFO (MainThread) [supervisor.backups.manager] Creating partial backup with slug 4a2bc94e completed
21-09-05 19:35:56 INFO (MainThread) [supervisor.homeassistant.core] Updating Home Assistant to version 2021.9.3
21-09-05 19:35:56 INFO (SyncWorker_6) [supervisor.docker.interface] Updating image ghcr.io/home-assistant/raspberrypi4-homeassistant:2021.8.8 to ghcr.io/home-assistant/raspberrypi4-homeassistant:2021.9.3
21-09-05 19:35:56 INFO (SyncWorker_6) [supervisor.docker.interface] Downloading docker image ghcr.io/home-assistant/raspberrypi4-homeassistant with tag 2021.9.3.
21-09-05 19:36:00 INFO (MainThread) [supervisor.api.middleware.security] /snapshots access from cebe7a76_hassio_google_drive_backup
21-09-05 19:36:00 INFO (MainThread) [supervisor.api.middleware.security] /snapshots/4a2bc94e/info access from cebe7a76_hassio_google_drive_backup
21-09-05 19:36:01 INFO (MainThread) [supervisor.api.middleware.security] /snapshots/7e729a17/remove access from cebe7a76_hassio_google_drive_backup
21-09-05 19:36:01 INFO (MainThread) [supervisor.backups.manager] Removed backup file 7e729a17
21-09-05 19:36:01 INFO (MainThread) [supervisor.api.middleware.security] /snapshots/4a2bc94e/download access from cebe7a76_hassio_google_drive_backup
21-09-05 19:36:01 INFO (MainThread) [supervisor.api.backups] Downloading backup 4a2bc94e
21-09-05 19:42:16 WARNING (MainThread) [supervisor.misc.tasks] Watchdog/Application found a problem with observer plugin!
21-09-05 19:42:16 INFO (SyncWorker_1) [supervisor.docker.interface] Stopping hassio_observer application
21-09-05 19:42:42 INFO (SyncWorker_1) [supervisor.docker.interface] Cleaning hassio_observer application
21-09-05 19:42:42 INFO (MainThread) [supervisor.plugins.observer] Starting observer plugin
21-09-05 19:42:47 INFO (SyncWorker_3) [supervisor.docker.observer] Starting Observer ghcr.io/home-assistant/armv7-hassio-observer with version 2021.06.0 - 172.30.32.6
21-09-05 19:43:26 INFO (SyncWorker_6) [supervisor.docker.interface] Stopping homeassistant application
21-09-05 19:43:38 INFO (SyncWorker_6) [supervisor.docker.interface] Cleaning homeassistant application
21-09-05 19:43:39 INFO (MainThread) [supervisor.homeassistant.module] Update pulse/client.config: /data/tmp/homeassistant_pulse
21-09-05 19:43:40 INFO (SyncWorker_7) [supervisor.docker.homeassistant] Starting Home Assistant ghcr.io/home-assistant/raspberrypi4-homeassistant with version 2021.9.3
21-09-05 19:43:40 INFO (MainThread) [supervisor.homeassistant.core] Wait until Home Assistant is ready
21-09-05 19:43:56 INFO (MainThread) [supervisor.resolution.evaluate] Starting system evaluation with state CoreState.RUNNING
21-09-05 19:43:57 INFO (MainThread) [supervisor.resolution.evaluate] System evaluation complete
21-09-05 19:44:54 INFO (MainThread) [supervisor.api.middleware.security] /snapshots access from cebe7a76_hassio_google_drive_backup
21-09-05 19:44:56 INFO (MainThread) [supervisor.api.middleware.security] /snapshots access from cebe7a76_hassio_google_drive_backup
21-09-05 19:47:35 INFO (MainThread) [supervisor.homeassistant.core] Detect a running Home Assistant instance
21-09-05 19:47:35 INFO (MainThread) [supervisor.homeassistant.core] Successful started Home Assistant 2021.9.3
21-09-05 19:47:35 INFO (SyncWorker_7) [supervisor.docker.interface] Cleanup images: ['ghcr.io/home-assistant/raspberrypi4-homeassistant:2021.8.8']
21-09-05 19:48:49 INFO (MainThread) [supervisor.api.middleware.security] /network/info access from a0d7b954_ssh
21-09-05 19:48:49 INFO (MainThread) [supervisor.api.middleware.security] /network/info access from a0d7b954_ssh
21-09-05 19:48:49 INFO (MainThread) [supervisor.api.middleware.security] /host/info access from a0d7b954_ssh
21-09-05 19:48:49 INFO (MainThread) [supervisor.api.middleware.security] /core/info access from a0d7b954_ssh
21-09-05 19:57:25 INFO (MainThread) [supervisor.api.middleware.security] /network/info access from a0d7b954_ssh
21-09-05 19:57:25 INFO (MainThread) [supervisor.api.middleware.security] /network/info access from a0d7b954_ssh
21-09-05 19:57:25 INFO (MainThread) [supervisor.api.middleware.security] /host/info access from a0d7b954_ssh
21-09-05 19:57:25 INFO (MainThread) [supervisor.api.middleware.security] /core/info access from a0d7b954_ssh
21-09-05 19:57:40 INFO (MainThread) [supervisor.api.middleware.security] /core/info access from a0d7b954_ssh
21-09-05 19:59:41 INFO (MainThread) [supervisor.api.middleware.security] /network/info access from a0d7b954_ssh
21-09-05 19:59:41 INFO (MainThread) [supervisor.api.middleware.security] /network/info access from a0d7b954_ssh
21-09-05 19:59:41 INFO (MainThread) [supervisor.api.middleware.security] /host/info access from a0d7b954_ssh
21-09-05 19:59:41 INFO (MainThread) [supervisor.api.middleware.security] /core/info access from a0d7b954_ssh
21-09-05 19:59:59 INFO (MainThread) [supervisor.api.middleware.security] /core/check access from a0d7b954_ssh
21-09-05 19:59:59 INFO (SyncWorker_2) [supervisor.docker] Runing command 'python3 -m homeassistant -c /config --script check_config' on ghcr.io/home-assistant/raspberrypi4-homeassistant
21-09-05 20:06:13 INFO (MainThread) [supervisor.homeassistant.core] Home Assistant config is valid
21-09-05 20:08:14 INFO (MainThread) [supervisor.api.middleware.security] /network/info access from a0d7b954_ssh
21-09-05 20:08:14 INFO (MainThread) [supervisor.api.middleware.security] /network/info access from a0d7b954_ssh
21-09-05 20:08:14 INFO (MainThread) [supervisor.api.middleware.security] /host/info access from a0d7b954_ssh
21-09-05 20:08:14 INFO (MainThread) [supervisor.api.middleware.security] /core/info access from a0d7b954_ssh
21-09-05 20:08:47 INFO (MainThread) [supervisor.api.middleware.security] /core/logs access from a0d7b954_ssh
21-09-05 20:11:49 INFO (MainThread) [supervisor.api.middleware.security] /core/options access from a0d7b954_ssh
21-09-05 20:12:10 INFO (MainThread) [supervisor.api.middleware.security] /core/stats access from a0d7b954_ssh
21-09-05 20:15:01 INFO (MainThread) [supervisor.api.middleware.security] /supervisor/info access from a0d7b954_ssh
21-09-05 20:15:27 INFO (MainThread) [supervisor.api.middleware.security] /supervisor/logs access from a0d7b954_ssh
➜  ~ 

I have same issue but with HA OS.

My personal hero and favourite is Luke Vink were my floorplan is based on. You can find his full configuration on github (https://github.com/lukevink/hass-config-lajv).

Layout is drawn with sweethome 3D.

For my floorplan, I have over 70 layers, so it takes a bit to build. I do not see any new errors that causes this reloading, but maybe I can disable some parts to find the issue → I use custom:config-template-card and as soon as I remove the entities to update this card when they change, it become solid, but of course not up to date. → Another test shows that any sensor/switch change will full reload the floorplan card

Any help is welcome.

My floorplan looks like this:

After update doesn’t calculate cost of energy. Even set a static price of kWh or use entity with current price. Unit of measurment of Entity of current price was changed to RUB/kWh.
Any suggestions?

@nordeep

Following the instructions below fixed the issue for me.

Hey guys. To be 100% sure anyone reading this topic. Is fixing https://github.com/home-assistant/core/issues/55541 once and for all closes the subject of HA 2019 version causing restarts on RPi3? Ie. all users of this hardware can update from 2018 version? Sorry for that but having read this topis, most of the comments are regarding wrong testing and I do not see any clear message…

1 Like

Doesn’t seem to be the same issue. All my energy consumtion entities have correct kWh units. But I found a strange thing sensor.energy_meter_d_main_cost - entity which must contain sum of calculatation has EUR currency although I have RUB as main currency. Changed it to the right one through phpMyAdmin - will watch for changes.

Just a warning my DB is dead this morning, not 100% sure it was this that did it because it was fine until 4:12am this morning then died.

Error executing query: (sqlite3.DatabaseError) database disk image is malformed [SQL: DELETE FROM events WHERE events.event_id IN

Unrecoverable sqlite3 database corruption detected: (sqlite3.DatabaseError) database disk image is malformed [SQL: DELETE FROM events WHERE events.event_id IN

The system will rename the corrupt database file //config/home-assistant_v2.db to //config/home-assistant_v2.db.corrupt.2021-09-06T03:12:48.885687+00:00 in order to allow startup to proceed

Fingers crossed I’ve had no issues so far. :crossed_fingers:
I had to go back and edit the DB a second time as I missed changing one of the values.

I remembered to shut down HA the second time :smiley:

I have managed to recover my DB for now from this post, doing a sqlite3 dump of the corrupted DB to a new DB then renamed bits.

Something odd though, this is the ls -l within HA of my config directory

But if I samba to the directory it looks like this

image

You can see the oddly named files HTLSH5~5 is actually the corrupt DB

Anyway, I am back for now so fingers crossed it is sorted.

That is because : is an illegal char in a filename and samba doesn’t translate it properly.

I can’t recall, but I think it is illegal in windows but ok in linux, hence only samba being affected (MY memory is abut confused on that).

Ah makes sense, I copied the corrupt DB to my windows machine and ran an integrity check on my original DB I backed up before making the change and no errors.

On the corrupt one;

*** in database main ***
On tree page 35983 cell 15: 2nd reference to page 118249
On tree page 35983 cell 14: 2nd reference to page 86028
On tree page 35983 cell 13: 2nd reference to page 86110
On tree page 35983 cell 12: 2nd reference to page 86177
On tree page 35983 cell 11: 2nd reference to page 86379
On tree page 35983 cell 10: 2nd reference to page 86531
On tree page 35983 cell 9: 2nd reference to page 86539
On tree page 35983 cell 8: 2nd reference to page 86547
On tree page 35983 cell 7: 2nd reference to page 86557
On tree page 35983 cell 6: 2nd reference to page 86566
On tree page 35983 cell 5: 2nd reference to page 87831
On tree page 35983 cell 4: 2nd reference to page 118137
On tree page 35983 cell 3: 2nd reference to page 118236
On tree page 35983 cell 2: 2nd reference to page 118245

and

wrong # of entries in index ix_states_old_state_id

So it was not happy

EDIT - Just checked my new DB from the dump and no errors so hopefully all good now

Hi, did you solve this ? Since the 2021.9 update, all my picture elements show a loading indicator (blue spinning circle). Sometimes its pretty instant but other times it takes 1-5 seconds.
I use some 100x100 PNG files for icons (all in the www folder)

Maybe yes, but I think the whole point of the Energy dashboard is expenses (costs) management.
We have support for electrical energy and gas.
Gas can be used to produce energy, so does pellet, coal, wood, and other sources, but we don’t have support for all of them.
I think that support for water usage would be a nice addition. I’ll create a feature request and we can discuss that in the proper place.

No, apparently as it is a custom integration, it will not be supported or fixed. So the issue has raised with the owner of the custom card (custom:config-template-card).

See: https://github.com/iantrich/config-template-card/issues/78