Energy Data corrupted

Buffy · July 7, 2024, 11:23am

For a few days now, I have the problem that energy data are not recorded every hour. Once or twice a day, the total consumption is summarized in one hour.
It looks like this:
July 5th
EnergyTotal

Same for all devices. Energy data are only rarely recorded:
EnergyDevice

And it doesn’t get better:
July 6th

July 7th

On July 4, I had the first gap of about three hours:

Help please…

woempiej · July 7, 2024, 11:45am

Any error messages in the Home Assistant logs related to connection issues of the HA server?

geertdevl · July 7, 2024, 11:49am

I have similar errors after updating recently to 2024.7.1.
Some information is updated, solar energy, gas and so on not.
And similar to your case, it can popup in total at a certain time.

woempiej · July 7, 2024, 11:55am

I am using 3x Shelly plug S devices and HA is updated to 2024.7.1
No similar issues here…

vercellino · July 7, 2024, 11:56am

I think something is changed in the recorder integration concerning the purge service.
The purge is done every day at 4 am, and looks like it takes long and long.
This is what I suspect.

woempiej · July 7, 2024, 12:35pm

and reported on github;

github.com/home-assistant/core

homeassistant.components.recorder.core

opened 07:58AM - 04 Jul 24 UTC

matomatusov

integration: recorder

### The problem Hi, I don't know what could be the problem? There is free d…isk space. Logger: homeassistant.components.recorder.core Source: components/recorder/core.py:395 integration: Recorder (documentation, issues) First occurred: 5:21:15 AM (1 occurrences) Last logged: 5:21:15 AM The recorder backlog queue reached the maximum size of 72299 events; usually, the system is CPU bound, I/O bound, or the database is corrupt due to a disk problem; The recorder will stop recording events to avoid running out of memory ![1](https://github.com/home-assistant/core/assets/129114957/e4a04c05-cfd7-46da-a61e-65e9e6e1208a) ![2](https://github.com/home-assistant/core/assets/129114957/c08ab97e-32fa-46b4-bf4c-8c0609ac4f39) ### What version of Home Assistant Core has the issue? core-2024.7.0 ### What was the last working version of Home Assistant Core? core-2024.6.4 ### What type of installation are you running? Home Assistant OS ### Integration causing the issue _No response_ ### Link to integration documentation on our website _No response_ ### Diagnostics information _No response_ ### Example YAML snippet _No response_ ### Anything in the logs that might be useful for us? _No response_ ### Additional information _No response_

github.com/home-assistant/core

Energy-Card and value-graphs behave strange after update from 2024.6.2 to 2024.7.x

opened 07:42AM - 06 Jul 24 UTC

tackin

### The problem I'm using Docker-Container on a pi4. Used to run very stable …until 2024.6. We have 8:46 o'clock and solar (PV) is working. But the latest energy-cards-values are from 4:00 o'clock in the morning. Same if I look in the entity-chart. Last vlaue from 4:05 or so. After a restart of the Container the Values "jump" from 0 to the acual value and charts start showing correct values. ### What version of Home Assistant Core has the issue? ## System Information version | core-2024.7.1 -- | -- installation_type | Home Assistant Container dev | false hassio | false docker | true user | root virtualenv | false python_version | 3.12.4 os_name | Linux os_version | 6.1.21-v8+ arch | aarch64 timezone | Europe/Berlin config_dir | /config <details><summary>Home Assistant Community Store</summary> GitHub API | ok -- | -- GitHub Content | ok GitHub Web | ok GitHub API Calls Remaining | 4932 Installed Version | 1.34.0 Stage | running Available Repositories | 1385 Downloaded Repositories | 11 </details> <details><summary>Home Assistant Cloud</summary> logged_in | false -- | -- can_reach_cert_server | ok can_reach_cloud_auth | ok can_reach_cloud | ok </details> <details><summary>Dashboards</summary> dashboards | 7 -- | -- resources | 7 views | 6 mode | storage </details> <details><summary>Recorder</summary> oldest_recorder_run | 20. Juni 2024 um 14:14 -- | -- current_recorder_run | 6. Juli 2024 um 08:58 estimated_db_size | 1289.47 MiB database_engine | sqlite database_version | 3.45.3 </details> ### What was the last working version of Home Assistant Core? 2024.6.x ### What type of installation are you running? Home Assistant OS ### Integration causing the issue My guess: Huawei ### Link to integration documentation on our website https://github.com/wlcrs/huawei_solar/wiki ### Diagnostics information { "home_assistant": { "installation_type": "Home Assistant Container", "version": "2024.7.1", "dev": false, "hassio": false, "virtualenv": false, "python_version": "3.12.4", "docker": true, "arch": "aarch64", "timezone": "Europe/Berlin", "os_name": "Linux", "os_version": "6.1.21-v8+", "run_as_root": true }, "custom_components": { "huawei_solar": { "documentation": "https://github.com/wlcrs/huawei_solar/wiki", "version": "1.2.6", "requirements": [ "huawei-solar==2.2.8" ] }, "average": { "documentation": "https://github.com/Limych/ha-average", "version": "2.3.4", "requirements": [] }, "alarmo": { "documentation": "https://github.com/nielsfaber/alarmo", "version": "v1.10.4", "requirements": [] }, "hacs": { "documentation": "https://hacs.xyz/docs/configuration/start", "version": "1.34.0", "requirements": [ "aiogithubapi>=22.10.1" ] }, "tapo": { "documentation": "https://github.com/petretiandrea/home-assistant-tapo-p100", "version": "3.1.2", "requirements": [ "plugp100==5.1.3" ] }, "thermal_comfort": { "documentation": "https://github.com/dolezsa/thermal_comfort/blob/master/README.md", "version": "2.2.2", "requirements": [] }, "config_editor": { "documentation": "https://github.com/htmltiger/config-editor-card", "version": "4.3", "requirements": [] }, "auto_backup": { "documentation": "https://github.com/jcwillox/hass-auto-backup", "version": "1.5.0", "requirements": [] }, "localtuya": { "documentation": "https://github.com/rospogrigio/localtuya/", "version": "5.2.1", "requirements": [] }, "waste_collection_schedule": { "documentation": "https://github.com/mampfes/hacs_waste_collection_schedule#readme", "version": "1.49.0", "requirements": [ "icalendar", "recurring_ical_events", "icalevents", "beautifulsoup4", "lxml" ] } }, "integration_manifest": { "domain": "huawei_solar", "name": "Huawei Solar", "config_flow": true, "documentation": "https://github.com/wlcrs/huawei_solar/wiki", "issue_tracker": "https://github.com/wlcrs/huawei_solar/issues", "requirements": [ "huawei-solar==2.2.8" ], "codeowners": [ "wlcrs" ], "iot_class": "local_polling", "version": "1.2.6", "loggers": [ "huawei_solar", "pymodbus" ], "is_built_in": false }, "setup_times": { "null": { "setup": 8.783303201198578e-05 }, "7a39b1b1d546c59ca7d277dac39cba62": { "wait_import_platforms": -0.04919659625738859, "wait_base_component": -0.00559993414208293, "config_entry_setup": 15.230675771366805 } }, "data": { "config_entry_data": { "host": "192.168.1.134", "port": 502, "slave_ids": [ 1 ], "enable_parameter_configuration": true, "username": null, "password": null }, "slave_0": { "model_name": "SUN2000-10KTL-M1\u0000\u0000\u0000\u0000SUN2000-12", "pv_string_count": 2, "has_optimizers": 0, "battery_type": 0, "battery_1_type": 0, "battery_2_type": 0, "power_meter_type": 1, "supports_capacity_control": false }, "slave_0_data": { "input_power": [ 5808, "W" ], "line_voltage_A_B": [ 407.3, "V" ], "line_voltage_B_C": [ 408.9, "V" ], "line_voltage_C_A": [ 409.2, "V" ], "phase_A_voltage": [ 234.6, "V" ], "phase_B_voltage": [ 236.1, "V" ], "phase_C_voltage": [ 236.5, "V" ], "phase_A_current": [ 8.03, "A" ], "phase_B_current": [ 8.066, "A" ], "phase_C_current": [ 8.078, "A" ], "day_active_power_peak": [ 8193, "W" ], "active_power": [ 5676, "W" ], "reactive_power": [ -6, "VA" ], "power_factor": [ 1.0, null ], "grid_frequency": [ 50.02, "Hz" ], "efficiency": [ 97.72, "%" ], "internal_temperature": [ 50.7, "\u00b0C" ], "insulation_resistance": [ 30.0, "MOhm" ], "device_status": [ "On-grid", null ], "fault_code": [ 0, null ], "startup_time": [ "2024-07-06T04:44:54+00:00", null ], "shutdown_time": [ "2024-07-05T20:41:08+00:00", null ], "accumulated_yield_energy": [ 9818.4, "kWh" ], "daily_yield_energy": [ 5.78, "kWh" ], "state_1": [ [ "Grid-Connected", "Grid-Connected normally" ], null ], "state_2": [ [ "Unlocked", "PV connected", "DSP data collection" ], null ], "state_3": [ [ "On-grid", "Off-grid switch disabled" ], null ], "alarm_1": [ [], null ], "alarm_2": [ [], null ], "alarm_3": [ [], null ], "pv_01_voltage": [ 395.3, "V" ], "pv_01_current": [ 7.62, "A" ], "pv_02_voltage": [ 350.4, "V" ], "pv_02_current": [ 7.86, "A" ], "meter_status": [ 1, null ], "grid_A_voltage": [ 234.3, "V" ], "grid_B_voltage": [ 235.6, "V" ], "grid_C_voltage": [ 236.0, "V" ], "active_grid_A_current": [ 7.36, "I" ], "active_grid_B_current": [ 7.93, "I" ], "active_grid_C_current": [ 7.59, "I" ], "power_meter_active_power": [ 5392, "W" ], "power_meter_reactive_power": [ 184, "Var" ], "active_grid_power_factor": [ -0.998, null ], "active_grid_frequency": [ 50.02, "Hz" ], "grid_exported_energy": [ 7695.74, "kWh" ], "grid_accumulated_energy": [ 1933.82, "kWh" ], "grid_accumulated_reactive_power": [ 0.0, "kVarh" ], "meter_type": [ 1, null ], "active_grid_A_B_voltage": [ 406.8, "V" ], "active_grid_B_C_voltage": [ 408.3, "V" ], "active_grid_C_A_voltage": [ 407.2, "V" ], "active_grid_A_power": [ 1728, "W" ], "active_grid_B_power": [ 1869, "W" ], "active_grid_C_power": [ 1794, "W" ] }, "slave_0_config_data": {} } } ### Example YAML snippet _No response_ ### Anything in the logs that might be useful for us? ```txt please see: https://tmpfile.uni-kl.de/de000592-6f61-4f03-87dd-585136b02a1f/+inline? The log was rejected by github as too long. ``` ### Additional information I hope my input helps you and is appropriate at this place. I also would like to provide you with the container-logs, but github told me: "There was an error creating your Issue: body is too long (maximum is 65536 characters). " So I put it here: https://tmpfile.uni-kl.de/de000592-6f61-4f03-87dd-585136b02a1f/+inline?