Problem with energy monitor total consumption

mjarva · August 10, 2022, 11:33am

Hello,
I have Energy monitor in use, with “total_increasing” state_class sensor producing kWh readings.
This worked fine, until I noticed huge spike in metered consumption shown in graph.

Checking SQLite database, it showed lines like this (these are after the “fix” I did, will explain it after pictures):
Before spike:

Reading after spike:

Point being: state increases consistently, but sum jumps over 9000 points.

To fix this, I ran query like this (ID being correct one from june).

UPDATE "statistics"
SET sum = sum - 9545
WHERE metadata_id = 60 AND id > 599998

This fixed it modifying approximately 1400 lines, and I was satisfied.

Until hour changed, and the error was moved to this moment. Now it looks like this for today:

The question is: why sum increases, even when state changes with way lower rate? And even more importantly: how to fix this?
I have this issue with another kWh sensor, with same kind of behaviour.

tom_l · August 10, 2022, 11:43am

Don’t edit the database.

Go to Developer Tools → Statistics. Find the sensor you need to change. Click on the little ramp icon to the right. Find the time the erroneous reading was added and set it to something in between the previous and next.

You can get a reasonable time range to check by hovering your mouse over the bar in the energy graph you posted above.

You should then investigate why your sensor caused this. Most times it is because the sensor reports 0 instead of unavailable. If it is a template sensor this can be fixed. If it is an integration an issue needs to be raised.

mjarva · August 11, 2022, 6:21am

Hello, thank you for the answer!
I have totally missed that statistic page. I was able to fix readings via it, luckily I have daily backups and was able to restore unmeddled version, for once I had done changes to SQLite db, statistics page did not show problematic values. Due to my meddling I lost yestrerdays values, but thats nonissue.

Here are original values before I did adjustments:

First one is bit tight, but point being: sensor reported approximately constantly rising values for state, as expected, but sum jumped over 9000 points. What could be reason for that?

tom_l · August 11, 2022, 6:24am

mjarva · August 11, 2022, 6:31am

Yes, but isn’t statistics -tables state the value which sensor sends? If, then sensor did not send a zero. Or have I misunderstood that? If so, its propably zero value issue, and I’ll do template sensor.

tom_l · August 11, 2022, 6:35am

Show your template sensor.

mjarva · August 11, 2022, 6:45am

This is not template sensor (at least yet), I have OpenEnergyMonitor, using emoncms platform:

sensor:
  platform: emoncms
  api_key: xxx
  url: http://192.168.0.19/emoncms
  id: 1

This creates sensors for all the feeds OpenEnergyMonitor has, and one of the feeds is cumulative kWh count.

tom_l · August 11, 2022, 6:49am

Looks exactly the same as this issue which went stale and was never fixed:

github.com/home-assistant/core

Statistics/Energy - Unexpected discontinuities in calculated sum

opened 07:04AM - 23 Sep 21 UTC

closed 10:10AM - 02 Nov 21 UTC

deece

integration: emoncms stale

### The problem Occasionally, I'll see some odd looking graphs in the energy da…shboard, with one value massively swamping the others. Data is sourced via the EmonCMS integration Digging into the database (I'm using PostgreSQL as the db), one can see that the sum is occasionally miscalculated, eg, ids 121 & 356 [hass_stats.txt](https://github.com/home-assistant/core/files/7215483/hass_stats.txt) As an aside, I wonder if it might be better to store the inferred delta against the previous record, rather than the sum. ### What is version of Home Assistant Core has the issue? core-2021.9.6 ### What was the last working version of Home Assistant Core? _No response_ ### What type of installation are you running? Home Assistant Supervised ### Integration causing the issue _No response_ ### Link to integration documentation on our website _No response_ ### Example YAML snippet _No response_ ### Anything in the logs that might be useful for us? _No response_ ### Additional information _No response_

I suggest you open a new one.

mjarva · August 11, 2022, 7:04am

Will do.
I do suspect that this is not EmonCMS issue, for the other sensor with similar issue is Z-Wave plug, using Z-Wave JS integration.

Sveto · June 21, 2024, 10:19pm

Have an exact problem using AEON Labs energy monitor. It would seemingly at random record non-existent data, sometimes in the tens of thousands of kWh range. The total kWh is correct on the sensor summary page, but energy monitor sometimes shows over 100 K + kWh spent in one hour? I did try adjusting values in statistics, but I am tired of having to do it multiple times a day especially as I am imputing an arbitrary values since I don’t know how much energy was exactly spent. Doing this completelly invaditaes validity of recorded data which in turn becomes useless so why have it at all? This is very disappointing especially as my whole venture in to setting up HA was its ability to integrate variety on energy monitors for display and analysis. Is there anything to be done about this issue?