Energy Management in Home Assistant

[jivesinger]

There was debate a few months ago about this.
From memory the concensus was that water is not energy, so no.

[CChris (Christoph)]

since the focus is on “Energy” Usage - I do agree.
And I think, at the moment, the energy section does still have much space for improvements…

Long Term, I would love to see the Energy Dashboard evolve to a “Environmental Impact” Dashboard, which does also integrate methods for Water usage and other possible measurements…

[pbranly (Philippe)]

Yes short term evolution are:

• have addition between electricity energy and gas energy (in kWh)
• have a new calculation of non fossil percentage taking into account gas (definitively fossil)
  There is PR ongoing that is not yet accepted
  Phil

[martin.hopkins (Martin)]

I was struggling with this for a long time so thanks for the pointer. I’m using an EmonPi which supplies float value for the Wattage, so this worked a treat for me…

- platform: mqtt
  name: "Garage Electric"
  state_topic: "emon/emontx/power3"
  device_class: power
  unit_of_measurement: "W"
  value_template: "{{ value | round(0,half,0) }}"
- platform: integration
  source: sensor.garage_electric
  name: Garage Electric kWh
  unit_prefix: k
  round: 2

[Hutcho]

If you haven’t figured it out yet, this post (not mine) worked for me and saved me a load of time:

How to get the Energy Consumption Dashboard and running with Homematic (IP) (HmiP-PSM/HM-ES-TX-WM)

Hi everyone, basically i am using HA just as a Frontend for Homematic (IP). All my automations are on the CCU/Raspberrymatic. I would really wish that the integration of Homematic (IP) would be more seamless in HA, however i can see the Point that the Homematic System is just highly popular in the german speaking part of the world. I really love the HA UI and the option to just configure everything gui related to the webui. What is really taxing for me is everything related to yaml based conf…

[Fete (a.nonym)]

Hi everyone, I hope I don’t post in the wrong place with this question. I have a Frient/Develco electricity meter that works very well. It reads consumption from my semi-smart energy meter that the elecrical company uses to bill me. A very nice guy just helped me to show the instantaneous power being pulled (in W) and also to make a counter that shows total minutes the power has been over a certain threshold.

What I hope to achieve is to measure the consumption in kWh of my dumb heater. I know it draws 6000W when it switches on, so I want to use this for mapping the total consumption per day/week/month/year. Figure I should use a helper, counter, template sensor or whatnot… I searched the forums, documents and search engines but I can’t figure it out. I don’t have a really good knowledge of HA yet.

Something like: “Heater switches on (power being pulled suddenly increases with 5900W) → some sensor starts reading and recording this → translates the W to kWh → sends this to the UI of HA.”

Ideally it should be the actual W being read by the smart meter, but it could also be: "Power being pulled suddenly increases with 5900W → some sensor starts reading and recording this → the sensor is using the time between the increase and when it decreases with 5900W → translates the data to kWh, given that a full hour of “increased power” is 6kWh.

It would be very very good to get this into the “official” energy dashboard, but might not be possible atm…?

I think this solution could benefit a lot of people who want to brake down total household energy usage to separate devices. Some devices are permanently installed and can’t be put in one of the various existing smart plugs, and not so rarely it’s the “heavy consumers”. So if one knows the power that their device is pulling when active, one could use this solution to measure its consumption. As long as one does not have several devices that pull about the same energy when used that is.

Would appreciate some help here!

I use hassoss core-2021.10.6, HA 6.5, on a Rpi. Deconz for zigbee.!

Esentially, it’s the spikes on this I want to measure expressed in kWh used:

power|387x341

[CChris (Christoph)]

you have one major issue with your idea.
The meter, which is measuring the total usage of your household cannot be used to measure single devices.

Just imagine the following situation:

your meter is constantly measuring the energy usage of your household.
If you switch your heater on - the energy usage will be increase by x watt… but what happens, if another device will be switched on - or something will be switched off at the same time.

just going for a fix amount of increased power usage does not really help getting reliable information.

[Fete (a.nonym)]

Thanks for your reply! @CChris

The meter is ofc not able to measure single devices by default. But i’m thinking it perhaps could be made “good enough” in some situations.

As for reliability/accuracy, if this could be done, it would get reliable enough information, atleast for me and surely for other ppl with about the same household setup as me. Ie few individual devices that constantly draws the same amount of power when switched on, and if that power is fairly large (6kW in my case).

I agree that if the sensor (or what might work best) starts to measure and “record” the energy usage if it’s increased by a certain W, also will “get” any eventual devices that are switched on after the one you want to measure. That might be counter measured in code or by some other magic I’ve seen users here do. But if not, thats where my thought came in of using “time between power usage in W increased by X amount until it decreased by X amount” and then translate it into kWh.

You don’t think it can be done?

[OzGav]

Yes I would suggest you look at the Powercalc custom component.

Powercalc - Virtual power sensors

In the last few weeks I have been working on a custom component to get virtual power sensors for your lights or other devices. It is stable enough right now to share it on this forum and make dedicated topic for it. The component provides multiple strategies to calculate estimated power consumption. One of the most interesting is the LUT method (using lookup tables). Some community members and me have taken measurements for all kind of different brightness/hue/saturation settings and their resp…

I would create a binary sensor heater_on and then create an automation that flips that to true when your consumption goes over 6000W.

Then you would set up Powercalc with your binary sensor and use a manual power setting of 6000W. Powercalc will then do everything you need (and probably more!)

Of course if anything else puts your consumption over 6000W then you will have inaccuracies….

[e-raser]

How can I delete data from the Energy Dashboard?

I accidentally added the total grid use sensor as single device. Even after having deleted it from that section, all graphs and statistics still fail, everything is rendered useless

Update: solved with/in Energy Management in Home Assistant - #1127 by e-raser.

[sparkydave (🇦🇺 Dave)]

Anyone else have issues adding an Iotawatt calculated output to the Energy dashboard?

I created the outputs as described in the official HA docs but HA won’t let me add the accumulated Wh entities. As far as I know they have the correct attributes.

[OzGav]

The only thing different I see compared to mine is yours has Type: Output but mine has Type: Input

[sparkydave (🇦🇺 Dave)]

@OzGav

mine is yours has Type: Output but mine has Type: Input

That’s just because my example entity above is a calculated output from the iotawatt rather than one of the hard-wired inputs.

Input example:

One thing I’m thinking though is that my entities are in Wh rather than kWh… It seems the Energy dashboard might only accept kWh? Even though the HA docs don’t say we need to create a conversion for the iotawatt sensors.

[OzGav]

No I found this one that appears in the drop down list of the energy configuration. I have lots that are Wh

[sparkydave (🇦🇺 Dave)]

Well then I have no idea why I can’t add any of the iotawatt entities to the Energy dashboard then. It’s odd because I’ve simply followed the HA docs… It was easier using the custom component

[OzGav]

Yeah not sure sorry. Im not using the offical add-on… Maybe try the Iotawatt thread as you did before?

[sparkydave (🇦🇺 Dave)]

Yeah, I just didn’t want to spam it too much with issues relating to the core integration since that thread is for the custom one. Will try anyway

[arva]

Is there a way to manually correct the data on Energy Management? I had some networks issues yesterday and my Shelly EM3 was offline and came online one yesterday and twice this morning. So my daily, weekly and monthly are quite a bit off now. See the screens:

Day before yesterday, when everything was ok:

Yesterday:

Today:

I would be ok, if i can delete those two spikes and no data for those two days.

[arva]

Turned out it was caused by Shelly EM3. After restar sometimes it will be unavailable and because of that calculation that sums three phases will be 0 for a brief moment and then back to where it really was. Trick was to add availability_template to the template sensor. More here: Shelly 3EM 3-phases Energy sensor - #56 by arva

But now i need to delete those spikes and I don’t know where.

EDIT: Here is a solution how you can delete from the DB: Energy Management in Home Assistant - #455 by markss

[arva]

@markss

For those wanting to dig a little further into their Energy visualisation not working, you can use the “SQLite Web” addon to look under the covers at the statistics and how it works. It appears some entities from plugins will have all the appropriate attributes to appear in here, if yours aren’t, check the posts above that mention last_reset:

        attributes:         
          last_reset: '1970-01-01T00:00:00+00:00'

To get started, you will need to install the SQLite Web addon and open it, you should see something like the following after choosing statistics_meta, then content.

statistics_meta appears to be a master lookup table of all your entities that statistics are being collected on, in my case I am interested in #8:

If you then choose statistics - content you will probably see lots of entries however, I have used the query function command: SELECT * FROM "statistics" where metadata_id = 8 to pull up all entries associated with my solar feed in - there is only one because I have been trying to get my OpenEnergyMonitor configuration working despite the lack of documentation.

If you want to reset the statistics of an entity, you can do it here also, because I have been using a “smart plug” in a variety of places I wanted to reset it so it has clean data for the energy integration.

First: I manually locate it’s ID via statistics_meta and find out it is #2.

Then go to the “Query” tab and to make sure I have everything as correct as possible, I type in:
SELECT * FROM "statistics" where metadata_id = 2 and click execute.

DANGER
If that shows the results that I am expecting, to deleted it, I slightly change the command to:
DELETE FROM "statistics" where metadata_id = 2 and click execute.

It then appears that statistics are generated hourly so that is why you need to wait 2 hours for the visualisation to show any information, but if you go in via the SQLite Web addon you should be able to see some sort of value after 1 hours (on my system it shows as on the hour)

To make this slightly more discoverable, this post is about:
OpenEnergyMonitor (emoncms), EnergyManagement, Statistics, SQLite Web, database cleaning

Thanks for sharing the instructions!

My issue was that Shelly EM was unavailable few times after restarts and template sensor that sums up three phases went to 0 and theb back to real value.

When i investigated database with SQLite Web I saw the problem with some 0 rows and sum lines that were affected. I deleted the 0 rows and corrected the SUM values with UPDATE. Now everything in DB looks good, but Energy Dashboard still shows the wrong numbers.

Any ideas, where the Energy Management gets the (wrong) data?

EDIT: If anyone is using HA in a Docker stack, SQLite Web works neatly with Docker Compose:

  sqliteweb:
    image: tomdesinto/sqliteweb
    ports:
      - 8089:8080
    volumes:
    - ${USERDIR}/docker/homeassistant/home-assistant_v2.db:/db/home-assistant_v2.db
    command: home-assistant_v2.db