ESB Smart Meter Power Usage Integration

Energy
1

In Ireland, we have a ESB Smart Meter which returns the In and Out usage of power by a home every 30mins. There is an API which returns this csv format data.

I’d like to create a HA integration/add-on which gets the data and then records the values into a format which HA can leverage.

This is an existing repo which has the steps for the login and downloading of the csv data

and I’d hope to reuse/integrate this with the Restful API/Scraper functions from HA.

The format of the csv data is shown below

MPRN,Meter Serial Number,Read Value,Read Type,Read Date and End Time
100012XYZ,33831590,0.006000,Active Import Interval (kW),07-06-2024 01:00
100012XYZ,33831590,0.008000,Active Export Interval (kW),07-06-2024 01:00
100012XYZ,33831590,0.009000,Active Export Interval (kW),07-06-2024 00:30
100012XYZ,33831590,0.006000,Active Import Interval (kW),07-06-2024 00:30

My question is how should i transpose this data feed and what sdk/api from HA should i call so i can track the kW In and Out usage.

Any advise/pointers would be appreciated.
Thanks

1 Like
2

References

3
4

Do you use MariaDB or InfluxDB with your HA instance? You could insert the data there

5

have a look at Reading multiple rows from csv - #12 by VDRainer and it might give you a pointer in terms of reading from the CSV you have…

beyond me before I say it…but ideally we’d get the original script you linked to working with pyscript (or similar) so we could call it as a service direct from HA and update sensor data from there. From a similar perspective there are some scripts floating around Boards that will pull the Met Eireann solar forecast into HA sensors so that’s kind of what I’m on about (Boards is an Irish multi-topic general forum for anyone not familiar with it boards.ie - Wikipedia)

6

I’ve found the ESBN HDF files to be poor in terms of data quality. Missing data for days on end (presumably some ETL process has fallen over) etc.

Perhaps our efforts would be better focused on getting ESBN to enable the P1 port on the smart meters. That would give realtime billing data.

2 Likes
7

The last response I got from them on that was that they were looking to roll that out late 24/25, so I mean its not completely off the cards, but why in gods name not just have in activated from day 1!!!

1 Like
8

Would be interested in this, or in hearing about any ways people are leveraging ESB smart meter data.

1 Like
9

Out of interest how did you contact them maybe a few more mails from other might get the ball rolling

10

Any luck with progressing this anyone? Would be happy to send an email to ESB to help promote the request. What email address did you use? @Rattlehead?

1 Like
11

Same here would love to get access to the P1 port and extract the data.

12

has anyone contacted ESB? Im also happy to send an email if we find out who to actually send it to? So it actually goes to the right people

13

Absolutely we need to to get that P1 port unlocked in Ireland. We must be a decade behind other European countries that have had this option for years now… I contacted ESB about this and was told it’s something that is not in the roadmap but might be considered in a few years. :frowning_face:

Worse yet, the smart meter customer service rep had to disappear for 15 minutes just to try and figure out what I meant by P1 port.

Time to contact local TDs perhaps? Only Ireland could spend so much money upgrading everyone to smart meters but then fail to enable them for local data readings.

If you’re reading this and are frustrated please contact ESB yourself to keep the pressure up…

3 Likes
14

I also hope we get a more direct / live solution as the Python script is great but super limited due to API on ESB site being so restrictive…

15

This is the response I got from ESB. So hopefully something is coming.

In 2017 the Commission for Regulation of Utilities (CRU) agreed a phased approach to the smart metering roll out and ESB Networks. Currently the P1 port on all the smart meters is disabled and will not send any information if the customer plugs in a device. Port 1 enablement is planned for Q4 2025.

Starting 2025, ESB Networks will offer guidance to customers on how to access near real-time information from the smart meter.

Initially, an LED Pulse Monitor will be available, which can connect to third-party apps and devices.

We are engaging with our meter manufacturers and working through the details of enabling the P1 port. Please bear with us over the next few months as this work is conducted and look for updates on our website towards the end of this year.

2 Likes
16

A friend has said to me the other day that he got a letter saying that there would be some USB device coming to monitor he usage from the ESB networks. I did ask him to send me a photo of it as I wanted to take this up with the ESB networks to see if this is a fake letter.

I am wondering did anyone get a letter like this.

17

Folks a shelly EM is a lot more straightforward and in my usage gives very similar readings to what is coming from the smart meter.

18

I have a Shelly EM its ok but the Power factor is a pain on it as I can not disable it. I like to see my true reading of what I am using there and then as in now not having to work it out with the power factor every time.

19

I must be missing something I can see exactly what I am using at any time on the shelly app and I have all the data coming into HA hourly.

20

I want to see my entire houses consumption, my understanding is that the shelly EM is a single unit on a single plug, monitoring just that plug?