Read bitmask value of register in Modbus sensor

@grandslam there already is a python based RSCP lib for E3DC around on github which we could use for a “native” HA component, but I lack the python knowledge to write such an integration. https://github.com/fsantini/python-e3dc/

Yes I know that one already, also contributed to it to include some Quattroporte specific stuff and specific case of my setup.
Also there are some others C-based with specific use cases.
But none of them allow the raw communication as command line utility for easy integration without python knowledge.
I have now complete control just by using the HA command_line platform and can use it also outside from HA.

Side note: also needed a reason to learn go :wink:

Maybe a little bit offtopic, but I have successfully integrated the mod bus read outs from my E3DC, creating multiple sensors for the current power (solar, battery, grid and home) in Watts.
Is it possible to track the energy consuption [Wh] using this information? I came across the utility meter integration, which would track Wh per day, week, year, but as an input already requires a sensor providing information in Wh.

My first step would be to understand how the home consumption can be tracked via an utility meter. Secondly the engery bought from grid over time would be interesting to track. Here the sensor could have positive and negative values (depending on if energy is sold, or bought).

well, shouldn’t you be able to convert W into Wh by creating a template sensor that multiplies the sensor value in W with the update interval of the sensor value (about the timerange this power has been consumed)? Like if the sensor is updated every 2 seconds (not sure wthat the actual interval is), it would be 400 (W) / 3600 (seconds per hour) * 2 (duration in seconds, aka the update interval) = 0,22 Wh or something like that.

It won’t be super accurate since your accuracy is limited to the update interval of the sensor values, but at least should give you compareable results for personal information. The value likely will differ from what you actually have to pay for.

Hello all,

i am preparing home assistant (i am new with HA) to check if everything what i have so far in iobroker can be done also on HA. i found this thread about my e3dc s10 system but i dont get it working. to be honest, i dont know why. i put in the example from lanciafulvia but HA says something about sensor is wrong. maybe formating of text wrong? i played with the formating and got different errors or not. in case of not HA stucks on the proof process.

On logs i found this probem and thats where i stuck:
Logger: aiohttp.server
Source: helpers/config_validation.py:737
First occurred: 13:39:13 (1 occurrences)
Last logged: 13:39:13

Error handling request
Traceback (most recent call last):
File “/usr/local/lib/python3.8/site-packages/aiohttp/web_protocol.py”, line 422, in _handle_request
resp = await self._request_handler(request)
File “/usr/local/lib/python3.8/site-packages/aiohttp/web_app.py”, line 499, in _handle
resp = await handler(request)
File “/usr/local/lib/python3.8/site-packages/aiohttp/web_middlewares.py”, line 119, in impl
return await handler(request)
File “/usr/src/homeassistant/homeassistant/components/http/security_filter.py”, line 56, in security_filter_middleware
return await handler(request)
File “/usr/src/homeassistant/homeassistant/components/http/request_context.py”, line 18, in request_context_middleware
return await handler(request)
File “/usr/src/homeassistant/homeassistant/components/http/ban.py”, line 74, in ban_middleware
return await handler(request)
File “/usr/src/homeassistant/homeassistant/components/http/auth.py”, line 135, in auth_middleware
return await handler(request)
File “/usr/src/homeassistant/homeassistant/components/http/view.py”, line 131, in handle
result = await result
File “/usr/src/homeassistant/homeassistant/components/config/core.py”, line 29, in post
errors = await async_check_ha_config_file(request.app[“hass”])
File “/usr/src/homeassistant/homeassistant/config.py”, line 904, in async_check_ha_config_file
res = await check_config.async_check_ha_config_file(hass)
File “/usr/src/homeassistant/homeassistant/helpers/check_config.py”, line 225, in async_check_ha_config_file
p_validated = platform_schema(p_validated)
File “/usr/local/lib/python3.8/site-packages/voluptuous/schema_builder.py”, line 272, in call
return self._compiled([], data)
File “/usr/local/lib/python3.8/site-packages/voluptuous/schema_builder.py”, line 594, in validate_dict
return base_validate(path, iteritems(data), out)
File “/usr/local/lib/python3.8/site-packages/voluptuous/schema_builder.py”, line 386, in validate_mapping
cval = cvalue(key_path, value)
File “/usr/local/lib/python3.8/site-packages/voluptuous/schema_builder.py”, line 817, in validate_callable
return schema(data)
File “/usr/src/homeassistant/homeassistant/helpers/config_validation.py”, line 486, in verify
return cast(dict, schema(value))
File “/usr/local/lib/python3.8/site-packages/voluptuous/schema_builder.py”, line 272, in call
return self._compiled([], data)
File “/usr/local/lib/python3.8/site-packages/voluptuous/schema_builder.py”, line 594, in validate_dict
return base_validate(path, iteritems(data), out)
File “/usr/local/lib/python3.8/site-packages/voluptuous/schema_builder.py”, line 386, in validate_mapping
cval = cvalue(key_path, value)
File “/usr/local/lib/python3.8/site-packages/voluptuous/validators.py”, line 215, in _run
return self._exec(self._compiled, value, path)
File “/usr/local/lib/python3.8/site-packages/voluptuous/validators.py”, line 339, in _exec
v = func(path, v)
File “/usr/local/lib/python3.8/site-packages/voluptuous/schema_builder.py”, line 817, in validate_callable
return schema(data)
File “/usr/src/homeassistant/homeassistant/helpers/config_validation.py”, line 737, in validator
if key in config:
TypeError: argument of type ‘NoneType’ is not iterable

looks like your configuration is not formatted correctly. YAML needs correct indention (2 spaces per indention level, no tabs).

Btw, the modbus integration now requires a new config structure, all sensors etc within the modbus domain and not each respective sensor domains. So it now is following the new, required HA component structure. My current config looks like this:

Main modbus config

modbus:
  - name: e3dc
    type: tcp
    host: 192.168.0.XXX
    port: 502
    sensors:
      - name: E3DC solar power
        unit_of_measurement: W
        address: 40067
        device_class: power
      - name: E3DC battery power
        unit_of_measurement: W
        address: 40069
        device_class: power
      - name: E3DC battery soc
        unit_of_measurement: '%'
        address: 40082
        data_type: uint
        device_class: battery
      - name: E3DC power consumption
        unit_of_measurement: W
        address: 40071
        device_class: power
      - name: E3DC grid power
        unit_of_measurement: W
        address: 40073
        device_class: power
      - name: E3DC emergency power state
        data_type: uint
        address: 40083
      - name: E3DC EMS state
        data_type: uint
        address: 40084
      - name: E3DC autarky and consumption
        data_type: uint
        address: 40081
      - name: E3DC string 1 power
        data_type: uint
        address: 40101
        device_class: power
        unit_of_measurement: W
      - name: E3DC string 2 power
        data_type: uint
        address: 40102
        device_class: power
        unit_of_measurement: W
      - name: E3DC powermeter 1 L1
        data_type: int
        address: 40105
        device_class: power
        unit_of_measurement: W
      - name: E3DC powermeter 1 L2
        data_type: int
        address: 40106
        device_class: power
        unit_of_measurement: W
      - name: E3DC powermeter 1 L3
        data_type: int
        address: 40107
        device_class: power
        unit_of_measurement: W

Some binary sensors to prettify some of the modbus values

binary_sensor:
  - platform: template
    sensors:
      e3dc_emergency_power_possible:
        friendly_name: "E3DC Emergency Power possible"
        value_template: "{{ states('sensor.e3dc_ems_state')|int|bitwise_and(4) > 0 }}"
      e3dc_battery_loading_blocked:
        friendly_name: "E3DC Battery loading blocked"
        value_template: "{{ states('sensor.e3dc_ems_state')|int|bitwise_and(1) > 0 }}"
      e3dc_battery_unloading_blocked:
        friendly_name: "E3DC Battery unloading blocked"
        value_template: "{{ states('sensor.e3dc_ems_state')|int|bitwise_and(2) > 0 }}"
      e3dc_weather_based_loading:
        friendly_name: "E3DC weather based loading limiter"
        value_template: "{{ states('sensor.e3dc_ems_state')|int|bitwise_and(8) > 0 }}"
      e3dc_power_limiter:
        friendly_name: "E3DC power limiter"
        value_template: "{{ states('sensor.e3dc_ems_state')|int|bitwise_and(16) > 0 }}"
      e3dc_smartcharge_loading_blocked:
        friendly_name: "E3DC SmartCharge loading blocked"
        value_template: "{{ states('sensor.e3dc_ems_state')|int|bitwise_and(32) > 0 }}"
      e3dc_smartcharge_unloading_blocked:
        friendly_name: "E3DC SmartCharge unloading blocked"
        value_template: "{{ states('sensor.e3dc_ems_state')|int|bitwise_and(64) > 0 }}"
      e3dc_emergency_power_active:
        friendly_name: "E3DC Emergency Power Mode Active"
        value_template: "{{ is_state('sensor.e3dc_emergency_power_state', '1') }}"
      e3dc_emergency_power_available:
        friendly_name: "E3DC Emergency Power Available"
        value_template: "{{ is_state('sensor.e3dc_emergency_power_state', '1') or is_state('sensor.e3dc_emergency_power_state', '2') }}"
        device_class: "power"

And finally some sensors which I use in conjunction with the power-distribution card

sensor:
  - platform: template
    sensors:
      e3dc_autarky:
        friendly_name: 'E3DC Autarky'
        unit_of_measurement: '%'
        value_template: "{{ (states('sensor.e3dc_autarky_and_consumption')|int / 256)|round(0,'floor') }}"
      e3dc_own_consumption:
        friendly_name: 'E3DC Own Consumption ratio'
        unit_of_measurement: '%'
        value_template: "{{ ((states('sensor.e3dc_autarky_and_consumption')|int / 256 - states('sensor.e3dc_autarky')|int) * 256)|round(0,'floor') }}"
2 Likes

thx very much da-anda, indeed, it was the formatting. i did a quick test and everything looks fine so far.
Danke! :slight_smile:

Wohoo!

Nice!
Config valid, i get the e3dc states et all, but no data:

2021-05-18 17:51:27 ERROR (SyncWorker_9) [homeassistant.components.modbus.modbus] Pymodbus: Modbus Error: [Connection] ModbusTcpClient(10.2.1.10:502): Connection unexpectedly closed 0.000040 seconds into read of 8 bytes without response from unit before it closed connection

Port is open, tho:

nmap 10.2.1.10 -p 502
Starting Nmap 7.80 ( https://nmap.org ) at 2021-05-18 17:52 CEST
Nmap scan report for 10.2.1.10
Host is up (0.00037s latency).

PORT STATE SERVICE
502/tcp open mbap

Any advice, please? :slight_smile:

do you get no data at all or just some? Please make sure that the Modbus mode in your E3DC is NOT(!) set to “sunspec mode”, as that one will only provide a fraction of the data. No idea otherwise though.

Good push in the right direction:

Turns out the querying server must be in the same subnet as the e3dc, else RST is sent.
NAT’ed the query; bam works :slight_smile:

Hey,

is it somehow possible to enable the new Energy Grid thing with this?

Sure, you need to create some specific sensors and integration sensors, but it does work. See this topic for some hints. At the time of this topic there was no support yet for the batteries. These require further sensors to be created.

But do not expect a perfect accuracy compared to the E3DC Webinterface. For it to be accurate, we’d need direct access to the energy values (kWh) instead of the power read outs. I opened a ticket with E3DC and requested an update to the Modbus interface. Maybe if enough people request this feature, they will be willing to adapt.

WOW, just WOW
exactly what i was looking for. Thank you da-anda!

What is important to know is that E3DC Modbus ONLY accepts traffice from the same subnet.

  • Set up NAT/masquerade
  • Move to the same subnet

Now it is working fine.
thank you for your efforts!
much appreciated.

Legi,
would you mind to share the YAML Code for your lovely chart of the Fotovoltank?

Locks like the one i can see from e3dc.
Would love to have this as well.
thanks
armin

Glad you could sort out the networking issues, wouldn’t have had any idea what to tell.

As for the lovelace card - check HACS for the power-distribution-card or install it manually from here GitHub - JonahKr/power-distribution-card: A Lovelace Card for visualizing power distributions.

Thanks da-anda

well, had to move the server at the end and get rid of my dmz. NAT should have worked but didn’t.
Took a few paket traces and had loads of retransmissions. So it was easier for me to move the server.

I will take a look at the link. But have to say that i am a “copy & paste” programmer :slight_smile: lets see how far my skills can go.
Another thing is that i do run my system in docker so no supervisior is there.
But hey actually i am proud. A week ago i did not even knew what home automation could give me.
Ordered some ikea lamps… very curious about it…

cheers A.

Same here… I just checked and found

So something has to be added and you can use status attributes on the developer tools tab.
Some also put it into the customization.yamls. Looks like wildcards working as well.

cheers A

@ArminF well, easiest way to install custom components is via HACS, so follow it’s install instructions (will also run in your setup) and installing community components is as simple as one click. https://hacs.xyz/

Aloha da-anda

Thanks! I could install HACS and guess what… even i could do it :slight_smile:
works like a charm. I am very happy.
No i need check how i get this energy stuff up and running.

Evening,
all up and running. maybe some fine tuning here and there. But for now i am very pround

DId anyone of you activated the Energy Management?
I did and figured most of it out.
There seems to be a battery check every morning on the E3DC as i get some charge/discharge values even when there is no solar power and battery is not in discharge.

2021-11-21_21-16-00

Do you get the same? I do not think my settings are wrong actually. Checked them several times.
For the entities i used a template sensor and integration for the conversion from watt to kwh.
Sensors i had to split into only positive values by using ABS.
thanks A