I worked it out just after publishing this message, I hadn’t inputted my MQTT Username & Password!!
[quote=“Frank_R, post:17, topic:70109”]
The scrape node does:
curl ‘http://:@192.168.x.x/status.html’
Then the grab nodes use regex to grab the values.
Until today I’d never heard of regex never mind use it!
Could you please give some advice on setting it up
I now have the inverter communicating via mqtt (I think) but do not know what to do or where to find the scraped data
When I carry out a ping check in Node-Red I get these messages
1/28/2021, 10:27:38 AMnode: Grab current power valuefunction : (error)
“TypeError: Cannot read property ‘1’ of null”
1/28/2021, 10:27:38 AMnode: Grab total power today valuefunction : (error)
“TypeError: Cannot read property ‘1’ of null”
1/28/2021, 10:27:38 AMnode: Grab total power valuefunction : (error)
“TypeError: msg.payload.match is not a function”
Can anyone offer assistance please
Difficult to troubleshoot.
-
Can you ping your wifi stick and login to the web interface using a normal browser.
-
Try this updated flow. After a certain Node-Red update (while ago, can’t remember) the ping node stopped working.
[{"id":"a6c69280.aefa","type":"tab","label":"Solis","disabled":false,"info":""},{"id":"8d3fd5ff.a575d8","type":"mqtt out","z":"a6c69280.aefa","name":"Publish MQTT Message","topic":"","qos":"","retain":"true","broker":"36d42be1.7a03e4","x":1150,"y":500,"wires":[]},{"id":"6315810.eba6a8","type":"ping","z":"a6c69280.aefa","mode":"timed","name":"Ping Solis Convertor","host":"192.168.2.25","timer":"60","inputs":0,"x":110,"y":280,"wires":[[]]},{"id":"9977c825.5888d8","type":"switch","z":"a6c69280.aefa","name":"Check if convertor is online","property":"payload","propertyType":"msg","rules":[{"t":"false"},{"t":"gt","v":"0","vt":"num"}],"checkall":"true","repair":false,"outputs":2,"x":200,"y":400,"wires":[["71244c20.72e364","b51741e5.39a3d"],["5af351cf.e8d92"]]},{"id":"24252177.a3d88e","type":"function","z":"a6c69280.aefa","name":"Grab current power value","func":"var parts = msg.payload.match(/webdata_now_p\\s=\\s\"(\\d+)\"/);\nmsg.payload = {\n value: parts[1],\n};\nreturn msg;","outputs":1,"noerr":0,"initialize":"","finalize":"","x":470,"y":480,"wires":[["e7aaad99.13a0c"]]},{"id":"5af351cf.e8d92","type":"exec","z":"a6c69280.aefa","command":"curl 'http://username:[email protected]/status.html'","addpay":true,"append":"","useSpawn":"false","timer":"10","oldrc":false,"name":"Scrape web interface","x":180,"y":480,"wires":[["24252177.a3d88e","35f76747.bda408","10bd3393.9a038c"],[],[]]},{"id":"71244c20.72e364","type":"change","z":"a6c69280.aefa","name":"Prepare message","rules":[{"t":"set","p":"topic","pt":"msg","to":"Solis_Power_Current","tot":"str"},{"t":"set","p":"payload","pt":"msg","to":"0","tot":"num"}],"action":"","property":"","from":"","to":"","reg":false,"x":730,"y":340,"wires":[["8d3fd5ff.a575d8"]]},{"id":"e7aaad99.13a0c","type":"change","z":"a6c69280.aefa","name":"Prepare message","rules":[{"t":"set","p":"topic","pt":"msg","to":"Solis_Power_Current","tot":"str"},{"t":"move","p":"payload.value","pt":"msg","to":"payload","tot":"msg"},{"t":"delete","p":"rc","pt":"msg"}],"action":"","property":"","from":"","to":"","reg":false,"x":730,"y":480,"wires":[["a54e4318.609bb"]]},{"id":"35f76747.bda408","type":"function","z":"a6c69280.aefa","name":"Grab total power today value","func":"var parts = msg.payload.match(/webdata_today_e\\s=\\s\"(\\S+)\"/);\nmsg.payload = {\n value: parts[1],\n};\nreturn msg;","outputs":1,"noerr":0,"x":480,"y":520,"wires":[["ec1f587c.99d7a8"]]},{"id":"ec1f587c.99d7a8","type":"change","z":"a6c69280.aefa","name":"Prepare message","rules":[{"t":"set","p":"topic","pt":"msg","to":"Solis_Power_Today","tot":"str"},{"t":"move","p":"payload.value","pt":"msg","to":"payload","tot":"msg"},{"t":"delete","p":"rc","pt":"msg"}],"action":"","property":"","from":"","to":"","reg":false,"x":730,"y":520,"wires":[["8d3fd5ff.a575d8"]]},{"id":"10bd3393.9a038c","type":"function","z":"a6c69280.aefa","name":"Grab total power value","func":"var parts = msg.payload.match(/webdata_total_e\\s=\\s\"(\\S+)\"/);\nmsg.payload = {\n value: parts[1],\n};\nreturn msg;","outputs":1,"noerr":0,"x":460,"y":560,"wires":[["8a30c6ed.9b75d8"]]},{"id":"8a30c6ed.9b75d8","type":"change","z":"a6c69280.aefa","name":"Prepare message","rules":[{"t":"set","p":"topic","pt":"msg","to":"Solis_Power_Total","tot":"str"},{"t":"move","p":"payload.value","pt":"msg","to":"payload","tot":"msg"},{"t":"delete","p":"rc","pt":"msg"}],"action":"","property":"","from":"","to":"","reg":false,"x":730,"y":560,"wires":[["8d3fd5ff.a575d8"]]},{"id":"b51741e5.39a3d","type":"timecheck","z":"a6c69280.aefa","name":"Midnight","time":"23:58","x":500,"y":400,"wires":[["4869bc6c.1cf2c4"],[]]},{"id":"4869bc6c.1cf2c4","type":"change","z":"a6c69280.aefa","name":"Prepare message","rules":[{"t":"set","p":"topic","pt":"msg","to":"Solis_Power_Today","tot":"str"},{"t":"set","p":"payload","pt":"msg","to":"0","tot":"num"}],"action":"","property":"","from":"","to":"","reg":false,"x":730,"y":380,"wires":[["8d3fd5ff.a575d8"]]},{"id":"a54e4318.609bb","type":"function","z":"a6c69280.aefa","name":"to kW","func":"msg.payload = Number(msg.payload);\nmsg.payload = (msg.payload)/1000;\nreturn msg;","outputs":1,"noerr":0,"initialize":"","finalize":"","x":890,"y":480,"wires":[["8d3fd5ff.a575d8"]]},{"id":"d3756928.2025d8","type":"ping","z":"a6c69280.aefa","mode":"triggered","name":"Ping Solis Convertor","host":"","timer":"20","inputs":1,"x":190,"y":240,"wires":[["9977c825.5888d8"]]},{"id":"2311af6d.9be32","type":"inject","z":"a6c69280.aefa","name":"Ping trigger","props":[{"p":"payload"},{"p":"topic","vt":"str"}],"repeat":"60","crontab":"","once":false,"onceDelay":0.1,"topic":"","payload":"[{\"host\":\"192.168.2.25\",\"timeout\":15000}]","payloadType":"json","x":130,"y":160,"wires":[["d3756928.2025d8"]]},{"id":"36d42be1.7a03e4","type":"mqtt-broker","name":"mqtt_broker","broker":"localhost","port":"1883","clientid":"","usetls":false,"compatmode":false,"keepalive":"60","cleansession":true,"birthTopic":"","birthQos":"0","birthPayload":"","closeTopic":"","closeQos":"0","closePayload":"","willTopic":"","willQos":"0","willPayload":""}]
- If ping works again, please post output of the scrape node. maybe your web interface (and output) is slightly different. You can try regex101.com and paste your output in the text box, then tru the regex to see how it works.
1 Like
I’m new to setting anything up using mqtt, the only devices I’ve really done anything with that are mqtt are smart plugs and bulbs that I have flashed with tasmota and then they show as devices in mqtt
Questions & Answers
- Yes I can login using the wifi sticks local IP address
- I’ve done a ping test using Windows cmd and it passed ok
- I’ve loaded the new flow and everything appears OK and my mqtt broker log shows a connected
1611922381: New connection from xxx.xx.xx.x on port 1883.
1611922381: New client connected from xxx.xx.xx.x as Solis_Inverter (p2, c1, k60, u’MQTT’). - Should this create an entry in my integrations in entities or devices?
Will this help?
Ive attached a debug to the scrape in node-red and this is the result
1/29/2021, 2:04:42 PMnode: Grab current power valuefunction : (error)
“TypeError: Cannot read property ‘1’ of null”
1/29/2021, 2:04:42 PMnode: Grab total power today valuefunction : (error)
“TypeError: Cannot read property ‘1’ of null”
1/29/2021, 2:04:42 PMnode: Grab total power valuefunction : (error)
“TypeError: Cannot read property ‘1’ of null”
1/29/2021, 2:04:42 PMnode: 73368a0f.e61e44192.168.1.115 : msg.payload : string[7425]
“ addCfg(‘wifi_on’,0x0f070200,‘enable’);↵addCfg(‘sta_ssid’,0x04df0200,‘KLS-5810G 2.4GHz’);↵addCfg(‘ap_ssid’,xxxxxxxx,‘AP_xxxxxxxx’);↵addCfg(‘lan_ip’,xxxxxxxx,‘xx.xx.xxx.xxx’);↵addCfg(‘sta_enable’,0x04d40100,‘1’);↵ var st_con1=”“; var st_con2=”“; var st_con3=”“; function status(re) { var st_en=window.parent.reTip(“3”); var st_dis=window.parent.reTip(“4”); if(re.charAt(0)==“1”) { st_con1=“3”; document.getElementById(“cover_remote_status_a”).innerHTML=st_en; }else { st_con1=“4”; document.getElementById(“cover_remote_status_a”).in…”
I’ve xxx some data
It does appear to communicate with the inverter
Thanks again for your assistance
When I login to my inverter via a web page the 1st page I see is this (is yours similar)
Device information
Device serial number
613xxxxxx
Firmware version
H4.01.51Y4.0.02W1.0.57(2017-08-312-D)
Wireless AP mode
Enable
SSID
AP_613xxxxxx
IP address
xx.xx.xxx.xxx
MAC address
xx:xx:xx:xx:xx:xx
Wireless STA mode
Enable
Router SSID
KLS-5810G 2.4GHz
Signal Quality
34%
IP address
192.168.1.115
MAC address
xx:xx:xx:xx:xx:xx
Cable mode
Disable
IP address
MAC address
Connected Inverter
Type
Ginlong
Number
1
Inverter serial number
Firmware version (main)
006
Firmware version (slave)
Inverter model
0
Rated power
Current power
Yield today
0 kWh
Total yield
1311 kWh
Alerts
Last updated
0 Min Ago
Remote server information
Remote server A
Pingable
Remote server B
Pingable
Remote server C
Unpingable
As I seem to have hit a brick wall using the node-red method I thought I’d try the script method
Unfortunately I’ve hit problems again early on
Having NEVER used scripts in HA I have zero experience
I’ve copied cpuram’s script into my scripts.yaml file then saved & carried out a “Check Configuration” before restarting HA but I get an error
Error loading /config/configuration.yaml: mapping values are not allowed here
in “/config/scripts.yaml”, line 10, column 34
ANY assistance with either this method or the node-red method would be very much appreciated
@xion2000 I was able to add a PV sensor without any scripts or mqtt, just by calling inverter stick http (adjust ip/password values for your setup):
configuration.yaml
sensor:
- platform: rest
resource: http://192.168.1.14/status.html
authentication: basic
username: admin
password: XXXXX
unit_of_measurement: 'W'
value_template: '{{ value | regex_findall_index("var webdata_now_p = \"(\d+)\"")}}'
device_class: power
name : Solis
3 Likes
Thanks Iknop I’ve tried that but still no success
I’ve logged into the wifi stick / Solis Inverter and this is my status screen (I’ve edited some data out)
Device information
Device serial number
613496541
Firmware version
H4.01.51Y4.0.02W1.0.57(2017-08-312-D)
Wireless AP mode
Enable
SSID
xxxxxxxxxx
IP address
xx.xx.xxx.xxx
MAC address
xx:xx:xx:xx:xx:xx
Wireless STA mode
Enable
Router SSID
xxxxxxxxxxxxxxx
Signal Quality
24%
IP address
192.168.1.115
MAC address
xx:xx:xx:xx:xx:xx
Cable mode
Disable
IP address
MAC address
Connected Inverter
Type
Ginlong
Number
1
Inverter serial number
Firmware version (main)
006
Firmware version (slave)
Inverter model
0
Rated power
Current power
—
Yield today
0 kWh
Total yield
1313 kWh
Alerts
—
Last updated
0 Min Ago
Remote server information
Remote server A
Remote server B
Remote server C
What I find strange is “Current Power” always shows ---- but if I login to the Ginlong v2 website (or the old version 1 website which is still running) its uploading data fine
Thanks very much never thought to just scrape off the invertor panel, I now use a modified version! I added a timer that loops back around so it posts every minute and i used a node red entity so it just updates that instead of broadcasting to mqtt. The ping stuff didn’t seem to work so i killed all that and it seems to run fine.
Its not perfect as a cloud goes over and it dumps the input down for the minute but its enough to know if its a high solar or low solar output day which will be impacting my aircon settings shortly.
2 Likes
Did some research on this today. The file status.html is created each time the master.js and subsequently slave.js have been called. In my case, it was empty and only contained some horizontal lines.
The thing is that for populating the status.html page, the javascript file ‘status.js’ calls a json function through AJAX. If you run that against your Ginlong convertor, it should provide a json output. Try this:
http://p.q.r.s/status.json?CMD=inv_query
p.q.r.s obviously the IP address of your convertor.
Package that into a sensor:
- platform: rest
resource: http://192.168.1.4/status.json?CMD=inv_query
name: Solar power
json_attributes:
- i_pow_n
- i_eday
- i_eall
value_template: '{{ value_json.name }}'
- platform: template
sensors:
power_now:
friendly_name: "Current power"
value_template: '{{ states.sensor.solar_power.attributes["i_pow_n"] }}'
unit_of_measurement: W
energy_today:
friendly_name: "Energy today"
value_template: '{{ states.sensor.solar_power.attributes["i_eday"] }}'
unit_of_measurement: kWh
Worked for me.
– EDIT –
The inverter itself also consumes energy. It seems to be 224W, because this is the figure it remains reporting, even when the output power drops to zero. At the end of the day we are focused on what the solar panels deliver to the grid and as such we need to reduce the power with that consumed power.
Likewise we are reducing the produced energy the same way. In the returned JSON file, the inverter reports the ‘uptime’ (g_time in seconds), but that figure is highly inaccurate. Specifically during cloudy days the inverter may shut down if the produced solar energy is not sufficient to even power the inverter. So I am using the time the sun rose above the horizon. This is the latest code:
- platform: template
sensors:
power_now:
friendly_name: "Current power"
value_template: >-
{% if is_state("sun.sun", "above_horizon") -%}
{{ states.sensor.solar_power.attributes["i_pow_n"]-224 }}'
{%- endif %}
unit_of_measurement: W
energy_today:
friendly_name: "Energy today"
value_template: >-
{% if is_state("sun.sun", "above_horizon") -%}
{% set uptime = as_timestamp(now()) - as_timestamp(states.sun.sun.last_changed) + 3600-%}
{{ (states.sensor.solar_power.attributes["i_eday"]|float-((224/1000)*(uptime/3600)))|round(3)}}
{%- endif %}
unit_of_measurement: kWh
Good luck
1 Like
Hello
I think it depends on version of logger.
Mine is:
Firmware version (main)001B
Firmware version (slave)002B
Everything in my browser is on the same IP adress, there is no other sub-sites.
So it dosen’t work
http://192.168.x.x/status.html
or
http://192.168.x.x/status.json?CMD=inv_query
I tried to reduce only to IP adres but any of above example dosen’t work.
Do you have any idea what to check or change?
regards
It must be a firmware issue then. Here’s mine, which works perfectly OK.
So yours does not produce any output on http://192.168.1.8/status.json?CMD=inv_query ?
Can you go into developer mode in Google Chrome to try and find the source of the information that displays the page? From there you may run into some kind of json request.
Confirm,
http://192.168.1.8/status.json?CMD=inv_query
I got:
ERROR:404 Not Found
And I think it’s the matter of firmware.
In my side there is no information about “Brand”, and “Last updated” is only “0”, “1” and nothing.
But…
It is also matter of my little experience …
In my browser there is no site status.html but the way of scraping the page is working…
So I define the sensors (like lknop proposed) and … it works! 
I think I will not drill down the case, thanks all for help
regards
atryda
Did u get it in homeassistant?
How to grab data as I have same problem as yours.
Please guide
Yes, sure
I defined two sensors in config.yaml:
Replace xxxxx with your own password and change IP to yours.
But I know that there are a few version of this page, so I am not sure this will work for you
regards
- platform: rest
resource: http://192.168.1.8/status.html
authentication: basic
username: admin
password: admin
unit_of_measurement: 'W'
value_template: '{{ value | regex_findall_index("var webdata_now_p = \"(\d+)\"")}}'
device_class: power
name: "Solis current power"
- platform: rest
resource: http://192.168.1.8/status.html
authentication: basic
username: admin
password: admin
unit_of_measurement: 'kWh'
value_template: '{{ value | regex_findall_index("var webdata_today_e = \"(\S+)\"")}}'
device_class: power
name: "Solis energy today"
3 Likes
Dear, o u get results?
as i dont
and did you upgrade device?
invalid config for [sensor.rest]: invalid template (TemplateSyntaxError: unexpected char ‘“’ at 32) for dictionary value @ data[‘value_template’]. Got ‘‘{{ value | regex_findall_index(“var webdata_now_p = “(\d+)””)}}’’. (See ?, line ?)
Yes, it works:
Mine PV was instaled October 2020, so I didn’t upgrade any firmware.
I suppose it could be the matter of your enviroment.
What kind of instalatian have you?
Mine is HA OS on t630 terminal.
I have such parameters:
| version | core-2021.3.2 |
|---|---|
| installation_type | Home Assistant OS |
| dev | false |
| hassio | true |
| docker | true |
| virtualenv | false |
| python_version | 3.8.7 |
| os_name | Linux |
| os_version | 5.4.99 |
| arch | x86_64 |
| timezone | Europe/Warsaw |
What has happen if you on terminal console put such commend:
curl ‘http://admin:[email protected]/status.html’ | grep ‘var webdata_now’
Of course replace xxxxx with password 
Have you any data?
regards
Hi all, thought this might be of interest:
Solis Inverter Modbus integration - Configuration - Home Assistant Community (home-assistant.io)
I have managed to make a direct modbus connection and can get all the normal stats. Just having issues with reading and writing to the read/write registries so I can control it for community energy projects.
1 Like
What can be done in order to get all data
Like current power, energy today, energy total, pv1, pv2 etc
one more thing to know.
does data shows after sunset? if not how to make it show last reading after sunset?
thanks
@kirpat You can duplicate the sensor, and get other fields, this is what I use:
sensor:
- platform: rest
resource: http://192.168.1.52/status.html
authentication: basic
username: admin
password: XXXX
unit_of_measurement: 'W'
value_template: '{{ value | regex_findall_index("var webdata_now_p = \"(\d+)\"")}}'
device_class: power
name : Solis
- platform: rest
resource: http://192.168.1.52/status.html
authentication: basic
username: admin
password: XXXX
unit_of_measurement: 'kWh'
value_template: '{{ value | regex_findall_index("var webdata_today_e = \"(.+)\"")}}'
device_class: power
name : Panels today
scan_interval: 300
At night the inverter has no power and does not respond. You can take a look here, user @shawly has created a proxy that can provide default responses when the target rest server is offline:
