Ecowater softener -> how to integrate this python script?

kalhimeo · March 20, 2020, 10:41pm

Hi, thank you both for your replies.

I am running hass.io , not sure how to run the script as daemon though

majdzik84 · March 21, 2020, 5:27pm

I tried to run ecowater.py at the Putty terminal. I have hassio in ubuntu docker.

I think it fired correctly.

Enter the command
"user @ server: ~ $ python3 /usr/share/hassio/homeassistant/python_scripts/ecowater.py

It stops at ‘out_of_salt’ - I don’t have a device connected yet, so probably because I haven’t read anything.

kalhimeo · March 22, 2020, 5:17pm

Hi majdzik,

Thank you for your feedback.

I am running Hass.io, if I try to run a python command in the ssh terminal it says “command not found”. There is no “/usr/bin/python3” installed. I don’t know how Hass.io is supposed to run python scripts

majdzik84 · March 22, 2020, 6:44pm

Hi,
Maybe you don’t do this while logged in to the hassio terminal.
What machine do you have hassio placed on? Rapberry? Try to run the script from the main machine system (root). I made CRON to run the script every 1 min.

kalhimeo · March 23, 2020, 10:11am

I used the “Terminal & SSH” add-on from the hass.io supervisor store.
I am running hass.io as a virtual machine on a VMware ESXi Supervisor. I understand the principle of running the script via python command line and add it as a cron, but to be honest I am a bit confused about how hass.io is working with it s own virtual layers and what to connect with SSH then

Kchaney9 · May 17, 2020, 7:42pm

I’ve been trying to see if it’s possible to just use the webpage card to access wifi.ecowater.com where they have graphs for salt levels, water usage, current water flow, average daily water usage, and projected number of days left. Unfortunately I just get an error message saying the site was “blocked by response.”

kalhimeo · July 29, 2020, 9:33pm

So after going further and further with my HA installation, I managed to convert the python script from Kyle Johnson to an AppDaemon app

Here is the code of the ecowater.py file (to be placed in the ‘appdaemon\apps’ folder) :

import mqttapi as mqtt
import datetime
from datetime import timedelta
import requests
import json
import re

#
# Retrieve data from EcoWater interface and publish to MQTT
#
# Args: ecowater_minutes, ecowater_dsn, ecowater_email, ecowater_password
#
# Credits : Thanks to Kyle Johnson for the original code (https://www.gnulnx.net/2020/02/18/ecowater-api-scraping/)
#
# Converted to AppDaemon by kalhimeo
#

class EcoWater(mqtt.Mqtt):

  def initialize(self):

    # Run every X minutes
    self.run_every(self.run_parsing, datetime.datetime.now() + timedelta(seconds=3), self.args["ecowater_minutes"] * 60)
	
  def run_parsing(self, kwargs):
	
    # Regex to match the hidden input on the initial log in page
    request_validation_re = re.compile(r'<input name="__RequestVerificationToken" type="hidden" value="(.*?)" />')

    # The serial number of your ecowater device
    dsn = { "dsn": self.args["ecowater_dsn"], }

    # The initial form data
    payload = {
        "Email" : self.args["ecowater_email"],
        "Password" : self.args["ecowater_password"],
        "Remember" : 'false'
    }
	
    # The headers needed for the JSON request
    headers = {
        'Accept': '*/*',
        'Accept-Encoding': 'gzip, deflate, br',
        'Accept-Language' : 'en-US,en;q=0.5',
        'X-Requested-With': 'XMLHttpRequest',
        'Content-Type': 'application/x-www-form-urlencoded; charset=UTF-8',
        'User-Agent': 'Mozilla/5.0 (X11; Ubuntu; Linux x86_64; rv:73.0) Gecko/20100101 Firefox/73.0'
    }

    with requests.Session() as s:
        # Initial GET request
        g = s.get('https://www.wifi.ecowater.com/Site/Login')

        # Grab the token from the hidden input
        tokens = request_validation_re.findall(g.text)

        # Add the token to the form data payload
        payload['__RequestVerificationToken'] = tokens[0]

        # Log in to the site
        login = s.post('https://www.wifi.ecowater.com/Site/Login', data=payload)

        # Add the correct Referer header
        headers['Referer'] = login.url + '/' + dsn['dsn']

        # Query the JSON endpoint for the data that we actually want
        data = s.post('https://www.wifi.ecowater.com/Dashboard/UpdateFrequentData', data=dsn, headers=headers)

        # Load the data in to json
        jsonv = json.loads(data.text)

        # Delete the elements that we don't want
        del jsonv['water_units']
        del jsonv['time']

        # Publish each piece of json data in to mqtt
        for d in jsonv:
            self.mqtt_publish('ecowater/' + d, jsonv[d])

You need to add the app in the apps.yaml and provide some parameters :

EcoWater:
  module: ecowater
  class: EcoWater
  ecowater_minutes: 60
  ecowater_dsn: 'your_ecowater_serial_number'
  ecowater_email: 'your_email_account_for_ecowater_portal'
  ecowater_password: 'your_password_for_ecowater_portal'

You can then use the MQTT data as sensors and binary sensors in HA, example :

binary_sensor:
- platform: mqtt
 name: Ecowater Online
 state_topic: "ecowater/online"
 payload_on: True
 payload_off: False

sensor:
- platform: mqtt
 name: Ecowater Salt Level
 state_topic: "ecowater/salt_level"

Available binary sensors : online, recharge, out_of_salt
Available sensors : salt_level, salt_level_percent, water_today, water_avg, water_avail, water_flow, out_of_salt_days

That’s it , have fun !

florisi · August 4, 2020, 6:54am

Hi, I have the following error in AppDaemon.

WARNING AppDaemon: Unknown domain (default/mqtt) in call_service from EcoWater

How can I solve this?

kalhimeo · August 4, 2020, 9:06am

Did you install MQTT broker (add-on / integration) in HA ? Did you activate and configure MQTT in AppDaemon config ?

florisi · August 4, 2020, 9:42am

Hi,

the broker is installed.
But what do you mean by activate and configure MQTT in AppDaemon?
I’m a Newbie to MQTT.

kalhimeo · August 4, 2020, 2:12pm

check your appdaemon.yaml config file in your appdaemon folder.

You should have a MQTT section in your plugins which looks like :

    MQTT:
      type: mqtt
      namespace: mqtt
      verbose: True
      client_host: mqtt_ip
      client_port: mqtt_port
      client_id: homeassistant
      client_user: username
      client_password: password

More details : https://appdaemon.readthedocs.io/en/latest/CONFIGURE.html#configuration-of-the-mqtt-plugin

florisi · August 4, 2020, 2:52pm

Thanks, working now.
Great help.

Is there something like a beginnerguide for MQTT?

kalhimeo · August 4, 2020, 3:42pm

glad that it s working for you too !

I am sure there must be beginner guides, but I don t know any

florisi · August 5, 2020, 5:55am

The app is running good, I get the right values, but there is one warning.
Is there something I have to do about it?

WARNING AppDaemon: callback run_parsing() in EcoWater has now completed

kalhimeo · August 5, 2020, 10:55am

Yes i have the same, i don t know if this is due to a debug level, or if I should have some default log line at the end of the script to confirm it s execution. I am still new with appdaemon scripting as well

PanMat · September 5, 2020, 5:26am

@kalhimeo excellent work with the script and instructions above, worked like a charm for me in first attempt.
Thanks a lot

PanMat · September 13, 2020, 6:08pm

@kalhimeo is there way to avoid putting plain text values for DSN, username and password in app.yaml? I tried moving these values to secrets.yaml but the integration stopped working and I could not figure out a way to make app.yaml read the DSN, username and password from secrets.yaml file.

kalhimeo · September 15, 2020, 10:40am

I have no idea, I am still quite new with these things sorry

JWM22 · November 18, 2020, 5:09pm

@kalhimeo
Great thanks for this scripts and instructions indeed!
I got it working almost directly with your instructions.

Thanks a lot…

PanMat · May 7, 2021, 1:28am

@kalhimeo you did it perfectly, I was not starting the AppDaemon correctly. I’m able to put DSN, email and password in secrets.yaml and it is working like a charm!!
Thanks!