How to collect bills detail from services providers?

Installation Home Assistant OS
1

I’m trying to get the bills from my servies provider ( electricity / gas / TV-Internet … etc ). All this providers have a sort of web page ( no public API ), there I can login with user / password ( filling the login form, press login button ). Once I`m logged in I have access to the bills, statistics, prices and so on.

I know that there is a Scrape Sensor witch can help me with this, but I don`t understand how this actually works. The biggest question is how to handle the login session and navigation from one page to another.

Apart of this builtin sensor, I was thinking of a add-on (docker container) with node-js and Puppeteer, but I `m not sure how tho create this add-on. I am using Home Assistant over HASSIO OS on a Raspberry Pi 3.

If someone else knows how to do this please share it.

2

Greetings, NoBine.

You can write a custom sensor on Python, which will be collect data from providers website.
Inside this sensor you can authorize and get data from web pages with Beatiful Soup for example.

Best regards

3

Thank you @sleepdealer, is there any other alternative solution? I’m asking because I`m not confident writing Python code, I’m more familiar with javascript,

Thank you,