I guess now is a good time as any to release this add-on/app.
This app (Add-on) eliminates the need for manual downloads, by running a “headless” background scraper that simulates a login, intercepts the data stream, and provides it to Home Assistant in real-time.
It has been working well for me, for weeks on HAOS on x86. The repo has been up for a while, but it makes sense to make an announcement so people can stop download their data manually from hydroottawa.savagedata.com to import it.
This app depends on
Browserless: The Chromium engine that powers the headless navigation.
Folder Watcher: Monitors for new data files instantly.
My notes:
The ‘folder watcher’ - i believe its best to take front end integration route.
I can not seem to find where the files are stored!
the debug option is helpful -stating download is a success but i cant seem to verify the file manually.
i figured out the data is not stored in the root config folders.
i had to install the ‘samba share’ addon and then navigate to this folder, and see the files in a windows explorer.
Other issue: the ‘folder watch’ throws in a ha repair notification and asks to use the integrations instead.
Am hoping to see what can be done here…
Were the files in /share/hydro-ottawa/ ?
I suspect the error you are getting is because the folder wasn’t added:
Configured folders must be added to allowlist_external_dirs. Note that by default folder monitoring is recursive, meaning that the contents of sub-folders are also monitored.