So I’ve been using multiscrape for a while to obtain waste collection dates and has been all working fine, but without any conscious change the behaviour of the scrape has changed. For ref I am on multiscrape 6.7.2 HA Core 2023.8.3.
The scrape has worked for months, but the issue now is that the scrape works for a while then goes unavailable. The weird bit is the duration the scrape works is equal to the scan_interval and the period unavailable is then 3 times the scan_interval, after which the cycle repeats. This patten holds for different scan intervals.
Example code is:
multiscrape:
- resource: https://<url>
headers:
User-Agent: Mozilla/5.0
scan_interval: 7200
timeout: 20
sensor:
- unique_id: food_waste
name: Food Waste
select: "body > div.wrapper > div > div.container > div > div.waste__loading_wrapper > div > div > div.govuk-grid-column-two-thirds > div:nth-child(2) > div.govuk-grid-column-three-quarters > dl > div:nth-child(2) > dd"
value_template: '{{ value.split(", ")[1].split(" (")[0][:8] }}'
Have I missed a change anywhere? Any thoughts?
Ta
S