Scraping website (bin schedule) - help with selector configuration

Configuration Frontend
1

Please could someone point me in the right direction for scraping the ‘next collection’ text from a website. I have tried a few alternatives, but without success and also messed about with Beautiful Soup, but cannot quite follow it.

Here is an example of the website (not my address):

https://recyclingservices.bromley.gov.uk/waste/3660778

If I copy the CSS selector for one of the waste types I get this:

body > div.wrapper > div > div.container > div > div.waste__collections > div > div.govuk-grid-column-two-thirds > div:nth-child(2) > div.govuk-grid-column-three-quarters > dl > div:nth-child(2) > dd

How do I format this for the scrape integration?

Thanks
S

2

Did you manage to get this going Snacker?

Thanks in advance!

3

I did, I realised I needed to include:

    headers:
      User-Agent: Mozilla/5.0

In the configuration of the multiscrape as I was getting blocked by the url. The format of the selector was absolutely fine. Full config for 1 example in case helpful is:

multiscrape:
  - resource: https://recyclingservices.bromley.gov.uk/waste/xxxxxxx
    headers:
      User-Agent: Mozilla/5.0  
    scan_interval: 7200
    timeout: 20
    sensor:
      - unique_id: food_waste
        name: Food Waste
        select:  "body > div.wrapper > div > div.container > div > div.waste__collections > div > div.govuk-grid-column-two-thirds > div:nth-child(2) > div.govuk-grid-column-three-quarters > dl > div:nth-child(2) > dd"

Hope this helps