Help with Multiscrape please

Configuration
1

Could anyone please help me fix a(nother) problem I have scraping data. I’m using multiscrape and retrieving one piece of data correctly but getting errors on everything else I try. In the code below I get waves_location correctly but waves_max_height returns “unavailable”.

multiscrape:
  - name: Waves scraper
    resource: https://coastalmonitoring.org/realtimedata/index.php?chart=97&tab=ld&disp_option=
    scan_interval: 83600
    log_response: true
    sensor:
      - unique_id: waves_location
        name: waves_location
        select: "#placename"
      - unique_id: waves_max_height
        name: waves_max_height
        select: "#content > div.boxbody > div:nth-child(5) > div:nth-child(2) > div > table > tbody > tr:nth-child(7) > td:nth-child(2)"
        state_class: measurement
        unit_of_measurement: m

I got the select expression using inspect in exactly the same way as the placename which works.
The data I want is in pagesoup.txt but I’m too dense to see the relationship between the select expression & the soup data.
Could anyone help please?

2

Try removing the ‘tbody’ from the select expression.

3

Thanks for the reply, but that didn’t work either. It still returns “unavailable” and the log reads 2023-04-16 08:56:08.687 ERROR (MainThread) [custom_components.multiscrape.sensor] Waves scraper # waves_max_height # Unable to scrape data: Could not find a tag for given selector

4

I think I fixed it:

      - unique_id: waves_max_height
        name: waves_max_height
        select: "table > tr:nth-child(7) > td:nth-child(2)"
        state_class: measurement
        unit_of_measurement: m

as I found that this was the only instance of table on the website, all the rest was unnecessary.

5

I’ve done a few basic scrapes but really want to scrape some date from the US News National Power Outage Map. This table is much more than my capabilities allow. Can someone give me a sample of one element and I think I can take it from there. The source is https://data.usatoday.com/national-power-outage-map-tracker/area/south-carolina/45/ but I’m lost on what to select to show the table data elements.