Help with multiscrape value within <span>

DJI · January 18, 2023, 11:30am

Can anyone help me select some data from the website https://tides.willyweather.co.uk/sw/devon/appledore-torridge.html please? I’ve scraped some of what I need from elsewhere on this site (the wind tab) but on this tidal page all I can get is the location. The data I need is in a side panel on the right labelled “now” and a table at the bottom labelled “tides”.

I’ve done what normally works (select the text, right click “inspect” then “copy selector” into configuration.yaml):-

logger:
  default: info
  logs:
    custom_components.multiscrape: debug

multiscrape:
  - name: Tide scraper
    resource: https://tides.willyweather.co.uk/sw/devon/appledore-torridge.html
    scan_interval: 3600
    button:
      - unique_id: tide_data
        name: Tides data refresh
    sensor:
      - unique_id: tide_location
        name: tide_location
        select: "body > section > section.content > main > article > header > h1"
        value_template: '{{ (value.split("Tide")[-2]) }}'
      - unique_id: tide_height
        name: tide_height
        select: "body > section > section.content > aside > section.block.tide-clock > header > h1 > span"
#        value_template: '{{ (value.split("m")[-2]) }}'
#        state_class: measurement
#        unit_of_measurement: m

(I’ve commented out the what I want to do with the value once I’ve managed to select it).
I dont get any errors, just the entity state “unavailable”.
I’ve played around trying to scrape other data off this particular page with no success.
I also can’t find where debug is putting any info that might help me.
Can any kind person help me out?

Troon · January 18, 2023, 11:50am

Unfortunately the HTML you’re seeing is being dynamically generated by your browser. If you do a View Source instead, you see what the scrape sensor sees.

You might be able to pull something out of the block that starts ww.data.graphs=, but that’s going to be hard work. I think I’d be looking for another source of data: they don’t seem to provide an API to get this data cleanly.

Here, perhaps? Tide Gauge API reference — maybe average Ilfracombe and Newlyn?

DJI · January 18, 2023, 12:18pm

Thanks again Troon for your help. Unfortunately the tide here is hard to infer from Ilfracombe (being esturine). The Admiralty Easytide site is definitive but even harder to scrape. I don’t know how they do it, but WillyWeather are the only source I can find that gets the same current height as Easytide (and incidentally more up-to-date real time wind speeds nearby too).
WillyWeather do offer a widget and I’m wondering whether I could embed this into my dashboard for live coastal conditions. This is what they publish for a widget:

<div style="width: 293px;"><iframe style="display: block;" src="https://cdnres.willyweather.co.uk/widget/loadView.html?id=5049" width="293" height="228" frameborder="0" scrolling="no"></iframe><a style="margin: -20px 0 0 0;display: block;z-index: 1;position: relative;height: 20px;text-indent: -9999em" href="https://www.willyweather.co.uk/sw/devon/appledore-torridge.html" rel="nofollow">The latest appledore torridge wind</a></div>

Can I use it in HA do you think?

Troon · January 18, 2023, 2:12pm

Sadly that widget just refers back to the original webpage. I’m having a look now to see if there’s a reasonable way to extract the data.

Troon · January 18, 2023, 2:29pm

This returns the next tide height data point using an ugly command_line sensor and a lot of black magic:

- platform: command_line
  name: Appledore current tide height
  scan_interval: 1200
  unique_id: 6eb949ed-52ab-49fa-827e-90c45ec488ee
  command: "curl -s https://tides.willyweather.co.uk/sw/devon/appledore-torridge.html | grep forecastGraphs | cut -d: -f2-"
  unit_of_measurement: 'm'
  value_template: >-
    {% set input = value[:-3] %}
    {% set points = (input|from_json)['forecastGraphs']['tides']['dataConfig']['series']['groups'][0]['points'] %}
    {% set n = now()|as_timestamp()|int %}
    {{ (points|selectattr('x','>=',n)|first)['y'] }}

The points data structure has a load of entries with x as the Unix timestamp and y as the height. Play with this in the template editor — the first two lines do the same job as the template above but with hardcoded data rather than the lookup:

{% set a = {"forecastGraphs":{"tides":{"dataConfig":{"series":{"config":{"id":"tides","color":"#0094F8","lineWidth":2,"lineFill":true,"lineRenderer":"CurvedLineRenderer","showPoints":false,"pointFormatter":"TidePointFormatter"},"yAxisDataMin":-0.4,"yAxisDataMax":8.7,"yAxisMin":-1,"yAxisMax":11,"groups":[{"dateTime":1674000000,"points":[{"x":1674000615,"y":4.65,"description":"","interpolated":true},{"x":1674001710,"y":4.9,"description":"","interpolated":true},{"x":1674002805,"y":5.12,"description":"","interpolated":true},{"x":1674003900,"y":5.31,"description":"","interpolated":true},{"x":1674004995,"y":5.47,"description":"","interpolated":true},{"x":1674006090,"y":5.58,"description":"","interpolated":true},{"x":1674007185,"y":5.65,"description":"","interpolated":true},{"x":1674008280,"y":5.67,"description":"high","interpolated":false},{"x":1674009522,"y":5.65,"description":"","interpolated":true},{"x":1674010764,"y":5.58,"description":"","interpolated":true},{"x":1674012006,"y":5.47,"description":"","interpolated":true},{"x":1674013248,"y":5.31,"description":"","interpolated":true},{"x":1674014490,"y":5.13,"description":"","interpolated":true},{"x":1674015732,"y":4.9,"description":"","interpolated":true},{"x":1674016974,"y":4.65,"description":"","interpolated":true},{"x":1674018216,"y":4.38,"description":"","interpolated":true},{"x":1674019458,"y":4.1,"description":"","interpolated":true},{"x":1674020700,"y":3.81,"description":"","interpolated":true},{"x":1674021942,"y":3.52,"description":"","interpolated":true},{"x":1674023184,"y":3.24,"description":"","interpolated":true},{"x":1674024426,"y":2.97,"description":"","interpolated":true},{"x":1674025668,"y":2.72,"description":"","interpolated":true},{"x":1674026910,"y":2.49,"description":"","interpolated":true},{"x":1674028152,"y":2.31,"description":"","interpolated":true},{"x":1674029394,"y":2.15,"description":"","interpolated":true},{"x":1674030636,"y":2.04,"description":"","interpolated":true},{"x":1674031878,"y":1.97,"description":"","interpolated":true},{"x":1674033120,"y":1.95,"description":"low","interpolated":false},{"x":1674034152,"y":1.97,"description":"","interpolated":true},{"x":1674035184,"y":2.05,"description":"","interpolated":true},{"x":1674036216,"y":2.17,"description":"","interpolated":true},{"x":1674037248,"y":2.33,"description":"","interpolated":true},{"x":1674038280,"y":2.53,"description":"","interpolated":true},{"x":1674039312,"y":2.77,"description":"","interpolated":true},{"x":1674040344,"y":3.04,"description":"","interpolated":true},{"x":1674041376,"y":3.33,"description":"","interpolated":true},{"x":1674042408,"y":3.63,"description":"","interpolated":true},{"x":1674043440,"y":3.94,"description":"","interpolated":true},{"x":1674044472,"y":4.25,"description":"","interpolated":true},{"x":1674045504,"y":4.55,"description":"","interpolated":true},{"x":1674046536,"y":4.84,"description":"","interpolated":true},{"x":1674047568,"y":5.11,"description":"","interpolated":true},{"x":1674048600,"y":5.35,"description":"","interpolated":true},{"x":1674049632,"y":5.55,"description":"","interpolated":true},{"x":1674050664,"y":5.71,"description":"","interpolated":true},{"x":1674051696,"y":5.83,"description":"","interpolated":true},{"x":1674052728,"y":5.91,"description":"","interpolated":true},{"x":1674053760,"y":5.93,"description":"high","interpolated":false},{"x":1674054999,"y":5.9,"description":"","interpolated":true},{"x":1674056238,"y":5.83,"description":"","interpolated":true},{"x":1674057477,"y":5.7,"description":"","interpolated":true},{"x":1674058716,"y":5.53,"description":"","interpolated":true},{"x":1674059955,"y":5.31,"description":"","interpolated":true},{"x":1674061194,"y":5.06,"description":"","interpolated":true},{"x":1674062433,"y":4.78,"description":"","interpolated":true},{"x":1674063672,"y":4.48,"description":"","interpolated":true},{"x":1674064911,"y":4.15,"description":"","interpolated":true},{"x":1674066150,"y":3.83,"description":"","interpolated":true},{"x":1674067389,"y":3.5,"description":"","interpolated":true},{"x":1674068628,"y":3.17,"description":"","interpolated":true},{"x":1674069867,"y":2.87,"description":"","interpolated":true},{"x":1674071106,"y":2.59,"description":"","interpolated":true},{"x":1674072345,"y":2.34,"description":"","interpolated":true},{"x":1674073584,"y":2.12,"description":"","interpolated":true},{"x":1674074823,"y":1.95,"description":"","interpolated":true},{"x":1674076062,"y":1.82,"description":"","interpolated":true},{"x":1674077301,"y":1.75,"description":"","interpolated":true},{"x":1674078540,"y":1.72,"description":"low","interpolated":false},{"x":1674079548,"y":1.75,"description":"","interpolated":true},{"x":1674080556,"y":1.83,"description":"","interpolated":true},{"x":1674081564,"y":1.97,"description":"","interpolated":true},{"x":1674082572,"y":2.15,"description":"","interpolated":true},{"x":1674083580,"y":2.38,"description":"","interpolated":true},{"x":1674084588,"y":2.65,"description":"","interpolated":true},{"x":1674085596,"y":2.95,"description":"","interpolated":true}],"overlays":[{"renderer":"MoonPhasesOverlayRenderer","data":{"phase":"Waning Crescent","phaseCode":"wanc","percentageFull":16,"hemisphere":"n"}}]},{"dateTime":1674086400,"points":[{"x":1674086604,"y":3.28,"description":"","interpolated":true},{"x":1674087612,"y":3.62,"description":"","interpolated":true},{"x":1674088620,"y":3.98,"description":"","interpolated":true},{"x":1674089628,"y":4.33,"description":"","interpolated":true},{"x":1674090636,"y":4.67,"description":"","interpolated":true},{"x":1674091644,"y":5,"description":"","interpolated":true},{"x":1674092652,"y":5.3,"description":"","interpolated":true},{"x":1674093660,"y":5.57,"description":"","interpolated":true},{"x":1674094668,"y":5.8,"description":"","interpolated":true},{"x":1674095676,"y":5.98,"description":"","interpolated":true},{"x":1674096684,"y":6.12,"description":"","interpolated":true},{"x":1674097692,"y":6.2,"description":"","interpolated":true},{"x":1674098700,"y":6.23,"description":"high","interpolated":false},{"x":1674099975,"y":6.2,"description":"","interpolated":true},{"x":1674101250,"y":6.11,"description":"","interpolated":true},{"x":1674102525,"y":5.97,"description":"","interpolated":true},{"x":1674103800,"y":5.78,"description":"","interpolated":true},{"x":1674105075,"y":5.54,"description":"","interpolated":true},{"x":1674106350,"y":5.26,"description":"","interpolated":true},{"x":1674107625,"y":4.95,"description":"","interpolated":true},{"x":1674108900,"y":4.61,"description":"","interpolated":true},{"x":1674110175,"y":4.25,"description":"","interpolated":true},{"x":1674111450,"y":3.88,"description":"","interpolated":true},{"x":1674112725,"y":3.51,"description":"","interpolated":true},{"x":1674114000,"y":3.15,"description":"","interpolated":true},{"x":1674115275,"y":2.81,"description":"","interpolated":true},{"x":1674116550,"y":2.5,"description":"","interpolated":true},{"x":1674117825,"y":2.22,"description":"","interpolated":true},{"x":1674119100,"y":1.98,"description":"","interpolated":true},{"x":1674120375,"y":1.79,"description":"","interpolated":true},{"x":1674121650,"y":1.65,"description":"","interpolated":true},{"x":1674122925,"y":1.56,"description":"","interpolated":true},{"x":1674124200,"y":1.53,"description":"low","interpolated":false},{"x":1674125184,"y":1.56,"description":"","interpolated":true},{"x":1674126168,"y":1.65,"description":"","interpolated":true},{"x":1674127152,"y":1.8,"description":"","interpolated":true},{"x":1674128136,"y":2,"description":"","interpolated":true},{"x":1674129120,"y":2.26,"description":"","interpolated":true},{"x":1674130104,"y":2.55,"description":"","interpolated":true},{"x":1674131088,"y":2.88,"description":"","interpolated":true},{"x":1674132072,"y":3.24,"description":"","interpolated":true},{"x":1674133056,"y":3.62,"description":"","interpolated":true},{"x":1674134040,"y":4.01,"description":"","interpolated":true},{"x":1674135024,"y":4.4,"description":"","interpolated":true},{"x":1674136008,"y":4.78,"description":"","interpolated":true},{"x":1674136992,"y":5.14,"description":"","interpolated":true},{"x":1674137976,"y":5.47,"description":"","interpolated":true},{"x":1674138960,"y":5.76,"description":"","interpolated":true},{"x":1674139944,"y":6.02,"description":"","interpolated":true},{"x":1674140928,"y":6.22,"description":"","interpolated":true},{"x":1674141912,"y":6.37,"description":"","interpolated":true},{"x":1674142896,"y":6.46,"description":"","interpolated":true},{"x":1674143880,"y":6.49,"description":"high","interpolated":false},{"x":1674145140,"y":6.46,"description":"","interpolated":true},{"x":1674146400,"y":6.36,"description":"","interpolated":true},{"x":1674147660,"y":6.21,"description":"","interpolated":true},{"x":1674148920,"y":6,"description":"","interpolated":true},{"x":1674150180,"y":5.73,"description":"","interpolated":true},{"x":1674151440,"y":5.42,"description":"","interpolated":true},{"x":1674152700,"y":5.08,"description":"","interpolated":true},{"x":1674153960,"y":4.7,"description":"","interpolated":true},{"x":1674155220,"y":4.31,"description":"","interpolated":true},{"x":1674156480,"y":3.91,"description":"","interpolated":true},{"x":1674157740,"y":3.5,"description":"","interpolated":true},{"x":1674159000,"y":3.11,"description":"","interpolated":true},{"x":1674160260,"y":2.73,"description":"","interpolated":true},{"x":1674161520,"y":2.39,"description":"","interpolated":true},{"x":1674162780,"y":2.08,"description":"","interpolated":true},{"x":1674164040,"y":1.81,"description":"","interpolated":true},{"x":1674165300,"y":1.6,"description":"","interpolated":true},{"x":1674166560,"y":1.45,"description":"","interpolated":true},{"x":1674167820,"y":1.35,"description":"","interpolated":true},{"x":1674169080,"y":1.32,"description":"low","interpolated":false},{"x":1674170052,"y":1.35,"description":"","interpolated":true},{"x":1674171024,"y":1.46,"description":"","interpolated":true},{"x":1674171996,"y":1.62,"description":"","interpolated":true}],"overlays":[{"renderer":"MoonPhasesOverlayRenderer","data":{"phase":"Waning Crescent","phaseCode":"wanc","percentageFull":8,"hemisphere":"n"}}]},{"dateTime":1674172800,"points":[{"x":1674172968,"y":1.85,"description":"","interpolated":true},{"x":1674173940,"y":2.13,"description":"","interpolated":true},{"x":1674174912,"y":2.46,"description":"","interpolated":true},{"x":1674175884,"y":2.83,"description":"","interpolated":true},{"x":1674176856,"y":3.23,"description":"","interpolated":true},{"x":1674177828,"y":3.66,"description":"","interpolated":true},{"x":1674178800,"y":4.09,"description":"","interpolated":true},{"x":1674179772,"y":4.52,"description":"","interpolated":true},{"x":1674180744,"y":4.95,"description":"","interpolated":true},{"x":1674181716,"y":5.35,"description":"","interpolated":true},{"x":1674182688,"y":5.72,"description":"","interpolated":true},{"x":1674183660,"y":6.05,"description":"","interpolated":true},{"x":1674184632,"y":6.33,"description":"","interpolated":true},{"x":1674185604,"y":6.56,"description":"","interpolated":true},{"x":1674186576,"y":6.72,"description":"","interpolated":true},{"x":1674187548,"y":6.83,"description":"","interpolated":true},{"x":1674188520,"y":6.86,"description":"high","interpolated":false},{"x":1674189804,"y":6.82,"description":"","interpolated":true},{"x":1674191088,"y":6.72,"description":"","interpolated":true},{"x":1674192372,"y":6.54,"description":"","interpolated":true},{"x":1674193656,"y":6.3,"description":"","interpolated":true},{"x":1674194940,"y":6.01,"description":"","interpolated":true},{"x":1674196224,"y":5.66,"description":"","interpolated":true},{"x":1674197508,"y":5.27,"description":"","interpolated":true},{"x":1674198792,"y":4.85,"description":"","interpolated":true},{"x":1674200076,"y":4.4,"description":"","interpolated":true},{"x":1674201360,"y":3.95,"description":"","interpolated":true},{"x":1674202644,"y":3.49,"description":"","interpolated":true},{"x":1674203928,"y":3.04,"description":"","interpolated":true},{"x":1674212916,"y":1.07,"description":"","interpolated":true},{"x":1674214200,"y":1.03,"description":"low","interpolated":false},{"x":1674215169,"y":1.07,"description":"","interpolated":true},{"x":1674216138,"y":1.18,"description":"","interpolated":true},{"x":1674344391,"y":0.93,"description":"","interpolated":true}],"overlays":[{"renderer":"MoonPhasesOverlayRenderer","data":{"phase":"Waning Crescent","phaseCode":"wanc","percentageFull":1,"hemisphere":"n"}}]},{"dateTime":1674345600,"points":[{"x":1674345654,"y":0.72,"description":"","interpolated":true},{"x":1674346917,"y":0.59,"description":"","interpolated":true},{"x":1674348180,"y":0.55,"description":"low","interpolated":false},{"x":1674349134,"y":0.6,"description":"","interpolated":true},{"x":1674350088,"y":0.73,"description":"","interpolated":true},{"x":1674351042,"y":0.95,"description":"","interpolated":true},{"x":1674351996,"y":1.25,"description":"","interpolated":true},{"x":1674352950,"y":1.63,"description":"","interpolated":true},{"x":1674353904,"y":2.06,"description":"","interpolated":true},{"x":1674354858,"y":2.56,"description":"","interpolated":true},{"x":1674355812,"y":3.09,"description":"","interpolated":true},{"x":1674356766,"y":3.65,"description":"","interpolated":true},{"x":1674357720,"y":4.23,"description":"","interpolated":true},{"x":1674358674,"y":4.8,"description":"","interpolated":true},{"x":1674359628,"y":5.36,"description":"","interpolated":true},{"x":1674360582,"y":5.89,"description":"","interpolated":true},{"x":1674361536,"y":6.39,"description":"","interpolated":true},{"x":1674362490,"y":6.82,"description":"","interpolated":true},{"x":1674363444,"y":7.2,"description":"","interpolated":true},{"x":1674364398,"y":7.5,"description":"","interpolated":true},{"x":1674381384,"y":3.48,"description":"","interpolated":true},{"x":1674382668,"y":2.89,"description":"","interpolated":true},{"x":1674383952,"y":2.34,"description":"","interpolated":true},{"x":1674385236,"y":1.83,"description":"","interpolated":true},{"x":1674386520,"y":1.37,"description":"","interpolated":true},{"x":1674387804,"y":0.98,"description":"","interpolated":true},{"x":1674389088,"y":0.67,"description":"","interpolated":true},{"x":1674390372,"y":0.44,"description":"","interpolated":true},{"x":1674391656,"y":0.3,"description":"","interpolated":true},{"x":1674392940,"y":0.25,"description":"low","interpolated":false},{"x":1674393900,"y":0.3,"description":"","interpolated":true},{"x":1674394860,"y":0.44,"description":"","interpolated":true},{"x":1674395820,"y":0.66,"description":"","interpolated":true},{"x":1674396780,"y":0.97,"description":"","interpolated":true},{"x":1674397740,"y":1.36,"description":"","interpolated":true},{"x":1674398700,"y":1.81,"description":"","interpolated":true},{"x":1674399660,"y":2.31,"description":"","interpolated":true},{"x":1674409260,"y":7.4,"description":"","interpolated":true},{"x":1674410220,"y":7.62,"description":"","interpolated":true},{"x":1674411180,"y":7.76,"description":"","interpolated":true},{"x":1674412140,"y":7.81,"description":"high","interpolated":false},{"x":1674413403,"y":7.76,"description":"","interpolated":true},{"x":1674414666,"y":7.63,"description":"","interpolated":true},{"x":1674415929,"y":7.4,"description":"","interpolated":true},{"x":1674417192,"y":7.09,"description":"","interpolated":true},{"x":1674418455,"y":6.71,"description":"","interpolated":true},{"x":1674419718,"y":6.27,"description":"","interpolated":true},{"x":1674420981,"y":5.77,"description":"","interpolated":true},{"x":1674422244,"y":5.22,"description":"","interpolated":true},{"x":1674423507,"y":4.65,"description":"","interpolated":true},{"x":1674424770,"y":4.07,"description":"","interpolated":true},{"x":1674426033,"y":3.48,"description":"","interpolated":true},{"x":1674427296,"y":2.91,"description":"","interpolated":true},{"x":1674428559,"y":2.36,"description":"","interpolated":true},{"x":1674429822,"y":1.86,"description":"","interpolated":true},{"x":1674431085,"y":1.42,"description":"","interpolated":true}],"overlays":[{"renderer":"MoonPhasesOverlayRenderer","data":{"phase":"Waxing Crescent","phaseCode":"waxc","percentageFull":1,"hemisphere":"n"}}]},{"dateTime":1674432000,"points":[{"x":1674432348,"y":1.04,"description":"","interpolated":true},{"x":1674433611,"y":0.73,"description":"","interpolated":true},{"x":1674434874,"y":0.5,"description":"","interpolated":true},{"x":1674436137,"y":0.37,"description":"","interpolated":true},{"x":1674437400,"y":0.32,"description":"low","interpolated":false},{"x":1674438351,"y":0.37,"description":"","interpolated":true},{"x":1674439302,"y":0.51,"description":"","interpolated":true},{"x":1674440253,"y":0.75,"description":"","interpolated":true},{"x":1674441204,"y":1.07,"description":"","interpolated":true},{"x":1674442155,"y":1.47,"description":"","interpolated":true},{"x":1674443106,"y":1.93,"description":"","interpolated":true},{"x":1674444057,"y":2.45,"description":"","interpolated":true},{"x":1674445008,"y":3.02,"description":"","interpolated":true},{"x":1674445959,"y":3.62,"description":"","interpolated":true},{"x":1674446910,"y":4.23,"description":"","interpolated":true},{"x":1674447861,"y":4.84,"description":"","interpolated":true},{"x":1674448812,"y":5.44,"description":"","interpolated":true},{"x":1674449763,"y":6.01,"description":"","interpolated":true},{"x":1674450714,"y":6.53,"description":"","interpolated":true},{"x":1674451665,"y":6.99,"description":"","interpolated":true},{"x":1674452616,"y":7.39,"description":"","interpolated":true},{"x":1674453567,"y":7.71,"description":"","interpolated":true},{"x":1674454518,"y":7.95,"description":"","interpolated":true},{"x":1674455469,"y":8.09,"description":"","interpolated":true},{"x":1674456420,"y":8.14,"description":"high","interpolated":false},{"x":1674457704,"y":8.09,"description":"","interpolated":true},{"x":1674458988,"y":7.94,"description":"","interpolated":true},{"x":1674460272,"y":7.7,"description":"","interpolated":true},{"x":1674461556,"y":7.37,"description":"","interpolated":true},{"x":1674462840,"y":6.96,"description":"","interpolated":true},{"x":1674464124,"y":6.48,"description":"","interpolated":true},{"x":1674465408,"y":5.94,"description":"","interpolated":true},{"x":1674466692,"y":5.36,"description":"","interpolated":true},{"x":1674467976,"y":4.74,"description":"","interpolated":true},{"x":1674469260,"y":4.11,"description":"","interpolated":true},{"x":1674470544,"y":3.48,"description":"","interpolated":true},{"x":1674471828,"y":2.86,"description":"","interpolated":true},{"x":1674473112,"y":2.28,"description":"","interpolated":true},{"x":1674474396,"y":1.74,"description":"","interpolated":true},{"x":1674475680,"y":1.26,"description":"","interpolated":true},{"x":1674476964,"y":0.85,"description":"","interpolated":true},{"x":1674478248,"y":0.52,"description":"","interpolated":true},{"x":1674479532,"y":0.28,"description":"","interpolated":true},{"x":1674480816,"y":0.13,"description":"","interpolated":true},{"x":1674482100,"y":0.08,"description":"low","interpolated":false},{"x":1674483057,"y":0.13,"description":"","interpolated":true},{"x":1674484014,"y":0.27,"description":"","interpolated":true},{"x":1674484971,"y":0.51,"description":"","interpolated":true},{"x":1674485928,"y":0.82,"description":"","interpolated":true},{"x":1674486885,"y":1.22,"description":"","interpolated":true},{"x":1674487842,"y":1.69,"description":"","interpolated":true},{"x":1674488799,"y":2.21,"description":"","interpolated":true},{"x":1674489756,"y":2.77,"description":"","interpolated":true},{"x":1674490713,"y":3.37,"description":"","interpolated":true},{"x":1674491670,"y":3.98,"description":"","interpolated":true},{"x":1674492627,"y":4.59,"description":"","interpolated":true},{"x":1674493584,"y":5.19,"description":"","interpolated":true},{"x":1674494541,"y":5.75,"description":"","interpolated":true},{"x":1674495498,"y":6.27,"description":"","interpolated":true},{"x":1674496455,"y":6.74,"description":"","interpolated":true},{"x":1674497412,"y":7.14,"description":"","interpolated":true},{"x":1674498369,"y":7.45,"description":"","interpolated":true},{"x":1674499326,"y":7.69,"description":"","interpolated":true},{"x":1674500283,"y":7.83,"description":"","interpolated":true},{"x":1674501240,"y":7.88,"description":"high","interpolated":false},{"x":1674502503,"y":7.83,"description":"","interpolated":true},{"x":1674503766,"y":7.69,"description":"","interpolated":true},{"x":1674505029,"y":7.46,"description":"","interpolated":true},{"x":1674506292,"y":7.15,"description":"","interpolated":true},{"x":1674507555,"y":6.76,"description":"","interpolated":true},{"x":1674508818,"y":6.31,"description":"","interpolated":true},{"x":1674510081,"y":5.8,"description":"","interpolated":true},{"x":1674511344,"y":5.24,"description":"","interpolated":true},{"x":1674512607,"y":4.66,"description":"","interpolated":true},{"x":1674513870,"y":4.07,"description":"","interpolated":true},{"x":1674515133,"y":3.47,"description":"","interpolated":true},{"x":1674516396,"y":2.89,"description":"","interpolated":true},{"x":1674517659,"y":2.33,"description":"","interpolated":true}],"overlays":[{"renderer":"MoonPhasesOverlayRenderer","data":{"phase":"Waxing Crescent","phaseCode":"waxc","percentageFull":4,"hemisphere":"n"}}]},{"dateTime":1674518400,"points":[{"x":1674518922,"y":1.82,"description":"","interpolated":true},{"x":1674520185,"y":1.37,"description":"","interpolated":true},{"x":1674521448,"y":0.98,"description":"","interpolated":true},{"x":1674522711,"y":0.67,"description":"","interpolated":true},{"x":1674523974,"y":0.44,"description":"","interpolated":true},{"x":1674525237,"y":0.3,"description":"","interpolated":true},{"x":1674526500,"y":0.25,"description":"low","interpolated":false},{"x":1674527448,"y":0.3,"description":"","interpolated":true},{"x":1674528396,"y":0.44,"description":"","interpolated":true},{"x":1674529344,"y":0.68,"description":"","interpolated":true},{"x":1674530292,"y":1,"description":"","interpolated":true},{"x":1674531240,"y":1.41,"description":"","interpolated":true},{"x":1674532188,"y":1.88,"description":"","interpolated":true},{"x":1674533136,"y":2.41,"description":"","interpolated":true},{"x":1674534084,"y":2.98,"description":"","interpolated":true},{"x":1674535032,"y":3.58,"description":"","interpolated":true},{"x":1674535980,"y":4.2,"description":"","interpolated":true},{"x":1674536928,"y":4.82,"description":"","interpolated":true},{"x":1674537876,"y":5.42,"description":"","interpolated":true},{"x":1674538824,"y":5.99,"description":"","interpolated":true},{"x":1674539772,"y":6.52,"description":"","interpolated":true},{"x":1674540720,"y":6.99,"description":"","interpolated":true},{"x":1674541668,"y":7.4,"description":"","interpolated":true},{"x":1674542616,"y":7.72,"description":"","interpolated":true},{"x":1674543564,"y":7.96,"description":"","interpolated":true},{"x":1674544512,"y":8.1,"description":"","interpolated":true},{"x":1674545460,"y":8.15,"description":"high","interpolated":false},{"x":1674546741,"y":8.1,"description":"","interpolated":true},{"x":1674548022,"y":7.95,"description":"","interpolated":true},{"x":1674549303,"y":7.71,"description":"","interpolated":true},{"x":1674550584,"y":7.38,"description":"","interpolated":true},{"x":1674551865,"y":6.97,"description":"","interpolated":true},{"x":1674553146,"y":6.48,"description":"","interpolated":true},{"x":1674554427,"y":5.94,"description":"","interpolated":true},{"x":1674555708,"y":5.36,"description":"","interpolated":true},{"x":1674556989,"y":4.74,"description":"","interpolated":true},{"x":1674558270,"y":4.11,"description":"","interpolated":true},{"x":1674559551,"y":3.48,"description":"","interpolated":true},{"x":1674560832,"y":2.86,"description":"","interpolated":true},{"x":1674562113,"y":2.28,"description":"","interpolated":true},{"x":1674563394,"y":1.74,"description":"","interpolated":true},{"x":1674564675,"y":1.25,"description":"","interpolated":true},{"x":1674565956,"y":0.84,"description":"","interpolated":true},{"x":1674567237,"y":0.51,"description":"","interpolated":true},{"x":1674568518,"y":0.27,"description":"","interpolated":true},{"x":1674569799,"y":0.12,"description":"","interpolated":true},{"x":1674571080,"y":0.07,"description":"low","interpolated":false},{"x":1674572037,"y":0.12,"description":"","interpolated":true},{"x":1674572994,"y":0.26,"description":"","interpolated":true},{"x":1674573951,"y":0.49,"description":"","interpolated":true},{"x":1674574908,"y":0.8,"description":"","interpolated":true},{"x":1674575865,"y":1.19,"description":"","interpolated":true},{"x":1674576822,"y":1.65,"description":"","interpolated":true},{"x":1674577779,"y":2.16,"description":"","interpolated":true},{"x":1674578736,"y":2.72,"description":"","interpolated":true},{"x":1674579693,"y":3.31,"description":"","interpolated":true},{"x":1674580650,"y":3.91,"description":"","interpolated":true},{"x":1674581607,"y":4.5,"description":"","interpolated":true},{"x":1674582564,"y":5.09,"description":"","interpolated":true},{"x":1674583521,"y":5.65,"description":"","interpolated":true},{"x":1674584478,"y":6.16,"description":"","interpolated":true},{"x":1674585435,"y":6.62,"description":"","interpolated":true},{"x":1674586392,"y":7.01,"description":"","interpolated":true},{"x":1674587349,"y":7.32,"description":"","interpolated":true},{"x":1674588306,"y":7.55,"description":"","interpolated":true},{"x":1674589263,"y":7.69,"description":"","interpolated":true},{"x":1674590220,"y":7.74,"description":"high","interpolated":false},{"x":1674591483,"y":7.69,"description":"","interpolated":true},{"x":1674592746,"y":7.56,"description":"","interpolated":true},{"x":1674594009,"y":7.33,"description":"","interpolated":true},{"x":1674595272,"y":7.03,"description":"","interpolated":true},{"x":1674596535,"y":6.65,"description":"","interpolated":true},{"x":1674597798,"y":6.21,"description":"","interpolated":true},{"x":1674599061,"y":5.71,"description":"","interpolated":true},{"x":1674600324,"y":5.17,"description":"","interpolated":true},{"x":1674601587,"y":4.6,"description":"","interpolated":true},{"x":1674602850,"y":4.02,"description":"","interpolated":true},{"x":1674604113,"y":3.44,"description":"","interpolated":true}],"overlays":[{"renderer":"MoonPhasesOverlayRenderer","data":{"phase":"Waxing Crescent","phaseCode":"waxc","percentageFull":10,"hemisphere":"n"}}]}],"controlPoints":{"pre":{"x":1673986380,"y":1.93,"description":"low","interpolated":false},"post":{"x":1674615480,"y":0.3,"description":"low","interpolated":false}},"controlPoint":null},"xAxisMin":1674000000,"xAxisMax":1674604799},"carousel":{"size":3775,"start":3062},"units":{"height":"m"},"issueDateTime":"2022-12-06 13:07:54","nextIssueDateTime":"2022-12-07 13:07:54"},"sunrisesunset":{"dataConfig":{"series":{"config":{"id":"sunrisesunset","lineFill":true,"lineRenderer":"StraightLineRenderer","showPoints":false,"pointRenderer":"SunriseSunsetPointRenderer","pointFormatter":"SunriseSunsetPointFormatter"},"yAxisDataMin":null,"yAxisDataMax":null,"yAxisMin":null,"yAxisMax":null,"groups":[{"dateTime":1674000000,"points":[{"x":1674027186,"description":"First Light","type":"first-light"},{"x":1674029431,"description":"Sunrise","type":"sunrise"},{"x":1674060238,"description":"Sunset","type":"sunset"},{"x":1674062483,"description":"Last Light","type":"last-light"}]},{"dateTime":1674086400,"points":[{"x":1674113533,"description":"First Light","type":"first-light"},{"x":1674115771,"description":"Sunrise","type":"sunrise"},{"x":1674146734,"description":"Sunset","type":"sunset"},{"x":1674148972,"description":"Last Light","type":"last-light"}]},{"dateTime":1674172800,"points":[{"x":1674199879,"description":"First Light","type":"first-light"},{"x":1674202109,"description":"Sunrise","type":"sunrise"},{"x":1674233232,"description":"Sunset","type":"sunset"},{"x":1674235462,"description":"Last Light","type":"last-light"}]},{"dateTime":1674259200,"points":[{"x":1674286221,"description":"First Light","type":"first-light"},{"x":1674288443,"description":"Sunrise","type":"sunrise"},{"x":1674319731,"description":"Sunset","type":"sunset"},{"x":1674321953,"description":"Last Light","type":"last-light"}]},{"dateTime":1674345600,"points":[{"x":1674372561,"description":"First Light","type":"first-light"},{"x":1674374776,"description":"Sunrise","type":"sunrise"},{"x":1674406231,"description":"Sunset","type":"sunset"},{"x":1674408445,"description":"Last Light","type":"last-light"}]},{"dateTime":1674432000,"points":[{"x":1674458899,"description":"First Light","type":"first-light"},{"x":1674461105,"description":"Sunrise","type":"sunrise"},{"x":1674492732,"description":"Sunset","type":"sunset"},{"x":1674494938,"description":"Last Light","type":"last-light"}]},{"dateTime":1674518400,"points":[{"x":1674545234,"description":"First Light","type":"first-light"},{"x":1674547433,"description":"Sunrise","type":"sunrise"},{"x":1674579234,"description":"Sunset","type":"sunset"},{"x":1674581432,"description":"Last Light","type":"last-light"}]}],"controlPoints":{"pre":null,"post":null},"controlPoint":null},"xAxisMin":1674000000,"xAxisMax":1674604799},"carousel":{"size":1096,"start":383}}},"location":{"id":243028,"name":"Appledore Torridge","displayName":"Appledore (Torridge)","region":"Devon","state":"SW","postcode":"EX39 1","timeZone":"Europe\/London","timeZoneOffset":0,"lat":51.055,"lng":-4.19,"typeId":4,"distance":null,"dataMappings":{"regionPrecis":"region_precis-met_office-ukv-daily-sw","mapOverlays":{"3":{"id":0,"name":"National"},"5":{"id":510,"name":"Cobbacombe Cross (Devon)"},"4":{"id":78,"name":"National"},"100":{"id":80,"name":"National"},"1":{"id":510,"name":"Cobbacombe Cross (Devon)"}},"cameras":null,"statistics":{"temperature":{"id":99,"distance":4},"wind":{"id":99,"distance":4}}}}} %}
{% set points = a['forecastGraphs']['tides']['dataConfig']['series']['groups'][0]['points'] %}
{% set n = now()|as_timestamp()|int %}
{{ (points|selectattr('x','>=',n)|first) }}

After the hard-coded data expires (as now() marches inexorably on), you’ll need to set n as a value such as 1674100000 to get results out of it.

Troon · January 18, 2023, 4:18pm

Replying to myself: my previous attempt above doesn’t look through all the data. There are several groups of points in the data to allow for the graph plotter to insert moon phases, and I was only looking at the first (['groups'][0]['points'] in the second line of the template).

Probably won’t make any difference for the “next tide height” sensor, but good in case you try to create other look-aheads — this one looks through all the groups:

- platform: command_line
  name: Appledore current tide height
  scan_interval: 1200
  unique_id: b933ef4d-4b36-4e45-afdb-619eee1bb02e
  command: "curl -s https://tides.willyweather.co.uk/sw/devon/appledore-torridge.html | grep forecastGraphs | cut -d: -f2-"
  unit_of_measurement: 'm'
  value_template: >-
    {% set input = value[:-3] %}
    {% set groups = (input|from_json)['forecastGraphs']['tides']['dataConfig']['series']['groups'] %}
    {% set ns = namespace(points=[]) %}
    {% for group in groups %}
      {% set ns.points = ns.points + group['points'] %}
    {% endfor %}
    {% set n = now()|as_timestamp()|int %}
    {{ (ns.points|selectattr('x','>=',n)|first)['y'] }}