Could do with some help with setting up scrape (either yaml or ui)

aplittlecub · February 12, 2024, 10:15am

Hey,

I’m trying to scrape some information regarding bus times from this url: http://www.mybustracker.co.uk/?module=consult&googleMapMode=4&busStopCode=36235453

Relevant Code from URL:

<tbody id="tbodyTimesNewTr">
<tr class="tResult" id="range1">
<td colspan="3" class="tResultHover" title="PDF Service Diagram" onclick="openPopup('?module=BTMain&amp;displayDiagram=true&amp;serviceRef=47','_blank',600,400,null,null);">36235453 Kingston Avenue / Royal Infirmary - West Granton</td>
</tr>
<tr class="tblanc QzJAEUTl" id="range2">
<td class="service">24</td>
<td title="Click to see the diversion on the map" onclick="affichServiceOnMap('googlemap','47');" class="dest diverted">West Granton</td>
<td class="time">
<span class="mins">DUE</span>
<span class="flag handi">
<img src="/images/pixel_transparent.gif">
</span>
<span class="journeyAccess">
<img src="modules/Edinburgh/BTTimeConsult/images/journey_access.png" alt="Display journey times" title="Display journey times" onclick="showJourneyTimes('1820');" onmouseover="this.src='modules/Edinburgh/BTTimeConsult/images/journey_access_over.png';" onmouseout="this.src='modules/Edinburgh/BTTimeConsult/images/journey_access.png';">
</span>
</td>
</tr>
<tr class="tblanc FqnNHtla" id="range3">
<td class="service">N14</td>
<td title="Click to see the diversion on the map" onclick="affichServiceOnMap('googlemap','47');" class="dest diverted">Royal Infirmry</td>
<td class="time">
<span class="journeyAccess">
<img src="modules/Edinburgh/BTTimeConsult/images/journey_access.png" alt="Display journey times" title="Display journey times" onclick="showJourneyTimes('1820');" onmouseover="this.src='modules/Edinburgh/BTTimeConsult/images/journey_access_over.png';" onmouseout="this.src='modules/Edinburgh/BTTimeConsult/images/journey_access.png';">
</span>
<span class="mins">59</span>
<span class="flag handi">
<img src="/images/pixel_transparent.gif">
</span>
</td>
</tr>
<tr class="tgris QzJAEUTl" id="range4">
<td class="service">24</td>
<td title="Click to see the diversion on the map" onclick="affichServiceOnMap('googlemap','47');" class="dest diverted">West Granton</td>
<td class="time">
<span class="mins">20</span>
<span class="flag handi">
<img src="/images/pixel_transparent.gif">
</span>
<span class="journeyAccess">
<img src="modules/Edinburgh/BTTimeConsult/images/journey_access.png" alt="Display journey times" title="Display journey times" onclick="showJourneyTimes('1793');" onmouseover="this.src='modules/Edinburgh/BTTimeConsult/images/journey_access_over.png';" onmouseout="this.src='modules/Edinburgh/BTTimeConsult/images/journey_access.png';">
</span>
</td>
</tr>
<tr class="tblanc FqnNHtla" id="range5">
<td class="service">CS1</td>
<td title="Click to see the diversion on the map" onclick="affichServiceOnMap('googlemap','47');" class="dest diverted">Leith Wlk Foot</td>
<td class="time">
<span class="journeyAccess">
<img src="modules/Edinburgh/BTTimeConsult/images/journey_access.png" alt="Display journey times" title="Display journey times" onclick="showJourneyTimes('1820');" onmouseover="this.src='modules/Edinburgh/BTTimeConsult/images/journey_access_over.png';" onmouseout="this.src='modules/Edinburgh/BTTimeConsult/images/journey_access.png';">
</span>
<span class="mins">7</span>
<span class="flag handi">
<img src="/images/pixel_transparent.gif">
</span>
</td>
</tr>
<tr class="tblanc FqnNHtla" id="range6">
<td class="service">128</td>
<td title="Click to see the diversion on the map" onclick="affichServiceOnMap('googlemap','47');" class="dest diverted">Tesco Distrib</td>
<td class="time">
<span class="journeyAccess">
<img src="modules/Edinburgh/BTTimeConsult/images/journey_access.png" alt="Display journey times" title="Display journey times" onclick="showJourneyTimes('1820');" onmouseover="this.src='modules/Edinburgh/BTTimeConsult/images/journey_access_over.png';" onmouseout="this.src='modules/Edinburgh/BTTimeConsult/images/journey_access.png';">
</span>
<span class="mins">38</span>
<span class="flag handi">
<img src="/images/pixel_transparent.gif">
</span>
</td>
</tr>
<tr class="tResult" id="range7">
<td colspan="3" class="tResultHover" title="PDF Service Diagram" onclick="openPopup('?module=BTMain&amp;displayDiagram=true&amp;serviceRef=69','_blank',600,400,null,null);">36235453 Kingston Avenue / Wester Hailes - Millerhill</td>
</tr>
<tr class="tblanc QzJAEUTl" id="range8">
<td class="service">33</td>
<td title="Click to see the diversion on the map" onclick="affichServiceOnMap('googlemap','69');" class="dest diverted">Wester Hailes</td>
<td class="time">
<span class="mins">DUE</span>
<span class="flag">
<img src="/images/pixel_transparent.gif">
</span>
<span class="journeyAccess">
<img src="modules/Edinburgh/BTTimeConsult/images/journey_access.png" alt="Display journey times" title="Display journey times" onclick="showJourneyTimes('3835');" onmouseover="this.src='modules/Edinburgh/BTTimeConsult/images/journey_access_over.png';" onmouseout="this.src='modules/Edinburgh/BTTimeConsult/images/journey_access.png';">
</span>
</td>
</tr>
<tr class="tgris QzJAEUTl" id="range9">
<td class="service">33</td>
<td title="Click to see the diversion on the map" onclick="affichServiceOnMap('googlemap','69');" class="dest diverted">Wester Hailes</td>
<td class="time">
<span class="mins">21</span>
<span class="flag">*</span>
<span class="journeyAccess">
<img src="modules/Edinburgh/BTTimeConsult/images/journey_access.png" alt="Display journey times" title="Display journey times" onclick="showJourneyTimes('3848');" onmouseover="this.src='modules/Edinburgh/BTTimeConsult/images/journey_access_over.png';" onmouseout="this.src='modules/Edinburgh/BTTimeConsult/images/journey_access.png';">
</span>
</td>
</tr>
<tr class="tResult" id="range10">
<td colspan="3" class="tResultHover" title="PDF Service Diagram" onclick="openPopup('?module=BTMain&amp;displayDiagram=true&amp;serviceRef=87','_blank',600,400,null,null);">36235453 Kingston Avenue / Royal Infirmary - West Granton</td>
</tr>
<tr class="tblanc FqnNHtla" id="range11">
<td class="service">N3</td>
<td title="Click to see the diversion on the map" onclick="affichServiceOnMap('googlemap','47');" class="dest diverted">Torphin</td>
<td class="time">
<span class="journeyAccess">
<img src="modules/Edinburgh/BTTimeConsult/images/journey_access.png" alt="Display journey times" title="Display journey times" onclick="showJourneyTimes('1820');" onmouseover="this.src='modules/Edinburgh/BTTimeConsult/images/journey_access_over.png';" onmouseout="this.src='modules/Edinburgh/BTTimeConsult/images/journey_access.png';">
</span>
<span class="mins">35</span>
<span class="flag handi">
<img src="/images/pixel_transparent.gif">
</span>
</td>
</tr>
<tr class="tblanc FqnNHtla" id="range12">
<td class="service">11</td>
<td title="Click to see the diversion on the map" onclick="affichServiceOnMap('googlemap','47');" class="dest diverted">Elm Row</td>
<td class="time">
<span class="journeyAccess">
<img src="modules/Edinburgh/BTTimeConsult/images/journey_access.png" alt="Display journey times" title="Display journey times" onclick="showJourneyTimes('1820');" onmouseover="this.src='modules/Edinburgh/BTTimeConsult/images/journey_access_over.png';" onmouseout="this.src='modules/Edinburgh/BTTimeConsult/images/journey_access.png';">
</span>
<span class="mins">27</span>
<span class="flag handi">
<img src="/images/pixel_transparent.gif">
</span>
</td>
</tr>
<tr class="tblanc FqnNHtla" id="range13">
<td class="service">43</td>
<td title="Click to see the diversion on the map" onclick="affichServiceOnMap('googlemap','47');" class="dest diverted">Roslin</td>
<td class="time">
<span class="journeyAccess">
<img src="modules/Edinburgh/BTTimeConsult/images/journey_access.png" alt="Display journey times" title="Display journey times" onclick="showJourneyTimes('1820');" onmouseover="this.src='modules/Edinburgh/BTTimeConsult/images/journey_access_over.png';" onmouseout="this.src='modules/Edinburgh/BTTimeConsult/images/journey_access.png';">
</span>
<span class="mins">52</span>
<span class="flag handi">
<img src="/images/pixel_transparent.gif">
</span>
</td>
</tr>
<tr class="tblanc QzJAEUTl" id="range14">
<td class="service">38</td>
<td title="Click to see the diversion on the map" onclick="affichServiceOnMap('googlemap','87');" class="dest diverted">West Granton</td>
<td class="time">
<span class="mins">DUE</span>
<span class="flag">
<img src="/images/pixel_transparent.gif">
</span>
<span class="journeyAccess">
<img src="modules/Edinburgh/BTTimeConsult/images/journey_access.png" alt="Display journey times" title="Display journey times" onclick="showJourneyTimes('5781');" onmouseover="this.src='modules/Edinburgh/BTTimeConsult/images/journey_access_over.png';" onmouseout="this.src='modules/Edinburgh/BTTimeConsult/images/journey_access.png';">
</span>
</td>
</tr>
<tr class="tblanc FqnNHtla" id="range15">
<td class="service">43</td>
<td title="Click to see the diversion on the map" onclick="affichServiceOnMap('googlemap','47');" class="dest diverted">Elm Row</td>
<td class="time">
<span class="journeyAccess">
<img src="modules/Edinburgh/BTTimeConsult/images/journey_access.png" alt="Display journey times" title="Display journey times" onclick="showJourneyTimes('1820');" onmouseover="this.src='modules/Edinburgh/BTTimeConsult/images/journey_access_over.png';" onmouseout="this.src='modules/Edinburgh/BTTimeConsult/images/journey_access.png';">
</span>
<span class="mins">37</span>
<span class="flag handi">
<img src="/images/pixel_transparent.gif">
</span>
</td>
</tr>
<tr class="tgris QzJAEUTl" id="range16">
<td class="service">38</td>
<td title="Click to see the diversion on the map" onclick="affichServiceOnMap('googlemap','87');" class="dest diverted">West Granton</td>
<td class="time">
<span class="mins">31</span>
<span class="flag">
<img src="/images/pixel_transparent.gif">
</span>
<span class="journeyAccess">
<img src="modules/Edinburgh/BTTimeConsult/images/journey_access.png" alt="Display journey times" title="Display journey times" onclick="showJourneyTimes('5796');" onmouseover="this.src='modules/Edinburgh/BTTimeConsult/images/journey_access_over.png';" onmouseout="this.src='modules/Edinburgh/BTTimeConsult/images/journey_access.png';">
</span>
</td>
</tr>
<tr class="tblanc FqnNHtla" id="range17">
<td class="service">43</td>
<td title="Click to see the diversion on the map" onclick="affichServiceOnMap('googlemap','47');" class="dest diverted">Seton Sands</td>
<td class="time">
<span class="journeyAccess">
<img src="modules/Edinburgh/BTTimeConsult/images/journey_access.png" alt="Display journey times" title="Display journey times" onclick="showJourneyTimes('1820');" onmouseover="this.src='modules/Edinburgh/BTTimeConsult/images/journey_access_over.png';" onmouseout="this.src='modules/Edinburgh/BTTimeConsult/images/journey_access.png';">
</span>
<span class="mins">16</span>
<span class="flag handi">
<img src="/images/pixel_transparent.gif">
</span>
</td>
</tr>
<tr class="tResult" id="range18">
<td colspan="3" class="tResultHover" title="PDF Service Diagram" onclick="openPopup('?module=BTMain&amp;displayDiagram=true&amp;serviceRef=105','_blank',600,400,null,null);">36235453 Kingston Avenue / Fort Kinnaird - Royal Infirmary</td>
</tr>
<tr class="tblanc QzJAEUTl" id="range19">
<td class="service">49</td>
<td title="Click to see the diversion on the map" onclick="affichServiceOnMap('googlemap','105');" class="dest diverted">Fort Kinnaird</td>
<td class="time">
<span class="mins">11</span>
<span class="flag handi">
<img src="/images/pixel_transparent.gif">
</span>
<span class="journeyAccess">
<img src="modules/Edinburgh/BTTimeConsult/images/journey_access.png" alt="Display journey times" title="Display journey times" onclick="showJourneyTimes('7104');" onmouseover="this.src='modules/Edinburgh/BTTimeConsult/images/journey_access_over.png';" onmouseout="this.src='modules/Edinburgh/BTTimeConsult/images/journey_access.png';">
</span>
</td>
</tr>
<tr class="tblanc FqnNHtla" id="range20">
<td class="service">33</td>
<td title="Click to see the diversion on the map" onclick="affichServiceOnMap('googlemap','47');" class="dest diverted">Leith Wlk Foot</td>
<td class="time">
<span class="journeyAccess">
<img src="modules/Edinburgh/BTTimeConsult/images/journey_access.png" alt="Display journey times" title="Display journey times" onclick="showJourneyTimes('1820');" onmouseover="this.src='modules/Edinburgh/BTTimeConsult/images/journey_access_over.png';" onmouseout="this.src='modules/Edinburgh/BTTimeConsult/images/journey_access.png';">
</span>
<span class="mins">30</span>
<span class="flag handi">
<img src="/images/pixel_transparent.gif">
</span>
</td>
</tr>
<tr class="tgris QzJAEUTl" id="range21">
<td class="service">49</td>
<td title="Click to see the diversion on the map" onclick="affichServiceOnMap('googlemap','105');" class="dest diverted">Fort Kinnaird</td>
<td class="time">
<span class="mins">31</span>
<span class="flag handi">
<img src="/images/pixel_transparent.gif">
</span>
<span class="journeyAccess">
<img src="modules/Edinburgh/BTTimeConsult/images/journey_access.png" alt="Display journey times" title="Display journey times" onclick="showJourneyTimes('7068');" onmouseover="this.src='modules/Edinburgh/BTTimeConsult/images/journey_access_over.png';" onmouseout="this.src='modules/Edinburgh/BTTimeConsult/images/journey_access.png';">
</span>
</td>
</tr>
</tbody>

Attached screenshot shows the information I’m trying to scrape…
3 elements for each row:
purple: Bus Number
Orange: Destination Name (not that important really)
Green: Time until due

I’m finding the scrape documentation extremely confusing and could use help getting this working…

49f3dab6-50ed-4890-b799-0c2e86741f5e_text