Sensor scrape unknow

Configuration
1

image
image1366×720 205 KB

good evening guys, i’m trying to scrape from this site, specifically from this site and this pop up, i would like to get the full list, but it always returns unknown, this is my sensor conf.

thanks to those who answer me

  - platform: scrape            
    name: atm_alert
    resource: https://www.atm.it/it/Pagine/default.aspx
    select: '#Alert_m_testo'
2

The scrape sensor works with the actual HTML code that comes straight from the web server, not what you are looking at in the web browser.

This is what the scrape sensor sees:

<div id="Alert_m_sfondo" class="Alert_m_sfondo">
    <div class="Alert_m_Main">
        <div class="Alert_m_contenuto">
            <div id="Alert_m_chiudi">Chiudi</div>
            <h4 id="Alert_m_Titolo" class="Alert_m_Titolo"></h4>
            <hr class="Alert_m_linea" />
            <div id="Alert_m_testo" class="Alert_m_testo"></div>
            <br />
            <br />
        </div>
    </div>
</div>

There are possibly some good news: I can see that the actual data shown in that pop up is loaded as JSON from this URL: https://alert.atm.it/it

You could use the rest integration to fetch this JSON and then try to extract the data you’re interested in.

3

thanks buddy, i had no idea i could use his json, but since i don’t like ready-to-eat baby food, how did you know there was a json? sorry if the question is trivial but I’m a beginner

4

If the data is not in the HTML code coming from the server it must come from somewhere else, and nowadays the standard method is to fetch the data via JSON. In the web browsers Developer Tools you can select Network → Fetch/XHR to see that this website is indeed fetching the missing data as JSON.

5

thank you very much for the explanation you are really kind, however i am trying to bring home his data but nothing, i do not receive the sensor, it would seem that the template is wrong, i am using this. but according to the documentation it should be right and instead nothing, do you have any ideas?

i have tried these ways here

  - platform: rest
    resource: https://alert.atm.it/it
    name: atm alert
    value_template: "{{value_json['alert_text']}}"

  - platform: rest
    resource: https://alert.atm.it/it
    name: atm alert
    value_template: "{{value_json.alert_text}}"

---------------------------------------------------------------------------------------------

rest:
  headers:
    Content-Type: application/json  
  method: GET
  resource: https://alert.atm.it/it
  sensor:
    - name: "cambiamento_servizio"
      value_template: "{{ value_json[0]['alert_text']}}"
6

The text in json form comes from https://alert.atm.it/it?465
No idea what the “465” stands for or if it’s fixed.

7

comes from both https://alert.atm.it/it?465 and from https://alert.atm.it/it, I get the same information back, I’ll try your

8

same result, it does not create the sensor

9

Check your log. You can only put 255 characters in a state.

10

you are right maybe throwing in an input text would be the solution?

11

input_text are limited to 255 characters. Throw it in an attribute, which has no limit.

12

thanks petro, i try to do it because i never did, thanks again, in case i ask you for a hand

13

thx so much, i resolve with this

  - platform: rest
    name: comunicazione servizio
    resource: https://alert.atm.it/it
    method: GET
    value_template: >
      {{value_json[0].alert_text}}
    json_attributes:cf
      - alert_text