Scrape a page help

Configuration
1

I am having trouble… troubleshooting my issue. I cant tell if my config isn’t getting logged in or if its having trouble scraping the page

I am attempting to grab the previous 24 hr use value from here

<div class="row">
                                                        <div class="col-12 col-sm-12 col-md-6 col-lg-6 col-xl-4" style="padding-left: 0px">
                                                            <table style="width: 100%">
                                                                <tbody><tr>
                                                                    <td style="width: 50%">
                                                                        <span id="Content_PageFormLayout_MeterCallbackPanel_twentyFourHourUse" style="color: dimgrey; font-weight: bold; font-size: 1.7em">Previous 24
                                                                        </span>
                                                                    </td>
                                                                    <td rowspan="2" style="text-align: left"><span id="Content_PageFormLayout_MeterCallbackPanel_Previous24HourUseLabel" style="font-size: 2.0em; font-weight: bold;">1,030 gal.</span></td>
                                                                </tr>
                                                                <tr>
                                                                    <td>
                                                                        <span id="Content_PageFormLayout_MeterCallbackPanel_twentyFourHourUse2" style="color: dimgrey; font-weight: bold; font-size: 1.7em">
                                                                            <table>
                                                                                <tbody><tr>
                                                                                    <td>Hour Use:
                                                                                    </td>
                                                                                    <td></td>
                                                                                </tr>
                                                                            </tbody></table>
                                                                        </span>
                                                                    </td>
                                                                </tr>
                                                            </tbody></table>
                                                        </div>
                                                        <div id="Content_PageFormLayout_MeterCallbackPanel_thirtyDayDiv" class="col-12 col-sm-12 col-md-6 col-lg-6 col-xl-4">
                                                            <table style="width: 100%">
                                                                <tbody><tr>
                                                                    <td style="width: 50%;">
                                                                        <span id="Content_PageFormLayout_MeterCallbackPanel_thirtyDayUse" style="color: dimgrey; font-weight: bold; font-size: 1.7em">30 Day Avg
                                                                        </span>
                                                                    </td>
                                                                    <td rowspan="2" style="text-align: left"><span id="Content_PageFormLayout_MeterCallbackPanel_thirtyDayAverageUse" style="font-size: 2.0em; font-weight: bold;">1,142 gal.</span></td>
                                                                </tr>
                                                                <tr>
                                                                    <td>
                                                                        <span id="Content_PageFormLayout_MeterCallbackPanel_thirtyDayUse2" style="color: dimgrey; font-weight: bold; font-size: 1.7em">Daily Use:
                                                                        </span>
                                                                    </td>
                                                                </tr>
                                                            </tbody></table>
                                                        </div>
                                                    </div>

the login page is dead simple so i dont think that is my issue, but it might be

image
image696×581 26 KB

my config.yaml

sensor:

  • platform: scrape
    resource: Login
    name: water
    select: “#Content_PageFormLayout_MeterCallbackPanel_Previous24HourUseLabel”
    username: #####
    password: #####
    authentication: digest
2

The value im looking for is this

3

Just to recap: The value you are looking for is on a website that you can only see after you login via that form?

In that case, the scrape integration won’t work. It only supports basic or digest authentication, but no form-based authentication.

4

Crap, i was hoping that wasn’t the case.

5

Try multiscrape with form-submit feature. (still in beta)