Custom component Afvalbeheer - Support for multiple waste collectors

Share your Projects! Custom Integrations
1

Hey guys, I’ve created a custom component for the Dutch waste collector Cure Afvalbeheer. It creates sersors (for the waste fractions you specify in the configuration.yaml) like this:
Cure%20Sensors
If anyone wants to implement the component, this is the code:

EDIT: Now support for these waste collectors:

  • Alphen Aan Den Rijn
  • Avalex
  • Berkelland
  • Blink
  • Circulus-Berkel
  • Cranendonck
  • Cure
  • Cyclus
  • DAR
  • Den Haag
  • GAD
  • HVC
  • Meerlanden
  • Montfoort
  • RMN
  • Spaarnelanden
  • Venray
  • Waalre
  • ZRD

EDIT: Code now on github
Github Cure Afvalbeheer

8 Likes
2

Isn’t it always the same day of the week that Cure Afvalbeheer is collecting? I mean, it would be nice to know what time they are in my street so I can have an excuse to my collegues and leave work earlier :slight_smile:

3

Most of the time it is the same day of the week, but not always! The time is sadly not shared by Cure, so i have no way of knowing what time they will be there.

1 Like
4

Nice!!

Would it be easy to modify this for use with the Afvalwijzer of for instance the gemeente Groningen?

https://gemeente.groningen.nl/afvalwijzer/groningen

Log in via a random address: 9721TR housnr: 2

I spent a few hours studying you code, I tried to modify it such that it would work with the above address.
Unfortunately I keep getting errors. I guess it all boils down to the right url, which I don’t seem to get right…

5

there s a component for that already, has been around and is frequently updated by @xirixiz

see community: Garbage pickup date (mijnafvalwijzer.nl) custom_component

@xirixiz’s Github: https://github.com/xirixiz/home-assistant-config/blob/master/custom_components/sensor/mijnafvalwijzer.py

12

Lovelace:

  - type: vertical-stack
    cards:
      - type: custom:useful-markdown-card
        content: >
          Vandaag is het **<font color=var(--secondary-text-color)>[[ sensor.vandaag.state ]]</font>**.
      - type: horizontal-stack
        cards:
          - type: picture-entity
            entity: sensor.trash_today
            name: Vandaag
            state_image:
              'gft': /local/mijnafvalwijzer/gft3.png
              'papier': /local/mijnafvalwijzer/papier3.png
              'restafval': /local/mijnafvalwijzer/restafval3.png
              'plastic verpakkingsafval': /local/mijnafvalwijzer/plastic3.png
              'Geen': /local/mijnafvalwijzer/kliko3.png
          - type: picture-entity
            entity: sensor.trash_tomorrow
            name: Morgen
            state_image:
              'gft': /local/mijnafvalwijzer/gft3.png
              'papier': /local/mijnafvalwijzer/papier3.png
              'restafval': /local/mijnafvalwijzer/restafval3.png
              'plastic verpakkingsafval': /local/mijnafvalwijzer/plastic3.png
              'Geen': /local/mijnafvalwijzer/kliko3.png

      - type: glance
        entities:
         - entity: sensor.gft_formatted
           name: GFT
         - entity: sensor.papier_formatted
           name: Papier
         - entity: sensor.plastic_verpakkingsafval_formatted
           name: Plastic
         - entity: sensor.restafval_formatted
           name: Restafval

this new component for Cure seems heavily inspired…

1 Like
6

Thanks for pointing me to the thread!
But, unfortunately, the area where I live is not supported.

7

Groningen seems to have few options to get afvalwijzer data. However, I think it’s possible to use the following component: https://www.home-assistant.io/components/sensor.scrape/ and then scrape this page: https://gemeente.groningen.nl/afvalwijzer/bedum/9721TR/2/2018/

8

yes, I use those also:

  afval_vandaag:
    friendly_name: 'Afval vandaag'
    value_template: >-
       {% if is_state('sensor.afval_datum', 'vandaag') %}
        {{states('sensor.afval_soort')}}
        {% else %}
        Geen
        {% endif %}
    entity_picture_template: >
      {% set mapper = {'Papier': '/local/mijnafvalwijzer/papier.png',
                       'Groente, Fruit en Tuinafval': '/local/mijnafvalwijzer/gft.png',
                       'Plastic verpakkingsafval': '/local/mijnafvalwijzer/plastic.png',
                       'Restafval': '/local/mijnafvalwijzer/restafval.png'} %}
      {% set state = states('sensor.afval_vandaag') %}
      {{ mapper[state] if state in mapper else '/local/mijnafvalwijzer/kliko.png' }}



  - platform: scrape
    resource: !secret scrape_resource_date
    name: Afval Datum
    select: ".firstDate"
    scan_interval: 60

  - platform: scrape
    resource: !secret scrape_resource_type
    name: Afval Soort
    select: ".firstWasteType"
    scan_interval: 60

and an automation for Today:

  - alias: 'Afval vandaag'
    initial_state: on
    trigger:
      platform: time
      hours: 7 
      minutes: 0
      seconds: 0
    condition:
      - condition: template
        value_template: >
          {{ is_state('input_boolean.notify_utility', 'on')}}
      - condition: template
        value_template: >
           {{ states('sensor.afval_datum') == 'vandaag' }}
    action:
      - service: notify.notify
        data_template:
          message: >
            Het is vandaag {{ now().strftime('%d %B') }}.
            Zet het {{states('sensor.afval_soort')}} aan de straat!
      - condition: template
        value_template: >
          {{ is_state('input_boolean.persistent_notification_create', 'on')}}
      - service: persistent_notification.create
        data_template:
          title: >
            Afvalmelding Vandaag: {{states('sensor.afval_soort')}}
          message: >
            Het is vandaag {{ now().strftime('%d %B') }}.
            Zet het {{states('sensor.afval_soort')}} aan de straat!
9

Again, thank you for responding.

I know the Scrape sensor, have been playing with it a bit before. Unfortunately I have not managed to get a clear understanding of how to use this sensor :frowning:

Is there a way to find out how the data exactly looks like that is being scraped? Once I know that, I am probably able to get it to work.

This is the important part of the website, I think, showing via View page source:

    <tbody><tr data-lob="HGRIJS" data-material="MINI" class="blockWrapper RGE2Z1-16">
      <th scope="row"><h2>Grijze container</h2>
        <a title="Meer informatie over Grijze container" href="/afval/huisvuil-en-restafval-inleveren"><img alt="Grijze container" src="/sites/all/modules/custom/afvalwijzer/img/web_picto.minicontainer_grijs.jpg"></a><p>Wordt op de aangegeven dinsdagen<br />opgehaald. U mag de grijze container<br />tussen 6.00-8.00 uur aan de straat<br />zetten.<br /></p>
      </th><td class="m-01"><ul><li>9</li><li>23</li></ul></td><td class="m-02"><ul><li>6</li><li>20</li></ul></td><td class="m-03"><ul><li>6</li><li>20</li></ul></td><td class="m-04"><ul><li>3</li><li>17</li></ul></td><td class="m-05"><ul><li>1</li><li>15</li><li>29</li></ul></td><td class="m-06"><ul><li>12</li><li>26</li></ul></td><td class="m-07"><ul><li>10</li><li>24</li></ul></td><td class="m-08"><ul><li>7</li><li>21</li></ul></td><td class="m-09"><ul><li>4</li><li>18</li></ul></td><td class="m-10"><ul><li>2</li><li>16</li><li>30</li></ul></td><td class="m-11"><ul><li>13</li><li>27</li></ul></td><td class="m-12"><ul><li>11</li><li class="afwijkende-ophaaldag">22</li> <li class="element-invisible">(afwijkende ophaaldag)</li></ul></td></tr><tr data-lob="HGRIJS" data-material="MINI" class="blockWrapper RGE2Z1-19">
      <th scope="row"><p>Wordt op de aangegeven dinsdagen<br />opgehaald. U mag de grijze container<br />tussen 6.00-8.00 uur aan de straat<br />zetten.<br /></p>
      </th><td class="m-01"><ul></ul></td><td class="m-02"><ul></ul></td><td class="m-03"><ul></ul></td><td class="m-04"><ul></ul></td><td class="m-05"><ul></ul></td><td class="m-06"><ul></ul></td><td class="m-07"><ul></ul></td><td class="m-08"><ul></ul></td><td class="m-09"><ul></ul></td><td class="m-10"><ul></ul></td><td class="m-11"><ul></ul></td><td class="m-12"><ul></ul></td></tr><tr data-lob="HGFT" data-material="NVT" class="blockWrapper BGO2Z1-19">
      <th scope="row"><h2>Groene container</h2>
        <a title="Meer informatie over Groene container" href="/afval/gft-inleveren"><img alt="Groene container" src="/sites/all/modules/custom/afvalwijzer/img/web_picto.minicontainer_bio.jpg"></a><p>Wordt op de aangegeven dinsdagen<br />opgehaald. U mag de groene container<br />tussen 6.00-8.00 uur aan de straat<br />zetten.<br /></p>
      </th><td class="m-01"><ul></ul></td><td class="m-02"><ul></ul></td><td class="m-03"><ul></ul></td><td class="m-04"><ul></ul></td><td class="m-05"><ul></ul></td><td class="m-06"><ul></ul></td><td class="m-07"><ul></ul></td><td class="m-08"><ul></ul></td><td class="m-09"><ul></ul></td><td class="m-10"><ul></ul></td><td class="m-11"><ul></ul></td><td class="m-12"><ul></ul></td></tr><tr data-lob="HGFT" data-material="NVT" class="blockWrapper BGO2Z1-16">
      <th scope="row"><p>Wordt op de aangegeven dinsdagen<br />opgehaald. U mag de groene container<br />tussen 6.00-8.00 uur aan de straat<br />zetten.<br /></p>
      </th><td class="m-01"><ul><li>2</li><li>16</li><li>30</li></ul></td><td class="m-02"><ul><li>13</li><li>27</li></ul></td><td class="m-03"><ul><li>13</li><li>27</li></ul></td><td class="m-04"><ul><li>10</li><li>24</li></ul></td><td class="m-05"><ul><li>8</li><li>22</li></ul></td><td class="m-06"><ul><li>5</li><li>19</li></ul></td><td class="m-07"><ul><li>3</li><li>17</li><li>31</li></ul></td><td class="m-08"><ul><li>14</li><li>28</li></ul></td><td class="m-09"><ul><li>11</li><li>25</li></ul></td><td class="m-10"><ul><li>9</li><li>23</li></ul></td><td class="m-11"><ul><li>6</li><li>20</li></ul></td><td class="m-12"><ul><li>4</li><li>18</li></ul></td></tr><tr data-lob="HGFT" data-material="KERSTB" class="blockWrapper GA3K07-17">
      <th scope="row"><h2>Kerstboom</h2>
        <a title="Meer informatie over Kerstboom" href=""><img alt="Kerstboom" src="/sites/all/modules/custom/afvalwijzer/img/web_picto_kerstboom.jpg"></a><p>Zet de kerstboom (zonder versiering!)<br />tussen 6.00 en 08.00 uur aan de straat.<br />Niet op of in de nabijheid van een<br />ondergrondse container.<br /></p>
      </th><td class="m-01"><ul></ul></td><td class="m-02"><ul></ul></td><td class="m-03"><ul></ul></td><td class="m-04"><ul></ul></td><td class="m-05"><ul></ul></td><td class="m-06"><ul></ul></td><td class="m-07"><ul></ul></td><td class="m-08"><ul></ul></td><td class="m-09"><ul></ul></td><td class="m-10"><ul></ul></td><td class="m-11"><ul></ul></td><td class="m-12"><ul></ul></td></tr><tr data-lob="TEXTL" data-material="NVT" class="blockWrapper T26">
      <th scope="row"><h2>Kleding, textiel en schoenen</h2>
        <a title="Meer informatie over Kleding, textiel en schoenen" href="/afval/textiel-inleveren"><img alt="Kleding, textiel en schoenen" src="/sites/all/modules/custom/afvalwijzer/img/web_picto.textiel.jpg"></a><p>Zet textiel in een plastic zak om 08.00<br />uur aan de straat. Ook kleine elektr.<br />apparaten mogen mee (in aparte plastic<br />zak). Inzamelaar: GoudGoed, tel.:<br />050-5266881<br /></p>
      </th><td class="m-01"><ul><li>23</li></ul></td><td class="m-02"><ul><li>27</li></ul></td><td class="m-03"><ul><li>27</li></ul></td><td class="m-04"><ul><li>24</li></ul></td><td class="m-05"><ul><li>22</li></ul></td><td class="m-06"><ul><li>26</li></ul></td><td class="m-07"><ul></ul></td><td class="m-08"><ul></ul></td><td class="m-09"><ul><li>25</li></ul></td><td class="m-10"><ul><li>23</li></ul></td><td class="m-11"><ul><li>27</li></ul></td><td class="m-12"><ul></ul></td></tr><tr data-lob="HPAP" data-material="PAP240" class="blockWrapper P72C">
      <th scope="row"><h2>Oud papier</h2>
        <a title="Meer informatie over Oud papier" href=""><img alt="Oud papier" src="/sites/all/modules/custom/afvalwijzer/img/web_picto.minicontainer_papier.jpg"></a><p>Zet de container om 8.00 uur aan de<br />straat. Geen melk- en sappakken.<br />Inzamelaar:Dweilband Lekkur Anders<br />tel: 06-11181410<br /></p>
      </th><td class="m-01"><ul><li>6</li></ul></td><td class="m-02"><ul><li>3</li></ul></td><td class="m-03"><ul><li>3</li></ul></td><td class="m-04"><ul><li>7</li></ul></td><td class="m-05"><ul><li>5</li></ul></td><td class="m-06"><ul><li>2</li></ul></td><td class="m-07"><ul><li>7</li></ul></td><td class="m-08"><ul></ul></td><td class="m-09"><ul><li>1</li></ul></td><td class="m-10"><ul><li>6</li></ul></td><td class="m-11"><ul><li>3</li></ul></td><td class="m-12"><ul><li>1</li></ul></td></tr><tr data-lob="KGA" data-material="ORIGIN" class="blockWrapper K26">

It shows the data for the whole year (2018) in a table.
How do I get out of this garble of info, the data I want?
I do understand the format: m-01 means January, m-02 means February, the dates that follow the m-xy data are the dates of pick up. Meaning pick up on Jan 9 and 23 of the “Grijze container”, and so on.

Sorry, I’m a hardware guy, I can manage some simple programming in HA itself, but this goes above my hat (bad translation :slight_smile: )

10

I have managed to get somewhere:

sensor:
  - platform: command_line
    command: "curl get https://gemeente.groningen.nl/afvalwijzer/groningen/1111AA/12/2019/ 2>&1 | grep 'blockWrapper BGO2Z1-19' | awk '{print $2}' | grep -Eo '[0-9]{1,2}' | sed -n '1p'"
    name: afv_rest_mnd

This gives me the number of the month.
By varying “blockWrapper BGO2Z1-19”, “$2” and “1p” I can get out all the data that I need.
Now I need to vary only the “$2” part of awk ‘{print $2}’ . Is there an easy way to “connect” the value now().month+1 for this month and now().month+2 for next month to the awk-statement? I tried some different things but these did not work.

11

No this component is based on the default custom sensor component.

12

I will have a look. But as far as I can see, they don’t have an API. So my implementation of Groningen Afvalwijzer would be a all-in-one scraper at best.

13

In the end I decided to create a long list of automations, 2 for each of the dates listed on the page for my postal-code. Once written not so difficult to maintain, in principle only needed once a year.
So, there is no requirement from my side anymore :slight_smile:
Appreciate your willingness to try and help though!

15

ohw that’s a shame, i have the code for Groningen Afvalwijzer ready if you want;

EDIT: Code on Github now Github Groningen Afvalwijzer

16

“Dat is snel, je lijkt … wel!”

Of course, I’ll test it, during the weekend, I don’t work close to home and doing this remotely is too cumbersome.
Also, a nice opportunity for me to learn how to code such a function…
Thanks!!

17

Let me know if it does what you expect.

I cleaned up the code and replaced it in my post above. So the code makes more sense. If you need help you can DM me in Ducth if you like.

18

image

Well Pippyn, looks like it works!

For my postal code there is no entry for “Klein chemisch afval” and there are no new " Kerstboom"-dates for the rest of the year. That explains the two "Unknown"s I think?

19

yes indeed, you can either remove them from the config, hide them using customize.yaml or hide the unknown sensors dynamicly via Lovelace. I prefer the last one, because when there are dates for those sensors they automaticly show up

20

Ok, understood. I will manage after learning how to configure Lovelace.

Again, a big thank you for picking up on my question/request! Very much appreciated!

1 Like
21

Nice work @Pippyn. Very curious to use it, however I could not get the custom_component to be recognized. I’ve placed the file in custom_components/sensor/cure_afbeheer.py as you mentioned. Added the yaml-bit to my sensor config. Restart gives this in the log:
`

2019-01-12 08:45:36 ERROR (MainThread) [homeassistant.loader] Unable to find component sensor.cure_afvalbeheer

Do I need to allow the custom_component somewhere? Another custom component (alarm) does work actually.
Next to that, I found quite some spelling issues in your script, but I hope that doesn’t influence the workings at this moment in time.

update
Good news, the component works now. The issue was indeed a typo in @Pippyn instruction :slight_smile:

Save the file as cure_afbeheer.py in [homeassistant]/config/custom_components/sensor/

The filename should be cure_afvalbeheer.py