Support for Environment Canada platforms

Third party integrations
22

I seem to continually get update errors when I use this platform. However, it seems that all sensors are still updating frequently despite the errors. For example:

2019-07-30 09:34:59 ERROR (MainThread) [homeassistant.components.sensor] environment_canada: Error on device update! 
Traceback (most recent call last): 
  File "/usr/local/lib/python3.7/site-packages/urllib3/connection.py", line 160, in _new_conn (self._dns_host, self.port), self.timeout, **extra_kw) 
  File "/usr/local/lib/python3.7/site-packages/urllib3/util/connection.py", line 57, in create_connection for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 
  File "/usr/local/lib/python3.7/socket.py", line 748, in getaddrinfo for res in _socket.getaddrinfo(host, port, family, type, proto, flags): socket.gaierror: [Errno -3] Try again During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/local/lib/python3.7/site-packages/urllib3/connectionpool.py", line 603, in urlopen chunked=chunked) 
  File "/usr/local/lib/python3.7/site-packages/urllib3/connectionpool.py", line 355, in _make_request conn.request(method, url, **httplib_request_kw) 
  File "/usr/local/lib/python3.7/http/client.py", line 1244, in request self._send_request(method, url, body, headers, encode_chunked) 
  File "/usr/local/lib/python3.7/http/client.py", line 1290, in _send_request self.endheaders(body, encode_chunked=encode_chunked) 
  File "/usr/local/lib/python3.7/http/client.py", line 1239, in endheaders self._send_output(message_body, encode_chunked=encode_chunked) 
  File "/usr/local/lib/python3.7/http/client.py", line 1026, in _send_output self.send(msg) File "/usr/local/lib/python3.7/http/client.py", line 966, in send self.connect()
  File "/usr/local/lib/python3.7/site-packages/urllib3/connection.py", line 183, in connect conn = self._new_conn() File "/usr/local/lib/python3.7/site-packages/urllib3/connection.py", line 169, in _new_conn self, "Failed to establish a new connection: %s" % e) urllib3.exceptions.NewConnectionError: <urllib3.connection.HTTPConnection object at 0x7fa1cfc0ae50>: Failed to establish a new connection: [Errno -3] Try again

During handling of the above exception, another exception occurred:
Traceback (most recent call last): File "/usr/local/lib/python3.7/site-packages/requests/adapters.py", line 449, in send timeout=timeout 
  File "/usr/local/lib/python3.7/site-packages/urllib3/connectionpool.py", line 641, in urlopen _stacktrace=sys.exc_info()[2]) 
  File "/usr/local/lib/python3.7/site-packages/urllib3/util/retry.py", line 399, in increment raise MaxRetryError(_pool, url, error or ResponseError(cause)) urllib3.exceptions.MaxRetryError: HTTPConnectionPool(host='dd.weatheroffice.ec.gc.ca', port=80): Max retries exceeded with url: /citypage_weather/xml/ON/s0000326_e.xml (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7fa1cfc0ae50>: Failed to establish a new connection: [Errno -3] Try again'))

During handling of the above exception, another exception occurred: 
Traceback (most recent call last): File "/usr/src/homeassistant/homeassistant/helpers/entity_platform.py", line 261, in _async_add_entity await entity.async_device_update(warning=False) 
  File "/usr/src/homeassistant/homeassistant/helpers/entity.py", line 380, in async_device_update await self.hass.async_add_executor_job(self.update) 
  File "/usr/local/lib/python3.7/concurrent/futures/thread.py", line 57, in run result = self.fn(*self.args, **self.kwargs) 
  File "/usr/src/homeassistant/homeassistant/util/__init__.py", line 224, in wrapper result = method(*args, **kwargs) 
  File "/usr/src/homeassistant/homeassistant/components/environment_canada/sensor.py", line 145, in update self.ec_data.update() File "/usr/local/lib/python3.7/site-packages/env_canada/env_canada.py", line 72, in update timeout=10) 
  File "/usr/local/lib/python3.7/site-packages/requests/api.py", line 75, in get return request('get', url, params=params, **kwargs) File "/usr/local/lib/python3.7/site-packages/requests/api.py", line 60, in request return session.request(method=method, url=url, **kwargs) 
  File "/usr/local/lib/python3.7/site-packages/requests/sessions.py", line 533, in request resp = self.send(prep, **send_kwargs) 
  File "/usr/local/lib/python3.7/site-packages/requests/sessions.py", line 646, in send r = adapter.send(request, **kwargs) 
  File "/usr/local/lib/python3.7/site-packages/requests/adapters.py", line 516, in send raise ConnectionError(e, request=request) requests.exceptions.ConnectionError: HTTPConnectionPool(host='dd.weatheroffice.ec.gc.ca', port=80): Max retries exceeded with url: /citypage_weather/xml/ON/s0000326_e.xml (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7fa1cfc0ae50>: Failed to establish a new connection: [Errno -3] Try again'))
23

Interesting. That’s the right address, so I’m not sure what could be causing that. I suspect that it might be something upstream, e.g. DNS or the web server itself.

24

Not sure how easy it is to add the yesterday’s total precipitation to the component or if anyone is interested in getting it?

I am currently using yesterday’s data from the Environment Canada website for my location. I took yesterday’s total precipitation and added it to my Homeassistant system using the scrape sensor. I am using this to determine if my garden needs watering today.

Here are the details of my config if anyone is interested:

sensor:
  - platform: scrape
    resource: https://weather.gc.ca/city/pages/nb-36_metric_e.html
    name: Environment Canada yesterday's precipitation
    select: 'section:nth-child(6) > details > div > div:nth-child(2) > dl > dd'
    value_template: '{{ ((value.split(" ")[0]) | float ) }}'
    unit_of_measurement: "mm"
2 Likes
25

Great idea, I’ve added this to my library and submitted PRs to add it to the component as well.

26

Is there an ‘last updated’ information available at the source for the camera?

The GIF has the times on it, but they’re kinda small and in UTC. If it were an attribute you could template it onto the card or even put it on the title.

1 Like
27

Good idea, I’ve added this for 0.98.

28

Quite a few changes took affect in 0.97, hopefully for the better. I’ve tried to capture them all above at Support for Environment Canada platforms, and have updated the documentation at https://www.home-assistant.io/components/environment_canada. If you run into any trouble, please let me know.

29

After update to 0.97, sensor.humidex shows unknown, anytime humidex reported as none.
This was still working on v0.96 as a monitored_condition.
Has anyone have the same issue?

30

My humidex sensor on 0.97.1 showed values when they were present yesterday. As I noted above though, monitored_conditions was removed as a parameter in 0.97, and the sensors are no longer automatically hidden. Is that what you’re seeing?

31

What I meant to say was, if there is no humidex reported by Environment of Canada, the entity value shown is just “unknown”.

32

Yes, I think that’s how the frontend represents None from the backend. Is that a problem?

I did notice that there’s no unit anymore, since Environment Canada doesn’t provide one. I might hardcode that for the humidex and wind chill values.

33

I currently used Darksky but would like to switch to this component but I use Darksky’s cloud cover sensor to determine when I should open or close my blinds and I don’t see this sensor in this platform.
Is this a possibility? Also a pollen sensor for Canada would be great too.
thanks

34

It is not a big problem, but to me “unknown” suggest something is broken. " None", " - " or no value would be better I think.

35

I have updated hassio to the last release and the camera is not working. As per the log below any idea what would be the problem. tks
‘Log Details (ERROR)
Mon Aug 12 2019 12:03:04 GMT-0400 (Eastern Daylight Time)
environment_canada: Error on device update!
Traceback (most recent call last):
File “/usr/src/homeassistant/homeassistant/helpers/entity_platform.py”, line 291, in _async_add_entity
await entity.async_device_update(warning=False)
File “/usr/src/homeassistant/homeassistant/helpers/entity.py”, line 419, in async_device_update
await self.hass.async_add_executor_job(self.update)
File “/usr/local/lib/python3.7/concurrent/futures/thread.py”, line 57, in run
result = self.fn(*self.args, **self.kwargs)
File “/usr/src/homeassistant/homeassistant/util/init.py”, line 240, in wrapper
result = method(*args, **kwargs)
File “/usr/src/homeassistant/homeassistant/components/environment_canada/camera.py”, line 101, in update
self.image = self.radar_object.get_loop()
File “/usr/local/lib/python3.7/site-packages/env_canada/ec_radar.py”, line 98, in get_loop
frames = self.get_frames(count)
File “/usr/local/lib/python3.7/site-packages/env_canada/ec_radar.py”, line 81, in get_frames
frames.append(frames[count - 1])
IndexError: list index out of range’

36

I managed to ‘fix’ the previous errors I was seeing by reducing the number of monitored conditions. However, now with the latest update, and all sensors data pulled, I’m again seeing a large number of connection errors. However, they’re sporadic and I still am able to get updates for the sensors so I know that the connection works most of the time. I apologize if the reason was discussed, but would it be possible to add the monitored_conditions parameter back? It seemed to fix the issues I’m having again.

37

@stevenjev Thanks for bringing this up. I think that the likely cause of the errors is that the update of each sensor is triggering a fetch of the website, and that some of the requests are probably being blocked by a WAF or something similar, as a bunch of them are coming at once from a single IP. My plan is to add throttling into the library to prevent this.

As for the monitored_conditions parameter, removing this was based on an architectural decision for the system overall as detailed at https://github.com/home-assistant/architecture/blob/6eac2963d86a94642103e4524c8ff5e00645aa7b/adr/0003-monitor-condition-and-data-selectors.md

@Woodcat64 That makes sense. I’ll see if it would work for the component to return a string None rather than the Python null object None .

@fantangelo Unfortunately, it doesn’t look like Environment Canada provides data for cloud cover percentage or pollen.

@norm Do you know what radar station you’re using?

1 Like
39

I have the same issue, with automatic location or when using ASBV station. Haven’t tried other station

40

@e_jp Thanks, that helped. I looked into this, and it seems that the station code needs to be in the form of either CXXXX or XXX. So in your case, it should be CASBV, while for me it’s XFT. I’ve tightened up the config validation for this field, and I’ll fix the documentation as well.

I’m not sure why the automatic location wouldn’t work though. If you want to DM me your approximate coordinates, I can test it out.

41

Using CASBV fixed it. I DMed you my coordinates.

1 Like
42

Using CASBV fixed it for me as well. Thanks.

1 Like