System crashes almost everyday. Can someone help understand the logs?

Installation Home Assistant OS
1

Hi,
I’m running on RPI4 - hassio, latest versions. I just moved everything (5 days ago) to a SSD boot hoping this would solve my problem. I have a substantial system with 100+ entities. I use a Conbee II with Deconz. My issue started after an update in mid december (I sadly didn’t note which one…)

The system slows down, supervisor becomes unavailable until everything stops. I just witnessed it while working on it and was able to pick the logs as it happened. But I don’t know where to look further from those logs. The below starts when “no there’s no problem” and when it starts (we can see it by the frequent entry logs happening)

Has anybody some lights for me on how to solve this?

2021-01-15 11:26:21 WARNING (MainThread) [homeassistant.config_entries] Config entry for upnp not ready yet. Retrying in 80 seconds
2021-01-15 11:27:51 WARNING (MainThread) [homeassistant.components.upnp] Wanted UPnP/IGD device with UDN/ST "uuid:70d5b96d-4bf8-49be-b15d-96fbd6e415f4"/"urn:schemas-upnp-org:device:InternetGatewayDevice:2" not found, aborting
2021-01-15 11:27:51 WARNING (MainThread) [homeassistant.config_entries] Config entry for upnp not ready yet. Retrying in 80 seconds
2021-01-15 11:29:21 WARNING (MainThread) [homeassistant.components.upnp] Wanted UPnP/IGD device with UDN/ST "uuid:70d5b96d-4bf8-49be-b15d-96fbd6e415f4"/"urn:schemas-upnp-org:device:InternetGatewayDevice:2" not found, aborting
2021-01-15 11:29:21 WARNING (MainThread) [homeassistant.config_entries] Config entry for upnp not ready yet. Retrying in 80 seconds
2021-01-15 11:29:37 ERROR (MainThread) [homeassistant.config] Invalid config for [sensor]: required key not provided @ data['platform']. Got None. (See /config/sensors.yaml, line 1). Please check the docs at https://www.home-assistant.io/integrations/sensor
2021-01-15 11:30:40 ERROR (MainThread) [homeassistant.components.sensor] Entity id already exists - ignoring: sensor.badge_hall
2021-01-15 11:30:51 WARNING (MainThread) [homeassistant.components.upnp] Wanted UPnP/IGD device with UDN/ST "uuid:70d5b96d-4bf8-49be-b15d-96fbd6e415f4"/"urn:schemas-upnp-org:device:InternetGatewayDevice:2" not found, aborting
2021-01-15 11:30:51 WARNING (MainThread) [homeassistant.config_entries] Config entry for upnp not ready yet. Retrying in 80 seconds
2021-01-15 11:31:54 WARNING (MainThread) [homeassistant.components.media_player] Updating samsungtv media_player took longer than the scheduled update interval 0:00:10
2021-01-15 11:32:17 WARNING (MainThread) [homeassistant.components.light] Updating tuya light took longer than the scheduled update interval 0:00:15
2021-01-15 11:32:17 WARNING (MainThread) [homeassistant.components.switch] Updating tuya switch took longer than the scheduled update interval 0:00:15
2021-01-15 11:32:17 WARNING (MainThread) [homeassistant.components.cover] Updating tuya cover took longer than the scheduled update interval 0:00:15
2021-01-15 11:32:29 WARNING (MainThread) [homeassistant.components.media_player] Updating samsungtv media_player took longer than the scheduled update interval 0:00:10
2021-01-15 11:32:45 WARNING (MainThread) [homeassistant.components.media_player] Updating samsungtv media_player took longer than the scheduled update interval 0:00:10
2021-01-15 11:32:45 WARNING (MainThread) [homeassistant.components.light] Updating tuya light took longer than the scheduled update interval 0:00:15
2021-01-15 11:32:45 WARNING (MainThread) [homeassistant.components.switch] Updating tuya switch took longer than the scheduled update interval 0:00:15
2021-01-15 11:32:45 WARNING (MainThread) [homeassistant.components.cover] Updating tuya cover took longer than the scheduled update interval 0:00:15
2021-01-15 11:33:18 WARNING (MainThread) [homeassistant.config_entries] Config entry for upnp not ready yet. Retrying in 80 seconds
2021-01-15 11:33:18 WARNING (MainThread) [homeassistant.components.binary_sensor] Updating workday binary_sensor took longer than the scheduled update interval 0:00:30
2021-01-15 11:33:18 WARNING (MainThread) [homeassistant.components.switch] Updating wake_on_lan switch took longer than the scheduled update interval 0:00:30
2021-01-15 11:33:18 WARNING (MainThread) [homeassistant.components.light] Updating twinkly light took longer than the scheduled update interval 0:00:30
2021-01-15 11:33:18 WARNING (MainThread) [homeassistant.components.light] Updating twinkly light took longer than the scheduled update interval 0:00:30
2021-01-15 11:33:18 WARNING (MainThread) [homeassistant.components.media_player] Updating spotify media_player took longer than the scheduled update interval 0:00:30
2021-01-15 11:33:18 WARNING (MainThread) [homeassistant.components.light] Updating tuya light took longer than the scheduled update interval 0:00:15
2021-01-15 11:33:18 WARNING (MainThread) [homeassistant.components.switch] Updating tuya switch took longer than the scheduled update interval 0:00:15
2021-01-15 11:33:38 WARNING (MainThread) [homeassistant.components.media_player] Updating samsungtv media_player took longer than the scheduled update interval 0:00:10
2021-01-15 11:33:38 WARNING (MainThread) [homeassistant.components.light] Updating tuya light took longer than the scheduled update interval 0:00:15
2021-01-15 11:33:38 WARNING (MainThread) [homeassistant.components.switch] Updating tuya switch took longer than the scheduled update interval 0:00:15
2021-01-15 11:33:38 WARNING (MainThread) [homeassistant.components.cover] Updating tuya cover took longer than the scheduled update interval 0:00:15
2021-01-15 11:33:53 WARNING (MainThread) [homeassistant.helpers.entity] Updating state for binary_sensor.remote_ui (<class 'homeassistant.components.cloud.binary_sensor.CloudRemoteBinary'>) took 2.019 seconds. Please create a bug report at https://github.com/home-assistant/core/issues?q=is%3Aopen+is%3Aissue+label%3A%22integration%3A+cloud%22
2021-01-15 11:33:58 WARNING (MainThread) [homeassistant.components.switch] Setup of switch platform command_line is taking over 10 seconds.
2021-01-15 11:33:58 WARNING (MainThread) [homeassistant.components.sensor] Setup of sensor platform mqtt is taking over 10 seconds.
2021-01-15 11:34:17 WARNING (MainThread) [homeassistant.components.light] Updating tuya light took longer than the scheduled update interval 0:00:15
2021-01-15 11:34:17 WARNING (MainThread) [homeassistant.components.switch] Updating tuya switch took longer than the scheduled update interval 0:00:15
2021-01-15 11:34:17 WARNING (MainThread) [homeassistant.components.cover] Updating tuya cover took longer than the scheduled update interval 0:00:15
2021-01-15 11:34:18 WARNING (MainThread) [homeassistant.components.binary_sensor] Setup of binary_sensor platform template is taking over 10 seconds.
2021-01-15 11:34:18 WARNING (MainThread) [homeassistant.components.sensor] Setup of sensor platform template is taking over 10 seconds.
2021-01-15 11:34:18 WARNING (MainThread) [homeassistant.components.sensor] Setup of sensor platform template is taking over 10 seconds.
2021-01-15 11:34:18 WARNING (MainThread) [homeassistant.components.sensor] Setup of sensor platform template is taking over 10 seconds.
2021-01-15 11:34:18 WARNING (MainThread) [homeassistant.components.sensor] Setup of sensor platform template is taking over 10 seconds.
2021-01-15 11:34:18 WARNING (MainThread) [homeassistant.components.sensor] Setup of sensor platform template is taking over 10 seconds.
2021-01-15 11:34:18 WARNING (MainThread) [homeassistant.components.sensor] Setup of sensor platform template is taking over 10 seconds.
2021-01-15 11:34:18 WARNING (MainThread) [homeassistant.components.sensor] Setup of sensor platform template is taking over 10 seconds.
2021-01-15 11:34:18 WARNING (MainThread) [homeassistant.components.sensor] Setup of sensor platform template is taking over 10 seconds.
2021-01-15 11:34:18 WARNING (MainThread) [homeassistant.components.sensor] Setup of sensor platform template is taking over 10 seconds.
2021-01-15 11:34:18 WARNING (MainThread) [homeassistant.components.sensor] Setup of sensor platform template is taking over 10 seconds.
2021-01-15 11:34:18 WARNING (MainThread) [homeassistant.components.sensor] Setup of sensor platform template is taking over 10 seconds.
2021-01-15 11:34:18 WARNING (MainThread) [homeassistant.components.sensor] Setup of sensor platform template is taking over 10 seconds.
2021-01-15 11:34:18 WARNING (MainThread) [homeassistant.components.sensor] Setup of sensor platform template is taking over 10 seconds.
2021-01-15 11:34:18 WARNING (MainThread) [homeassistant.components.sensor] Setup of sensor platform template is taking over 10 seconds.
2021-01-15 11:34:18 WARNING (MainThread) [homeassistant.components.sensor] Setup of sensor platform template is taking over 10 seconds.
2021-01-15 11:34:18 WARNING (MainThread) [homeassistant.components.sensor] Setup of sensor platform template is taking over 10 seconds.
2021-01-15 11:34:18 WARNING (MainThread) [homeassistant.components.sensor] Setup of sensor platform template is taking over 10 seconds.
2021-01-15 11:34:18 WARNING (MainThread) [homeassistant.components.sensor] Setup of sensor platform template is taking over 10 seconds.
2021-01-15 11:34:18 WARNING (MainThread) [homeassistant.components.sensor] Setup of sensor platform template is taking over 10 seconds.
2021-01-15 11:34:18 WARNING (MainThread) [homeassistant.components.sensor] Setup of sensor platform template is taking over 10 seconds.
2021-01-15 11:34:18 WARNING (MainThread) [homeassistant.components.sensor] Setup of sensor platform template is taking over 10 seconds.
2021-01-15 11:34:18 WARNING (MainThread) [homeassistant.components.sensor] Setup of sensor platform template is taking over 10 seconds.
2021-01-15 11:34:18 WARNING (MainThread) [homeassistant.components.sensor] Setup of sensor platform template is taking over 10 seconds.
2021-01-15 11:34:18 WARNING (MainThread) [homeassistant.components.sensor] Setup of sensor platform template is taking over 10 seconds.
2021-01-15 11:34:18 WARNING (MainThread) [homeassistant.components.sensor] Setup of sensor platform template is taking over 10 seconds.
2021-01-15 11:34:18 WARNING (MainThread) [homeassistant.components.sensor] Setup of sensor platform template is taking over 10 seconds.
2021-01-15 11:34:18 WARNING (MainThread) [homeassistant.components.sensor] Setup of sensor platform template is taking over 10 seconds.
2021-01-15 11:34:18 WARNING (MainThread) [homeassistant.components.sensor] Setup of sensor platform template is taking over 10 seconds.
2021-01-15 11:34:18 WARNING (MainThread) [homeassistant.components.sensor] Setup of sensor platform template is taking over 10 seconds.
2021-01-15 11:34:18 WARNING (MainThread) [homeassistant.components.sensor] Setup of sensor platform template is taking over 10 seconds.
2021-01-15 11:34:18 WARNING (MainThread) [homeassistant.components.sensor] Setup of sensor platform template is taking over 10 seconds.
2021-01-15 11:34:18 WARNING (MainThread) [homeassistant.components.sensor] Setup of sensor platform template is taking over 10 seconds.
2021-01-15 11:34:18 WARNING (MainThread) [homeassistant.components.sensor] Setup of sensor platform template is taking over 10 seconds.
2021-01-15 11:34:18 WARNING (MainThread) [homeassistant.components.sensor] Setup of sensor platform template is taking over 10 seconds.
2021-01-15 11:34:18 WARNING (MainThread) [homeassistant.components.sensor] Setup of sensor platform template is taking over 10 seconds.
2021-01-15 11:34:18 WARNING (MainThread) [homeassistant.components.sensor] Setup of sensor platform template is taking over 10 seconds.
2021-01-15 11:34:18 WARNING (MainThread) [homeassistant.components.sensor] Setup of sensor platform template is taking over 10 seconds.
2021-01-15 11:34:18 WARNING (MainThread) [homeassistant.components.sensor] Setup of sensor platform template is taking over 10 seconds.
2021-01-15 11:34:18 WARNING (MainThread) [homeassistant.components.sensor] Setup of sensor platform template is taking over 10 seconds.
2021-01-15 11:34:18 WARNING (MainThread) [homeassistant.components.sensor] Setup of sensor platform template is taking over 10 seconds.
2021-01-15 11:34:18 WARNING (MainThread) [homeassistant.components.sensor] Setup of sensor platform template is taking over 10 seconds.
2021-01-15 11:34:18 WARNING (MainThread) [homeassistant.components.sensor] Setup of sensor platform template is taking over 10 seconds.
2021-01-15 11:34:18 WARNING (MainThread) [homeassistant.components.sensor] Setup of sensor platform template is taking over 10 seconds.
2021-01-15 11:34:18 WARNING (MainThread) [homeassistant.components.sensor] Setup of sensor platform template is taking over 10 seconds.
2021-01-15 11:34:18 WARNING (MainThread) [homeassistant.components.sensor] Setup of sensor platform template is taking over 10 seconds.
2021-01-15 11:34:18 WARNING (MainThread) [homeassistant.components.sensor] Setup of sensor platform template is taking over 10 seconds.
2021-01-15 11:34:18 WARNING (MainThread) [homeassistant.components.sensor] Setup of sensor platform template is taking over 10 seconds.
2021-01-15 11:34:20 ERROR (MainThread) [homeassistant.components.sensor] Entity id already exists - ignoring: sensor.badge_hall
2021-01-15 11:34:58 WARNING (MainThread) [homeassistant.helpers.entity] Updating state for sensor.time (<class 'homeassistant.components.time_date.sensor.TimeDateSensor'>) took 0.473 seconds. Please create a bug report at https://github.com/home-assistant/core/issues?q=is%3Aopen+is%3Aissue+label%3A%22integration%3A+time_date%22
2021-01-15 11:35:08 WARNING (MainThread) [homeassistant.components.sensor] Setup of sensor platform statistics is taking over 10 seconds.
2021-01-15 11:35:08 WARNING (MainThread) [homeassistant.components.sensor] Setup of sensor platform statistics is taking over 10 seconds.
2021-01-15 11:35:08 WARNING (MainThread) [homeassistant.components.binary_sensor] Setup of binary_sensor platform trend is taking over 10 seconds.
2021-01-15 11:35:08 WARNING (MainThread) [homeassistant.components.climate] Setup of climate platform generic_thermostat is taking over 10 seconds.
2021-01-15 11:35:08 WARNING (MainThread) [homeassistant.components.climate] Setup of climate platform generic_thermostat is taking over 10 seconds.
2021-01-15 11:35:08 WARNING (MainThread) [homeassistant.components.climate] Setup of climate platform generic_thermostat is taking over 10 seconds.
2021-01-15 11:35:08 WARNING (MainThread) [homeassistant.components.climate] Setup of climate platform generic_thermostat is taking over 10 seconds.
2021-01-15 11:35:08 WARNING (MainThread) [homeassistant.components.climate] Setup of climate platform generic_thermostat is taking over 10 seconds.
2021-01-15 11:35:08 WARNING (MainThread) [homeassistant.components.climate] Setup of climate platform generic_thermostat is taking over 10 seconds.
2021-01-15 11:35:08 WARNING (MainThread) [homeassistant.components.climate] Setup of climate platform generic_thermostat is taking over 10 seconds.
2021-01-15 11:35:08 WARNING (MainThread) [homeassistant.components.climate] Setup of climate platform generic_thermostat is taking over 10 seconds.
2021-01-15 11:35:22 WARNING (MainThread) [homeassistant.components.media_player] Updating browser_mod media_player took longer than the scheduled update interval 0:00:10
2021-01-15 11:35:22 WARNING (MainThread) [homeassistant.components.media_player] Updating samsungtv media_player took longer than the scheduled update interval 0:00:10
2021-01-15 11:35:22 WARNING (MainThread) [homeassistant.components.light] Updating tuya light took longer than the scheduled update interval 0:00:15
2021-01-15 11:35:22 WARNING (MainThread) [homeassistant.components.switch] Updating tuya switch took longer than the scheduled update interval 0:00:15
2021-01-15 11:35:22 WARNING (MainThread) [homeassistant.components.cover] Updating tuya cover took longer than the scheduled update interval 0:00:15
2021-01-15 11:35:26 WARNING (MainThread) [homeassistant.components.switch] Setup of switch platform template is taking over 10 seconds.
2021-01-15 11:35:26 WARNING (MainThread) [homeassistant.components.switch] Setup of switch platform template is taking over 10 seconds.
2021-01-15 11:35:26 WARNING (MainThread) [homeassistant.components.switch] Setup of switch platform template is taking over 10 seconds.
2021-01-15 11:35:43 WARNING (Thread-11) [pychromecast.socket_client] [Bathroom speaker(192.168.86.76):8009] Heartbeat timeout, resetting connection
2021-01-15 11:35:44 WARNING (Thread-13) [pychromecast.socket_client] [House(192.168.86.76):32200] Error communicating with socket, resetting connection
2021-01-15 11:35:44 WARNING (Thread-7) [pychromecast.socket_client] [Chromecast TV(192.168.86.47):8009] Error communicating with socket, resetting connection
2021-01-15 11:35:43 WARNING (Thread-14) [pychromecast.socket_client] [All but not upstairs(192.168.86.76):32198] Heartbeat timeout, resetting connection
2021-01-15 11:35:50 WARNING (Thread-10) [pychromecast.socket_client] [Kitchen Google(192.168.86.54):8009] Error communicating with socket, resetting connection
2021-01-15 11:35:52 ERROR (MainThread) [homeassistant.components.climate] Setup of platform generic_thermostat is taking longer than 60 seconds. Startup will proceed without waiting any longer.
2021-01-15 11:36:01 ERROR (MainThread) [homeassistant.components.climate] Setup of platform generic_thermostat is taking longer than 60 seconds. Startup will proceed without waiting any longer.
2021-01-15 11:36:09 ERROR (MainThread) [homeassistant.components.climate] Setup of platform generic_thermostat is taking longer than 60 seconds. Startup will proceed without waiting any longer.
2021-01-15 11:36:11 WARNING (Thread-7) [pychromecast.socket_client] [Chromecast TV(192.168.86.47):8009] Error communicating with socket, resetting connection
2021-01-15 11:36:14 ERROR (MainThread) [homeassistant.components.climate] Setup of platform generic_thermostat is taking longer than 60 seconds. Startup will proceed without waiting any longer.
2021-01-15 11:36:17 ERROR (MainThread) [homeassistant.components.climate] Setup of platform generic_thermostat is taking longer than 60 seconds. Startup will proceed without waiting any longer.
2021-01-15 11:36:19 ERROR (MainThread) [homeassistant.components.climate] Setup of platform generic_thermostat is taking longer than 60 seconds. Startup will proceed without waiting any longer.
2021-01-15 11:36:20 ERROR (MainThread) [homeassistant.components.climate] Setup of platform generic_thermostat is taking longer than 60 seconds. Startup will proceed without waiting any longer.
2021-01-15 11:36:23 ERROR (MainThread) [homeassistant.components.climate] Setup of platform generic_thermostat is taking longer than 60 seconds. Startup will proceed without waiting any longer.
2021-01-15 11:36:36 WARNING (MainThread) [homeassistant.components.binary_sensor] Updating workday binary_sensor took longer than the scheduled update interval 0:00:30
2021-01-15 11:36:36 WARNING (MainThread) [homeassistant.components.switch] Updating wake_on_lan switch took longer than the scheduled update interval 0:00:30
2021-01-15 11:36:36 WARNING (MainThread) [homeassistant.components.light] Updating twinkly light took longer than the scheduled update interval 0:00:30
2021-01-15 11:36:36 WARNING (MainThread) [homeassistant.components.light] Updating twinkly light took longer than the scheduled update interval 0:00:30
2021-01-15 11:36:36 WARNING (MainThread) [homeassistant.components.media_player] Updating spotify media_player took longer than the scheduled update interval 0:00:30
2021-01-15 11:36:36 ERROR (MainThread) [snitun.multiplexer.core] Ping fails, no response from peer
2021-01-15 11:37:08 ERROR (MainThread) [homeassistant.components.binary_sensor] Setup of platform trend is taking longer than 60 seconds. Startup will proceed without waiting any longer.
2021-01-15 11:37:08 WARNING (MainThread) [homeassistant.helpers.entity] Update of light.twinkly_fa9f05 is taking over 10 seconds
2021-01-15 11:37:08 WARNING (MainThread) [homeassistant.helpers.entity] Update of light.twinkly_facc45 is taking over 10 seconds
2021-01-15 11:37:19 WARNING (Thread-14) [pychromecast.socket_client] [All but not upstairs(192.168.86.76):32198] Heartbeat timeout, resetting connection
2021-01-15 11:37:36 ERROR (MainThread) [custom_components.sonoffOLD2.sonoff_cloud] Coolkit API error: Cannot connect to host eu-api.coolkit.cc:8080 ssl:default [Try again]
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/aiohttp/connector.py", line 1005, in _create_direct_connection
    hosts = await asyncio.shield(host_resolved)
  File "/usr/local/lib/python3.8/site-packages/aiohttp/connector.py", line 871, in _resolve_host
    addrs = await self._resolver.resolve(host, port, family=self._family)
  File "/usr/local/lib/python3.8/site-packages/aiohttp/resolver.py", line 31, in resolve
    infos = await self._loop.getaddrinfo(
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 825, in getaddrinfo
    return await self.run_in_executor(
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/socket.py", line 918, in getaddrinfo
    for res in _socket.getaddrinfo(host, port, family, type, proto, flags):
socket.gaierror: [Errno -3] Try again

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/config/custom_components/sonoffOLD2/sonoff_cloud.py", line 147, in _api
    r = await coro
  File "/usr/local/lib/python3.8/site-packages/aiohttp/client.py", line 527, in _request
    conn = await self._connector.connect(
  File "/usr/local/lib/python3.8/site-packages/aiohttp/connector.py", line 541, in connect
    proto = await self._create_connection(req, traces, timeout)
  File "/usr/local/lib/python3.8/site-packages/aiohttp/connector.py", line 898, in _create_connection
    _, proto = await self._create_direct_connection(req, traces, timeout)
  File "/usr/local/lib/python3.8/site-packages/aiohttp/connector.py", line 1017, in _create_direct_connection
    raise ClientConnectorError(req.connection_key, exc) from exc
aiohttp.client_exceptions.ClientConnectorError: Cannot connect to host eu-api.coolkit.cc:8080 ssl:default [Try again]
2021-01-15 11:38:13 ERROR (Thread-11) [pychromecast.socket_client] [Bathroom speaker(192.168.86.76):8009] Error reading from socket.
2021-01-15 11:38:15 WARNING (Thread-11) [pychromecast.socket_client] [Bathroom speaker(192.168.86.76):8009] Error communicating with socket, resetting connection
2021-01-15 11:38:15 WARNING (Thread-12) [pychromecast.socket_client] [Downstairs(192.168.86.76):32154] Heartbeat timeout, resetting connection
2021-01-15 11:38:17 WARNING (Thread-13) [pychromecast.socket_client] [House(192.168.86.76):32200] Heartbeat timeout, resetting connection
2021-01-15 11:38:17 WARNING (Thread-14) [pychromecast.socket_client] [All but not upstairs(192.168.86.76):32198] Error communicating with socket, resetting connection
2021-01-15 11:38:17 WARNING (Thread-7) [pychromecast.socket_client] [Chromecast TV(192.168.86.47):8009] Error communicating with socket, resetting connection
2021-01-15 11:38:17 WARNING (Thread-10) [pychromecast.socket_client] [Kitchen Google(192.168.86.54):8009] Heartbeat timeout, resetting connection
2021-01-15 11:38:34 ERROR (SyncWorker_11) [homeassistant.components.darksky.sensor] Unable to connect to Dark Sky: HTTPSConnectionPool(host='api.darksky.net', port=443): Max retries exceeded with url: /forecast/0bc90967dc25161a497a47a002546064/51.8898802,4.4618576?units=si&lang=nl (Caused by NewConnectionError('<urllib3.connection.HTTPSConnection object at 0x7f60deba60>: Failed to establish a new connection: [Errno -3] Try again'))
2021-01-15 11:38:56 WARNING (Thread-13) [pychromecast.socket_client] [House(192.168.86.76):32200] Error communicating with socket, resetting connection
2021-01-15 11:38:53 WARNING (Thread-14) [pychromecast.socket_client] [All but not upstairs(192.168.86.76):32198] Error communicating with socket, resetting connection
2021-01-15 11:39:07 WARNING (Thread-10) [pychromecast.socket_client] [Kitchen Google(192.168.86.54):8009] Heartbeat timeout, resetting connection
2021-01-15 11:39:09 WARNING (Thread-7) [pychromecast.socket_client] [Chromecast TV(192.168.86.47):8009] Heartbeat timeout, resetting connection
2021-01-15 11:39:15 WARNING (Thread-12) [pychromecast.socket_client] [Downstairs(192.168.86.76):32154] Error communicating with socket, resetting connection
2021-01-15 11:39:19 WARNING (Thread-11) [pychromecast.socket_client] [Bathroom speaker(192.168.86.76):8009] Heartbeat timeout, resetting connection
2021-01-15 11:39:39 WARNING (MainThread) [homeassistant.components.media_player] Updating samsungtv media_player took longer than the scheduled update interval 0:00:10
2

Dump question do you still get the same errors after restart from power off
not just a restart of HA

3

I do get errors, but not the same. This log started after a shutdown so here’s the startup part until it got somewhat stable:

2021-01-14 13:04:25 WARNING (MainThread) [homeassistant.loader] You are using a custom integration for nodered which has not been tested by Home Assistant. This component might cause stability problems, be sure to disable it if you experience issues with Home Assistant.
2021-01-14 13:04:25 WARNING (MainThread) [homeassistant.loader] You are using a custom integration for browser_mod which has not been tested by Home Assistant. This component might cause stability problems, be sure to disable it if you experience issues with Home Assistant.
2021-01-14 13:04:25 WARNING (MainThread) [homeassistant.loader] You are using a custom integration for hacs which has not been tested by Home Assistant. This component might cause stability problems, be sure to disable it if you experience issues with Home Assistant.
2021-01-14 13:04:25 WARNING (MainThread) [homeassistant.loader] You are using a custom integration for sonoff which has not been tested by Home Assistant. This component might cause stability problems, be sure to disable it if you experience issues with Home Assistant.
2021-01-14 13:04:25 WARNING (MainThread) [homeassistant.loader] You are using a custom integration for spotcast which has not been tested by Home Assistant. This component might cause stability problems, be sure to disable it if you experience issues with Home Assistant.
2021-01-14 13:04:26 WARNING (MainThread) [homeassistant.components.recorder] The 'purge_interval' option is deprecated, please remove it from your configuration
2021-01-14 13:04:26 WARNING (Recorder) [homeassistant.components.recorder] Ended unfinished session (id=12 from 2021-01-13 12:34:49)
2021-01-14 13:04:35 ERROR (MainThread) [homeassistant] Error doing job: Unclosed client session
2021-01-14 13:04:37 ERROR (MainThread) [homeassistant.components.sensor] Entity id already exists - ignoring: sensor.badge_hall
2021-01-14 13:04:37 WARNING (SyncWorker_4) [homeassistant.components.darksky.sensor] Monitored condition temperature_min is deprecated
2021-01-14 13:04:37 WARNING (SyncWorker_4) [homeassistant.components.darksky.sensor] Monitored condition temperature_max is deprecated
2021-01-14 13:04:41 ERROR (MainThread) [homeassistant] Error doing job: Unclosed client session
2021-01-14 13:04:41 WARNING (MainThread) [homeassistant.setup] Setup of evohome is taking over 10 seconds.
2021-01-14 13:04:43 ERROR (MainThread) [homeassistant.helpers.integration_platform] Unexpected error importing sonoff/logbook.py
Traceback (most recent call last):
  File "/usr/src/homeassistant/homeassistant/helpers/integration_platform.py", line 30, in _process
    platform = integration.get_platform(platform_name)
  File "/usr/src/homeassistant/homeassistant/loader.py", line 424, in get_platform
    cache[full_name] = self._import_platform(platform_name)
  File "/usr/src/homeassistant/homeassistant/loader.py", line 429, in _import_platform
    return importlib.import_module(f"{self.pkg_path}.{platform_name}")
  File "/usr/local/lib/python3.8/importlib/__init__.py", line 127, in import_module
    return _bootstrap._gcd_import(name[level:], package, level)
  File "<frozen importlib._bootstrap>", line 1014, in _gcd_import
  File "<frozen importlib._bootstrap>", line 991, in _find_and_load
  File "<frozen importlib._bootstrap>", line 973, in _find_and_load_unlocked
ModuleNotFoundError: No module named 'custom_components.sonoffOLD2.logbook'
2021-01-14 13:04:43 ERROR (MainThread) [homeassistant.helpers.integration_platform] Unexpected error importing sonoff/system_health.py
Traceback (most recent call last):
  File "/usr/src/homeassistant/homeassistant/helpers/integration_platform.py", line 30, in _process
    platform = integration.get_platform(platform_name)
  File "/usr/src/homeassistant/homeassistant/loader.py", line 424, in get_platform
    cache[full_name] = self._import_platform(platform_name)
  File "/usr/src/homeassistant/homeassistant/loader.py", line 429, in _import_platform
    return importlib.import_module(f"{self.pkg_path}.{platform_name}")
  File "/usr/local/lib/python3.8/importlib/__init__.py", line 127, in import_module
    return _bootstrap._gcd_import(name[level:], package, level)
  File "<frozen importlib._bootstrap>", line 1014, in _gcd_import
  File "<frozen importlib._bootstrap>", line 991, in _find_and_load
  File "<frozen importlib._bootstrap>", line 973, in _find_and_load_unlocked
ModuleNotFoundError: No module named 'custom_components.sonoffOLD2.system_health'
2021-01-14 13:04:43 ERROR (MainThread) [homeassistant.helpers.integration_platform] Unexpected error importing sonoff/media_source.py
Traceback (most recent call last):
  File "/usr/src/homeassistant/homeassistant/helpers/integration_platform.py", line 30, in _process
    platform = integration.get_platform(platform_name)
  File "/usr/src/homeassistant/homeassistant/loader.py", line 424, in get_platform
    cache[full_name] = self._import_platform(platform_name)
  File "/usr/src/homeassistant/homeassistant/loader.py", line 429, in _import_platform
    return importlib.import_module(f"{self.pkg_path}.{platform_name}")
  File "/usr/local/lib/python3.8/importlib/__init__.py", line 127, in import_module
    return _bootstrap._gcd_import(name[level:], package, level)
  File "<frozen importlib._bootstrap>", line 1014, in _gcd_import
  File "<frozen importlib._bootstrap>", line 991, in _find_and_load
  File "<frozen importlib._bootstrap>", line 973, in _find_and_load_unlocked
ModuleNotFoundError: No module named 'custom_components.sonoffOLD2.media_source'
2021-01-14 13:04:43 ERROR (MainThread) [homeassistant.helpers.integration_platform] Unexpected error importing sonoff/group.py
Traceback (most recent call last):
  File "/usr/src/homeassistant/homeassistant/helpers/integration_platform.py", line 30, in _process
    platform = integration.get_platform(platform_name)
  File "/usr/src/homeassistant/homeassistant/loader.py", line 424, in get_platform
    cache[full_name] = self._import_platform(platform_name)
  File "/usr/src/homeassistant/homeassistant/loader.py", line 429, in _import_platform
    return importlib.import_module(f"{self.pkg_path}.{platform_name}")
  File "/usr/local/lib/python3.8/importlib/__init__.py", line 127, in import_module
    return _bootstrap._gcd_import(name[level:], package, level)
  File "<frozen importlib._bootstrap>", line 1014, in _gcd_import
  File "<frozen importlib._bootstrap>", line 991, in _find_and_load
  File "<frozen importlib._bootstrap>", line 973, in _find_and_load_unlocked
ModuleNotFoundError: No module named 'custom_components.sonoffOLD2.group'
2021-01-14 13:04:48 WARNING (MainThread) [homeassistant.components.upnp] Wanted UPnP/IGD device with UDN/ST "uuid:70d5b96d-4bf8-49be-b15d-96fbd6e415f4"/"urn:schemas-upnp-org:device:InternetGatewayDevice:2" not found, aborting
4

And yes - it does. Looks like you (or somebody) renamed things in the custom_components folder, possible causing things to go mad

2021-01-14 13:04:43 ERROR (MainThread) [homeassistant.helpers.integration_platform] Unexpected error importing sonoff/logbook.py
ModuleNotFoundError: No module named 'custom_components.sonoffOLD2.logbook'
2021-01-14 13:04:43 ERROR (MainThread) [homeassistant.helpers.integration_platform] Unexpected error importing sonoff/system_health.py
ModuleNotFoundError: No module named 'custom_components.sonoffOLD2.system_health'
ModuleNotFoundError: No module named 'custom_components.sonoffOLD2.media_source'
ModuleNotFoundError: No module named 'custom_components.sonoffOLD2.group'
5

AHHH! I’ve learned something… Will remove all that stuff and cross fingers. Thanks!

6

While doing this, also pay attention to this:

See recorder for substitute (I guess it’s purge_keep_days).

7

Same for these;

8

Thanks - this has now created a log file at boot that has no errors. (I deleted obsolete custom_components and also corrected the deprecated option in recorder) Now crossing fingers this will also have solved my issue of crashing everyday :slight_smile:

9

It crashed again :frowning: . I added system monitor and seems to be a memory leak.
image

I believe the memory dropped when I clicked in “configuration” - for the first time today. I searched for an entity.

Logs around the time of the big drop are:

(There are almost 1000 log lines of warning before this which are similar to the one under this comment)
2021-01-16 13:50:02 WARNING (MainThread) [homeassistant.components.upnp] Wanted UPnP/IGD device with UDN/ST "uuid:70d5b96d-4bf8-49be-b15d-96fbd6e415f4"/"urn:schemas-upnp-org:device:InternetGatewayDevice:2" not found, aborting

Here's the rest for the 5min of the huge memory drop
2021-01-16 13:50:02 WARNING (MainThread) [homeassistant.config_entries] Config entry for upnp not ready yet. Retrying in 80 seconds
2021-01-16 13:51:32 WARNING (MainThread) [homeassistant.components.upnp] Wanted UPnP/IGD device with UDN/ST "uuid:70d5b96d-4bf8-49be-b15d-96fbd6e415f4"/"urn:schemas-upnp-org:device:InternetGatewayDevice:2" not found, aborting
2021-01-16 13:51:32 WARNING (MainThread) [homeassistant.config_entries] Config entry for upnp not ready yet. Retrying in 80 seconds
2021-01-16 13:52:19 WARNING (zeroconf-ServiceBrowser__googlecast._tcp.local._299) [homeassistant.components.cast.discovery] setup_internal_discovery failed to get info for 573b82bf-a4db-4321-9efd-e3d018d11bd0, Google-Cast-Group-573b82bfa4db43219efde3d018d11bd0._googlecast._tcp.local.
2021-01-16 13:52:31 WARNING (zeroconf-ServiceBrowser__googlecast._tcp.local._299) [homeassistant.components.cast.discovery] setup_internal_discovery failed to get info for 97dee928-4c80-4293-838f-02f140913664, Google-Cast-Group-97dee9284c804293838f02f140913664._googlecast._tcp.local.
2021-01-16 13:53:02 WARNING (MainThread) [homeassistant.components.upnp] Wanted UPnP/IGD device with UDN/ST "uuid:70d5b96d-4bf8-49be-b15d-96fbd6e415f4"/"urn:schemas-upnp-org:device:InternetGatewayDevice:2" not found, aborting
2021-01-16 13:53:02 WARNING (MainThread) [homeassistant.config_entries] Config entry for upnp not ready yet. Retrying in 80 seconds
2021-01-16 13:54:32 WARNING (MainThread) [homeassistant.components.upnp] Wanted UPnP/IGD device with UDN/ST "uuid:70d5b96d-4bf8-49be-b15d-96fbd6e415f4"/"urn:schemas-upnp-org:device:InternetGatewayDevice:2" not found, aborting
2021-01-16 13:54:32 WARNING (MainThread) [homeassistant.config_entries] Config entry for upnp not ready yet. Retrying in 80 seconds
2021-01-16 13:56:02 WARNING (MainThread) [homeassistant.components.upnp] Wanted UPnP/IGD device with UDN/ST "uuid:70d5b96d-4bf8-49be-b15d-96fbd6e415f4"/"urn:schemas-upnp-org:device:InternetGatewayDevice:2" not found, aborting
2021-01-16 13:56:02 WARNING (MainThread) [homeassistant.config_entries] Config entry for upnp not ready yet. Retrying in 80 seconds
2021-01-16 13:57:32 WARNING (MainThread) [homeassistant.components.upnp] Wanted UPnP/IGD device with UDN/ST "uuid:70d5b96d-4bf8-49be-b15d-96fbd6e415f4"/"urn:schemas-upnp-org:device:InternetGatewayDevice:2" not found, aborting
2021-01-16 13:57:32 WARNING (MainThread) [homeassistant.config_entries] Config entry for upnp not ready yet. Retrying in 80 seconds
2021-01-16 13:59:02 WARNING (MainThread) [homeassistant.components.upnp] Wanted UPnP/IGD device with UDN/ST "uuid:70d5b96d-4bf8-49be-b15d-96fbd6e415f4"/"urn:schemas-upnp-org:device:InternetGatewayDevice:2" not found, aborting
2021-01-16 13:59:02 WARNING (MainThread) [homeassistant.config_entries] Config entry for upnp not ready yet. Retrying in 80 seconds
2021-01-16 14:00:32 WARNING (MainThread) [homeassistant.components.upnp] Wanted UPnP/IGD device with UDN/ST "uuid:70d5b96d-4bf8-49be-b15d-96fbd6e415f4"/"urn:schemas-upnp-org:device:InternetGatewayDevice:2" not found, aborting
1 Like
10

Any solution ? I have the same situation.

11

I just did a test - deactivated all addons, checked the ram% and activated them one by one. This is the breakdown:
image

I feel I’m getting there but it’s painful

image
image1723×338 39.8 KB

This is today. Some weird stuff

  • Around 11h30PM system stopped loggin! My logs stops…
  • System went by itself into crazy memory grab
  • Was still responsive but very slow. Restarted in the morning
  • Following other comments, I uninstalled Mosquitto broker and moved it elsewhere (synology) : this liberated almout 20% memory! = MQTT was only use for 2 small flows
  • I restarted Node-red (I have lots of flows!) and the gain was 8% when Node-red was out.

My system

  • My system is a RPi4 - 1GB ram.
  • It runs out of an SSD (no SD Card)
  • I have Maria DB Running
  • I literally rebuilt the system from a fresh install - no system restore - rebuilt everything (wanted to die)

My hope:

  • I ordered a RPI4 but with 8gig ram.
  • It should arrive tomorrow…
1 Like
12

Thanks for Y reply.
I was wondering about SD card scenario , but you had SSD. Now I don’t have clue what’s going on.
Please , try to fetch stats from rpi4 , and we’ll see how it’s works.

13

Honnestly, I installed an SSD because of this problem. (2 weeks ago, I didn’t have an SSD)
It hasn’t changed anything really. I gained about 5% free memory from the SSD (and it’s a lot faster).
Lots of people suggest that your SD card might become old - and that maria-db might be using it too much - shortening the life of the SD card.

You can do the test yourself - add this to configuration.yaml

sensor:
  - platform: systemmonitor
    resources:
      - type: disk_use_percent
        arg: /home
      - type: memory_free
      - type: memory_use_percent

then reload groups and template entities (or restart)
This will create the sensors you saw above - especially the “memory_free_percent”

  • One this all works, set all your addons with the option “start on boot” to OFF
  • restart
  • Check the sensor
  • Go to your addons, start one of them
  • Wait 2-3 minutes, check the sensor
  • repeat…
1 Like
14

I did that , and i have the same story. Usage of memory archived 90% and then whole PI is bricked until power off&on.

15

After updating to the latest NodeRed version , the situation looks like fine. For now the stability , and ram usage is decent.
Capture

16

Glad to hear.
On my side, I “got fedup” and bought an RPI4 with 8G (which is an absolute overkill… it was a “rage purchase”.
image

Exact same system as before… Around 11% total memory used instead of 75% …

17

Whats the verion of NR ?

18

the version is 8.0.0

19

For sure NR below 8.0 creates big peaks of memmory usage. Now i very stable and reliable even on mine RPi3b.

20

Hey my systems keeps crashing as well. It is a RPi 4 4Gig, and thought that my SD card was ageing.my Disk IOwait was very high. So i started with a new installation on a SSD. This seems blazing fast and Disk IOwait is down to 1%
or less.
But the system keeps crashing. sometimes after more then 24 hours. sometimes within 3 hours. I tried to get the logs from homeassistant, but no luck.
i run Nodered v8.0.0 and a smal assortment of addins. but all from homeassistant or the community.
do you have sugestions?