HAOS on Rpi 3B+ bombing out on websocket.py daily

Pedals2Paddles · November 18, 2024, 11:39pm

Hi. I have a Raspberry Pi 3B+ running HAOS latest production release. Been having this problem for at least a year and it keeps getting more frequent and worse. At this point, it is bombing out hard once a day at least. Becomes totally unresponsive, and eventually restarts. There is no consistent event that perpetuates it. I already replaced the SD card with a Max Endurance card.

Hardware info show’s 0.7 of 1GB in use and 4% processor. The only add-on that is running is ZwaveJS-UI. I have Samba and terminal, but only start them when needed. Today’s crash was in the middle of the work day while I was not even home and not interacting with HA. No automations run at that time. None of my automations, scripts, integrations have errors and all work fine routinely all day every day. So I don’t think it’s something of mine making this happen.

The pi is powered via PoE. But I’ve tried it with a separate USB power to no avail.

Below is the Supervisor error log from today’s crash. It’s always the same theme but difference things it starts losing comms with internally. The traceback bombing out on websocket.py is consistent every time.

`[31m2024-11-18 11:22:12.333 ERROR (MainThread) [supervisor.homeassistant.api] Timeout on call http://172.30.32.1:8123/api/core/state.e[0m
e[33m2024-11-18 11:22:21.041 WARNING (MainThread) [supervisor.misc.tasks] Watchdog missed an Home Assistant Core API response.e[0m
e[31m2024-11-18 11:22:23.848 ERROR (MainThread) [supervisor.store.git] Can't update https://github.com/music-assistant/home-assistant-addon repo: Cmd('git') failed due to: exit code(128)
  cmdline: git fetch -v --update-shallow --depth=1 -- origin
  stderr: 'fatal: unable to access 'https://github.com/music-assistant/home-assistant-addon/': OpenSSL SSL_read: SSL_ERROR_SYSCALL, errno 0'.e[0m
e[31m2024-11-18 11:22:23.046 ERROR (MainThread) [supervisor.store.git] Can't update https://github.com/home-assistant/addons repo: Cmd('git') failed due to: exit code(128)
  cmdline: git fetch -v --update-shallow --depth=1 -- origin
  stderr: 'fatal: unable to access 'https://github.com/home-assistant/addons/': OpenSSL SSL_read: SSL_ERROR_SYSCALL, errno 0'.e[0m
e[31m2024-11-18 11:22:23.048 ERROR (MainThread) [supervisor.store.git] Can't update https://github.com/esphome/home-assistant-addon repo: Cmd('git') failed due to: exit code(128)
  cmdline: git fetch -v --update-shallow --depth=1 -- origin
  stderr: 'fatal: unable to access 'https://github.com/esphome/home-assistant-addon/': OpenSSL SSL_read: SSL_ERROR_SYSCALL, errno 0'.e[0m
e[31m2024-11-18 11:22:23.049 ERROR (MainThread) [supervisor.store.git] Can't update https://github.com/hassio-addons/repository repo: Cmd('git') failed due to: exit code(128)
  cmdline: git fetch -v --update-shallow --depth=1 -- origin
  stderr: 'fatal: unable to access 'https://github.com/hassio-addons/repository/': OpenSSL SSL_read: SSL_ERROR_SYSCALL, errno 0'.e[0m
e[31m2024-11-18 11:22:23.669 ERROR (MainThread) [supervisor.store] Could not reload repository core due to StoreGitError()e[0m
e[31m2024-11-18 11:22:23.670 ERROR (MainThread) [supervisor.store] Could not reload repository a0d7b954 due to StoreGitError()e[0m
e[31m2024-11-18 11:22:23.670 ERROR (MainThread) [supervisor.store] Could not reload repository d5369777 due to StoreGitError()e[0m
e[31m2024-11-18 11:22:23.671 ERROR (MainThread) [supervisor.store] Could not reload repository 5c53de3b due to StoreGitError()e[0m
e[31m2024-11-18 12:20:45.395 ERROR (MainThread) [supervisor.homeassistant.api] Timeout on call http://172.30.32.1:8123/api/core/state.e[0m
e[33m2024-11-18 12:20:45.713 WARNING (MainThread) [supervisor.misc.tasks] Watchdog missed an Home Assistant Core API response.e[0m
e[31m2024-11-18 14:25:11.463 ERROR (MainThread) [supervisor.homeassistant.api] Timeout on call http://172.30.32.1:8123/api/core/state.e[0m
e[33m2024-11-18 14:25:14.698 WARNING (MainThread) [supervisor.misc.tasks] Watchdog missed an Home Assistant Core API response.e[0m
e[31m2024-11-18 14:43:22.396 ERROR (MainThread) [supervisor.homeassistant.api] Timeout on call http://172.30.32.1:8123/api/core/state.e[0m
e[33m2024-11-18 14:43:22.981 WARNING (MainThread) [supervisor.misc.tasks] Watchdog missed an Home Assistant Core API response.e[0m
e[31m2024-11-18 15:17:18.170 ERROR (MainThread) [supervisor.homeassistant.api] Timeout on call http://172.30.32.1:8123/api/core/state.e[0m
e[33m2024-11-18 15:17:19.581 WARNING (MainThread) [supervisor.misc.tasks] Watchdog missed an Home Assistant Core API response.e[0m
e[33m2024-11-18 15:22:42.300 WARNING (MainThread) [supervisor.addons.addon] Watchdog found addon Z-Wave JS UI is unhealthy, restarting...e[0m
e[31m2024-11-18 15:23:06.762 ERROR (MainThread) [supervisor.homeassistant.api] Timeout on call http://172.30.32.1:8123/api/core/state.e[0m
e[33m2024-11-18 15:23:06.034 WARNING (MainThread) [supervisor.misc.tasks] Watchdog missed an Home Assistant Core API response.e[0m
e[31m2024-11-18 15:28:36.506 ERROR (MainThread) [supervisor.homeassistant.api] Timeout on call http://172.30.32.1:8123/api/core/state.e[0m
e[33m2024-11-18 15:28:39.190 WARNING (MainThread) [supervisor.misc.tasks] Watchdog missed an Home Assistant Core API response.e[0m
e[33m2024-11-18 15:29:21.020 WARNING (MainThread) [supervisor.misc.tasks] Watchdog/Application found a problem with observer plugin!e[0m
e[33m2024-11-18 15:30:59.566 WARNING (MainThread) [supervisor.addons.addon] Watchdog found addon Z-Wave JS UI is unhealthy, restarting...e[0m
e[31m2024-11-18 15:38:18.037 ERROR (MainThread) [supervisor.homeassistant.api] Timeout on call http://172.30.32.1:8123/api/core/state.e[0m
e[33m2024-11-18 15:38:19.444 WARNING (MainThread) [supervisor.misc.tasks] Watchdog missed an Home Assistant Core API response.e[0m
e[33m2024-11-18 15:41:37.452 WARNING (MainThread) [supervisor.misc.tasks] Watchdog/Application found a problem with observer plugin!e[0m
e[31m2024-11-18 15:42:33.501 ERROR (MainThread) [supervisor.homeassistant.api] Timeout on call http://172.30.32.1:8123/api/core/state.e[0m
e[31m2024-11-18 15:42:37.282 ERROR (MainThread) [supervisor.misc.tasks] Watchdog missed 2 Home Assistant Core API responses in a row. Restarting Home Assistant Core!e[0m
e[33m2024-11-18 15:43:50.032 WARNING (MainThread) [supervisor.addons.addon] Watchdog found addon Z-Wave JS UI is unhealthy, restarting...e[0m
e[31m2024-11-18 15:45:01.314 ERROR (MainThread) [asyncio] Task exception was never retrieved
future: <Task finished name='Task-23760' coro=<HomeAssistantWebSocket.async_supervisor_event() done, defined at /usr/src/supervisor/supervisor/homeassistant/websocket.py:322> exception=AttributeError("'NoneType' object has no attribute 'close'")>


Traceback (most recent call last):
  File "/usr/src/supervisor/supervisor/homeassistant/websocket.py", line 267, in async_send_message
    await self._client.async_send_command(message)
  File "/usr/src/supervisor/supervisor/homeassistant/websocket.py", line 95, in async_send_command
    return await self._futures[message["id"]]
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
supervisor.exceptions.HomeAssistantWSConnectionError: Connection was closed

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/src/supervisor/supervisor/homeassistant/websocket.py", line 327, in async_supervisor_event
    await self.async_send_message(
  File "/usr/src/supervisor/supervisor/homeassistant/websocket.py", line 269, in async_send_message
    await self._client.close()
          ^^^^^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'close'e[0m
e[31m2024-11-18 15:45:02.939 ERROR (MainThread) [asyncio] Task exception was never retrieved
future: <Task finished name='Task-23761' coro=<HomeAssistantWebSocket.async_supervisor_event() done, defined at /usr/src/supervisor/supervisor/homeassistant/websocket.py:322> exception=AttributeError("'NoneType' object has no attribute 'close'")>
Traceback (most recent call last):
  File "/usr/src/supervisor/supervisor/homeassistant/websocket.py", line 267, in async_send_message
    await self._client.async_send_command(message)
  File "/usr/src/supervisor/supervisor/homeassistant/websocket.py", line 95, in async_send_command
    return await self._futures[message["id"]]
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
supervisor.exceptions.HomeAssistantWSConnectionError: Connection was closed

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/src/supervisor/supervisor/homeassistant/websocket.py", line 327, in async_supervisor_event
    await self.async_send_message(
  File "/usr/src/supervisor/supervisor/homeassistant/websocket.py", line 269, in async_send_message
    await self._client.close()
          ^^^^^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'close'e[0m
e[31m2024-11-18 15:45:02.003 ERROR (MainThread) [asyncio] Task exception was never retrieved
future: <Task finished name='Task-23762' coro=<HomeAssistantWebSocket.async_supervisor_event() done, defined at /usr/src/supervisor/supervisor/homeassistant/websocket.py:322> exception=AttributeError("'NoneType' object has no attribute 'close'")>
Traceback (most recent call last):
  File "/usr/src/supervisor/supervisor/homeassistant/websocket.py", line 267, in async_send_message
    await self._client.async_send_command(message)
  File "/usr/src/supervisor/supervisor/homeassistant/websocket.py", line 95, in async_send_command
    return await self._futures[message["id"]]
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
supervisor.exceptions.HomeAssistantWSConnectionError: Connection was closed

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/src/supervisor/supervisor/homeassistant/websocket.py", line 327, in async_supervisor_event
    await self.async_send_message(
  File "/usr/src/supervisor/supervisor/homeassistant/websocket.py", line 269, in async_send_message
    await self._client.close()
          ^^^^^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'close'e[0m
e[31m2024-11-18 15:45:02.024 ERROR (MainThread) [asyncio] Task exception was never retrieved
future: <Task finished name='Task-23789' coro=<HomeAssistantWebSocket.async_supervisor_event() done, defined at /usr/src/supervisor/supervisor/homeassistant/websocket.py:322> exception=AttributeError("'NoneType' object has no attribute 'close'")>
Traceback (most recent call last):
  File "/usr/src/supervisor/supervisor/homeassistant/websocket.py", line 267, in async_send_message
    await self._client.async_send_command(message)
  File "/usr/src/supervisor/supervisor/homeassistant/websocket.py", line 95, in async_send_command
    return await self._futures[message["id"]]
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
supervisor.exceptions.HomeAssistantWSConnectionError: Connection was closed

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/src/supervisor/supervisor/homeassistant/websocket.py", line 327, in async_supervisor_event
    await self.async_send_message(
  File "/usr/src/supervisor/supervisor/homeassistant/websocket.py", line 269, in async_send_message
    await self._client.close()
          ^^^^^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'close'e[0m
e[31m2024-11-18 15:45:02.034 ERROR (MainThread) [asyncio] Task exception was never retrieved
future: <Task finished name='Task-23790' coro=<HomeAssistantWebSocket.async_supervisor_event() done, defined at /usr/src/supervisor/supervisor/homeassistant/websocket.py:322> exception=AttributeError("'NoneType' object has no attribute 'close'")>
Traceback (most recent call last):
  File "/usr/src/supervisor/supervisor/homeassistant/websocket.py", line 267, in async_send_message
    await self._client.async_send_command(message)
  File "/usr/src/supervisor/supervisor/homeassistant/websocket.py", line 95, in async_send_command
    return await self._futures[message["id"]]
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
supervisor.exceptions.HomeAssistantWSConnectionError: Connection was closed

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/src/supervisor/supervisor/homeassistant/websocket.py", line 327, in async_supervisor_event
    await self.async_send_message(
  File "/usr/src/supervisor/supervisor/homeassistant/websocket.py", line 269, in async_send_message
    await self._client.close()
          ^^^^^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'close'e[0m
e[31m2024-11-18 15:45:02.043 ERROR (MainThread) [asyncio] Task exception was never retrieved
future: <Task finished name='Task-23791' coro=<HomeAssistantWebSocket.async_supervisor_event() done, defined at /usr/src/supervisor/supervisor/homeassistant/websocket.py:322> exception=AttributeError("'NoneType' object has no attribute 'close'")>
Traceback (most recent call last):
  File "/usr/src/supervisor/supervisor/homeassistant/websocket.py", line 267, in async_send_message
    await self._client.async_send_command(message)
  File "/usr/src/supervisor/supervisor/homeassistant/websocket.py", line 95, in async_send_command
    return await self._futures[message["id"]]
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
supervisor.exceptions.HomeAssistantWSConnectionError: Connection was closed

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/src/supervisor/supervisor/homeassistant/websocket.py", line 327, in async_supervisor_event
    await self.async_send_message(
  File "/usr/src/supervisor/supervisor/homeassistant/websocket.py", line 269, in async_send_message
    await self._client.close()
          ^^^^^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'close'e[0m
e[31m2024-11-18 15:45:02.055 ERROR (MainThread) [asyncio] Task exception was never retrieved
future: <Task finished name='Task-23794' coro=<HomeAssistantWebSocket.async_supervisor_event() done, defined at /usr/src/supervisor/supervisor/homeassistant/websocket.py:322> exception=AttributeError("'NoneType' object has no attribute 'close'")>
Traceback (most recent call last):
  File "/usr/src/supervisor/supervisor/homeassistant/websocket.py", line 267, in async_send_message
    await self._client.async_send_command(message)
  File "/usr/src/supervisor/supervisor/homeassistant/websocket.py", line 95, in async_send_command
    return await self._futures[message["id"]]
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
supervisor.exceptions.HomeAssistantWSConnectionError: Connection was closed

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/src/supervisor/supervisor/homeassistant/websocket.py", line 327, in async_supervisor_event
    await self.async_send_message(
  File "/usr/src/supervisor/supervisor/homeassistant/websocket.py", line 269, in async_send_message
    await self._client.close()
          ^^^^^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'close'e[0m
e[31m2024-11-18 15:45:02.062 ERROR (MainThread) [asyncio] Task exception was never retrieved
future: <Task finished name='Task-23795' coro=<HomeAssistantWebSocket.async_supervisor_event() done, defined at /usr/src/supervisor/supervisor/homeassistant/websocket.py:322> exception=AttributeError("'NoneType' object has no attribute 'close'")>
Traceback (most recent call last):
  File "/usr/src/supervisor/supervisor/homeassistant/websocket.py", line 267, in async_send_message
    await self._client.async_send_command(message)
  File "/usr/src/supervisor/supervisor/homeassistant/websocket.py", line 95, in async_send_command
    return await self._futures[message["id"]]
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
supervisor.exceptions.HomeAssistantWSConnectionError: Connection was closed

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/src/supervisor/supervisor/homeassistant/websocket.py", line 327, in async_supervisor_event
    await self.async_send_message(
  File "/usr/src/supervisor/supervisor/homeassistant/websocket.py", line 269, in async_send_message
    await self._client.close()
          ^^^^^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'close'e[0m
e[31m2024-11-18 15:45:02.074 ERROR (MainThread) [asyncio] Task exception was never retrieved
future: <Task finished name='Task-23796' coro=<HomeAssistantWebSocket.async_supervisor_event() done, defined at /usr/src/supervisor/supervisor/homeassistant/websocket.py:322> exception=AttributeError("'NoneType' object has no attribute 'close'")>
Traceback (most recent call last):
  File "/usr/src/supervisor/supervisor/homeassistant/websocket.py", line 267, in async_send_message
    await self._client.async_send_command(message)
  File "/usr/src/supervisor/supervisor/homeassistant/websocket.py", line 95, in async_send_command
    return await self._futures[message["id"]]
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
supervisor.exceptions.HomeAssistantWSConnectionError: Connection was closed

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/src/supervisor/supervisor/homeassistant/websocket.py", line 327, in async_supervisor_event
    await self.async_send_message(
  File "/usr/src/supervisor/supervisor/homeassistant/websocket.py", line 269, in async_send_message
    await self._client.close()
          ^^^^^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'close'e[0m
`

WallyR · November 18, 2024, 11:48pm

Remember that the memory usage is just a value for that current moment.
It could easily be higher before and if it crash due to not enough ram, then you do not see value that was actual required.

There are several threads on the forum with RPi3B+ crashing and you might have to accept that that Raspi model have come to end of support for HA.
In HA documentation there have for quite some time been a note on that model saying it is only good for starting up on.