UPDATE: I think I now know why the triggers were missed. HASS was in the process of restarting. The current log begins with the typical warnings of custom integrations and no subsequent errors or warnings of any kind…
2021-10-24 09:59:58 WARNING (SyncWorker_0) [homeassistant.loader] We found a custom integration hacs which has not been tested by Home Assistant. This component might cause stability problems, be sure to disable it if you experience issues with Home Assistant
2021-10-24 09:59:58 WARNING (SyncWorker_2) [homeassistant.loader] We found a custom integration files which has not been tested by Home Assistant. This component might cause stability problems, be sure to disable it if you experience issues with Home Assistant
2021-10-24 09:59:58 WARNING (SyncWorker_1) [homeassistant.loader] We found a custom integration favicon which has not been tested by Home Assistant. This component might cause stability problems, be sure to disable it if you experience issues with Home Assistant
2021-10-24 09:59:58 WARNING (SyncWorker_2) [homeassistant.loader] We found a custom integration authenticated which has not been tested by Home Assistant. This component might cause stability problems, be sure to disable it if you experience issues with Home Assistant
2021-10-24 10:00:12 WARNING (MainThread) [homeassistant.components.camera] Setup of camera platform amcrest is taking over 10 seconds.
The NUT power outage and smoke detector events occurred at 10:00:02 during the restart, so the automations likely weren’t processed yet. Why and how a restart could have triggered a phantom power outage AND smoke detector is another question. How weird is that?
Below is the previous homeassistant.log.1 that shows some serious errors that include “Client error on /homeassistant/restart request Server disconnected” and the Vera integration. I had not noticed that this is automatically saved now (great feature!). The Vera hub is used only to communicate via serial to the security panel for hardwired door/window/smoke sensors and has worked flawlessly for years. (All Zwave connections were moved off it to Zwave-JS).
It’s not clear that the Vera Integration is at fault, but perhaps its thread was a victim of the shutdown/restart. How a restart could somehow trigger phantom events which in turn instructed the security panel (via Vera) to fire off its loud siren. Just an insane series of events.
2021-10-24 09:59:42 ERROR (MainThread) [homeassistant.components.hassio.handler] Client error on /homeassistant/restart request Server disconnected
2021-10-24 09:59:42 WARNING (Thread-9) [homeassistant.util.executor] Thread[SyncWorker_4] is still running at shutdown: File "/usr/local/lib/python3.9/threading.py", line 930, in _bootstrap
self._bootstrap_inner()
File "/usr/local/lib/python3.9/threading.py", line 973, in _bootstrap_inner
self.run()
File "/usr/local/lib/python3.9/threading.py", line 910, in run
self._target(*self._args, **self._kwargs)
File "/usr/local/lib/python3.9/concurrent/futures/thread.py", line 77, in _worker
work_item.run()
File "/usr/local/lib/python3.9/concurrent/futures/thread.py", line 52, in run
result = self.fn(*self.args, **self.kwargs)
File "/usr/src/homeassistant/homeassistant/components/vera/common.py", line 80, in _run_poll_server
if not self.poll_server_once():
File "/usr/local/lib/python3.9/site-packages/pyvera/__init__.py", line 1669, in poll_server_once
device_data, new_timestamp = self.get_device_data(self._last_updated)
File "/usr/local/lib/python3.9/site-packages/pyvera/__init__.py", line 1646, in get_device_data
return self._controller.get_changed_devices(last_updated)
File "/usr/local/lib/python3.9/site-packages/pyvera/__init__.py", line 335, in get_changed_devices
response = self.data_request(payload, TIMEOUT * 2)
File "/usr/local/lib/python3.9/site-packages/pyvera/__init__.py", line 121, in data_request
response = requests.get(request_url, timeout=timeout, params=payload)
File "/usr/local/lib/python3.9/site-packages/requests/api.py", line 75, in get
return request('get', url, params=params, **kwargs)
File "/usr/local/lib/python3.9/site-packages/requests/api.py", line 61, in request
return session.request(method=method, url=url, **kwargs)
File "/usr/local/lib/python3.9/site-packages/requests/sessions.py", line 542, in request
resp = self.send(prep, **send_kwargs)
File "/usr/local/lib/python3.9/site-packages/requests/sessions.py", line 655, in send
r = adapter.send(request, **kwargs)
File "/usr/local/lib/python3.9/site-packages/requests/adapters.py", line 439, in send
resp = conn.urlopen(
File "/usr/local/lib/python3.9/site-packages/urllib3/connectionpool.py", line 699, in urlopen
httplib_response = self._make_request(
File "/usr/local/lib/python3.9/site-packages/urllib3/connectionpool.py", line 440, in _make_request
httplib_response = conn.getresponse()
File "/usr/local/lib/python3.9/http/client.py", line 1371, in getresponse
response.begin()
File "/usr/local/lib/python3.9/http/client.py", line 319, in begin
version, status, reason = self._read_status()
File "/usr/local/lib/python3.9/http/client.py", line 280, in _read_status
line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1")
File "/usr/local/lib/python3.9/socket.py", line 704, in readinto
return self._sock.recv_into(b)
2021-10-24 09:59:43 WARNING (Thread-9) [homeassistant.util.executor] Thread[SyncWorker_4] is still running at shutdown: File "/usr/local/lib/python3.9/threading.py", line 930, in _bootstrap
self._bootstrap_inner()
File "/usr/local/lib/python3.9/threading.py", line 973, in _bootstrap_inner
self.run()
File "/usr/local/lib/python3.9/threading.py", line 910, in run
self._target(*self._args, **self._kwargs)
File "/usr/local/lib/python3.9/concurrent/futures/thread.py", line 77, in _worker
work_item.run()
File "/usr/local/lib/python3.9/concurrent/futures/thread.py", line 52, in run
result = self.fn(*self.args, **self.kwargs)
File "/usr/src/homeassistant/homeassistant/components/vera/common.py", line 80, in _run_poll_server
if not self.poll_server_once():
File "/usr/local/lib/python3.9/site-packages/pyvera/__init__.py", line 1669, in poll_server_once
device_data, new_timestamp = self.get_device_data(self._last_updated)
File "/usr/local/lib/python3.9/site-packages/pyvera/__init__.py", line 1646, in get_device_data
return self._controller.get_changed_devices(last_updated)
File "/usr/local/lib/python3.9/site-packages/pyvera/__init__.py", line 335, in get_changed_devices
response = self.data_request(payload, TIMEOUT * 2)
File "/usr/local/lib/python3.9/site-packages/pyvera/__init__.py", line 121, in data_request
response = requests.get(request_url, timeout=timeout, params=payload)
File "/usr/local/lib/python3.9/site-packages/requests/api.py", line 75, in get
return request('get', url, params=params, **kwargs)
File "/usr/local/lib/python3.9/site-packages/requests/api.py", line 61, in request
return session.request(method=method, url=url, **kwargs)
File "/usr/local/lib/python3.9/site-packages/requests/sessions.py", line 542, in request
resp = self.send(prep, **send_kwargs)
File "/usr/local/lib/python3.9/site-packages/requests/sessions.py", line 655, in send
r = adapter.send(request, **kwargs)
File "/usr/local/lib/python3.9/site-packages/requests/adapters.py", line 439, in send
resp = conn.urlopen(
File "/usr/local/lib/python3.9/site-packages/urllib3/connectionpool.py", line 699, in urlopen
httplib_response = self._make_request(
File "/usr/local/lib/python3.9/site-packages/urllib3/connectionpool.py", line 440, in _make_request
httplib_response = conn.getresponse()
File "/usr/local/lib/python3.9/http/client.py", line 1371, in getresponse
response.begin()
File "/usr/local/lib/python3.9/http/client.py", line 319, in begin
version, status, reason = self._read_status()
File "/usr/local/lib/python3.9/http/client.py", line 280, in _read_status
line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1")
File "/usr/local/lib/python3.9/socket.py", line 704, in readinto
return self._sock.recv_into(b)
2021-10-24 09:59:50 ERROR (MainThread) [homeassistant] Error doing job: Exception in callback async_track_point_in_utc_time.<locals>.run_action(<Job HassJobT...f2e48bcc2b0>>>) at /usr/src/homeassistant/homeassistant/helpers/event.py:1170
Traceback (most recent call last):
File "/usr/local/lib/python3.9/asyncio/events.py", line 80, in _run
self._context.run(self._callback, *self._args)
File "/usr/src/homeassistant/homeassistant/helpers/event.py", line 1188, in run_action
hass.async_run_hass_job(job, utc_point_in_time)
File "/usr/src/homeassistant/homeassistant/core.py", line 436, in async_run_hass_job
return self.async_add_hass_job(hassjob, *args)
File "/usr/src/homeassistant/homeassistant/core.py", line 368, in async_add_hass_job
task = self.loop.run_in_executor( # type: ignore
File "/usr/local/lib/python3.9/asyncio/base_events.py", line 814, in run_in_executor
executor.submit(func, *args), loop=self)
File "/usr/local/lib/python3.9/concurrent/futures/thread.py", line 161, in submit
raise RuntimeError('cannot schedule new futures after shutdown')
RuntimeError: cannot schedule new futures after shutdown
2021-10-24 09:59:52 WARNING (MainThread) [homeassistant.util.executor] Thread[SyncWorker_4] is still running at shutdown: File "/usr/local/lib/python3.9/threading.py", line 930, in _bootstrap
self._bootstrap_inner()
File "/usr/local/lib/python3.9/threading.py", line 973, in _bootstrap_inner
self.run()
File "/usr/local/lib/python3.9/threading.py", line 910, in run
self._target(*self._args, **self._kwargs)
File "/usr/local/lib/python3.9/concurrent/futures/thread.py", line 77, in _worker
work_item.run()
File "/usr/local/lib/python3.9/concurrent/futures/thread.py", line 52, in run
result = self.fn(*self.args, **self.kwargs)
File "/usr/src/homeassistant/homeassistant/components/vera/common.py", line 80, in _run_poll_server
if not self.poll_server_once():
File "/usr/local/lib/python3.9/site-packages/pyvera/__init__.py", line 1669, in poll_server_once
device_data, new_timestamp = self.get_device_data(self._last_updated)
File "/usr/local/lib/python3.9/site-packages/pyvera/__init__.py", line 1646, in get_device_data
return self._controller.get_changed_devices(last_updated)
File "/usr/local/lib/python3.9/site-packages/pyvera/__init__.py", line 335, in get_changed_devices
response = self.data_request(payload, TIMEOUT * 2)
File "/usr/local/lib/python3.9/site-packages/pyvera/__init__.py", line 121, in data_request
response = requests.get(request_url, timeout=timeout, params=payload)
File "/usr/local/lib/python3.9/site-packages/requests/api.py", line 75, in get
return request('get', url, params=params, **kwargs)
File "/usr/local/lib/python3.9/site-packages/requests/api.py", line 61, in request
return session.request(method=method, url=url, **kwargs)
File "/usr/local/lib/python3.9/site-packages/requests/sessions.py", line 542, in request
resp = self.send(prep, **send_kwargs)
File "/usr/local/lib/python3.9/site-packages/requests/sessions.py", line 655, in send
r = adapter.send(request, **kwargs)
File "/usr/local/lib/python3.9/site-packages/requests/adapters.py", line 439, in send
resp = conn.urlopen(
File "/usr/local/lib/python3.9/site-packages/urllib3/connectionpool.py", line 699, in urlopen
httplib_response = self._make_request(
File "/usr/local/lib/python3.9/site-packages/urllib3/connectionpool.py", line 440, in _make_request
httplib_response = conn.getresponse()
File "/usr/local/lib/python3.9/http/client.py", line 1371, in getresponse
response.begin()
File "/usr/local/lib/python3.9/http/client.py", line 319, in begin
version, status, reason = self._read_status()
File "/usr/local/lib/python3.9/http/client.py", line 280, in _read_status
line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1")
File "/usr/local/lib/python3.9/socket.py", line 704, in readinto
return self._sock.recv_into(b)
2021-10-24 09:59:53 ERROR (SyncWorker_4) [concurrent.futures] exception calling callback for <Future at 0x7f2e34b3e0a0 state=finished raised SystemExit>
Traceback (most recent call last):
File "/usr/local/lib/python3.9/concurrent/futures/thread.py", line 52, in run
result = self.fn(*self.args, **self.kwargs)
File "/usr/src/homeassistant/homeassistant/components/vera/common.py", line 80, in _run_poll_server
if not self.poll_server_once():
File "/usr/local/lib/python3.9/site-packages/pyvera/__init__.py", line 1669, in poll_server_once
device_data, new_timestamp = self.get_device_data(self._last_updated)
File "/usr/local/lib/python3.9/site-packages/pyvera/__init__.py", line 1646, in get_device_data
return self._controller.get_changed_devices(last_updated)
File "/usr/local/lib/python3.9/site-packages/pyvera/__init__.py", line 335, in get_changed_devices
response = self.data_request(payload, TIMEOUT * 2)
File "/usr/local/lib/python3.9/site-packages/pyvera/__init__.py", line 121, in data_request
response = requests.get(request_url, timeout=timeout, params=payload)
File "/usr/local/lib/python3.9/site-packages/requests/api.py", line 75, in get
return request('get', url, params=params, **kwargs)
File "/usr/local/lib/python3.9/site-packages/requests/api.py", line 61, in request
return session.request(method=method, url=url, **kwargs)
File "/usr/local/lib/python3.9/site-packages/requests/sessions.py", line 542, in request
resp = self.send(prep, **send_kwargs)
File "/usr/local/lib/python3.9/site-packages/requests/sessions.py", line 655, in send
r = adapter.send(request, **kwargs)
File "/usr/local/lib/python3.9/site-packages/requests/adapters.py", line 439, in send
resp = conn.urlopen(
File "/usr/local/lib/python3.9/site-packages/urllib3/connectionpool.py", line 699, in urlopen
httplib_response = self._make_request(
File "/usr/local/lib/python3.9/site-packages/urllib3/connectionpool.py", line 445, in _make_request
six.raise_from(e, None)
File "<string>", line 3, in raise_from
File "/usr/local/lib/python3.9/site-packages/urllib3/connectionpool.py", line 440, in _make_request
httplib_response = conn.getresponse()
File "/usr/local/lib/python3.9/http/client.py", line 1371, in getresponse
response.begin()
File "/usr/local/lib/python3.9/http/client.py", line 319, in begin
version, status, reason = self._read_status()
File "/usr/local/lib/python3.9/http/client.py", line 280, in _read_status
line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1")
File "/usr/local/lib/python3.9/socket.py", line 704, in readinto
return self._sock.recv_into(b)
SystemExit
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/usr/local/lib/python3.9/concurrent/futures/_base.py", line 329, in _invoke_callbacks
callback(self)
File "/usr/local/lib/python3.9/asyncio/futures.py", line 398, in _call_set_state
dest_loop.call_soon_threadsafe(_set_state, destination, source)
File "/usr/local/lib/python3.9/asyncio/base_events.py", line 791, in call_soon_threadsafe
self._check_closed()
File "/usr/local/lib/python3.9/asyncio/base_events.py", line 510, in _check_closed
raise RuntimeError('Event loop is closed')
RuntimeError: Event loop is closed