HA unreachable as from (each) Sunday

Installation Home Assistant OS
1

I’ve HA runnning on a RBPI 4 with an M2 SSD connected to it via USB.
It ran smoothly for over a year.
Last week Sunday, it became unreachable and also (partly) unresponsive:

  • Web interface is not accessible anymore
  • Automations do not trigger anymore
  • (some?) add-ons keep on working (like MQTT, because I can verify that from outside HA)
  • I can still ping the device

After rebooting, I can access the web interface for ~10 seconds and then it doesn’t respond anymore (it times out after several minutes waiting).
Last week, I tried rebooting it several times without succes. Until Friday evening, after a reboot everything seemed totally fine again. I have even upgraded it to the latest HA version without any issue. Saturday it worked fine as well.

And then Sunday again, since yesterday it shows the same behaviour as last week.

  • Web interface is not accessible anymore
  • Automations do not trigger anymore
  • (some?) add-ons keep on working (like MQTT, because I can verify that from outside HA)
  • I can still ping the device

I have no clue for this. Where should I look for? I don’t have automations running (only) on Sunday. Add-ons do not update automatically.
What can I do to get HA up and running again and how can I find out what’s going wrong?

2

I managed to get SSH access. The CLI is working fine… anyone has an idea where I should start looking to get the web interface up and running again?

3

And it’s Sunday again…
Last week I’ve completely reinstalled HA and restored my backup. Since today it’s unreachable again. I can’t access it via SSH, nor via the web interface.

:frowning: :frowning:

Does anybody has an idea what could go wrong here?

4

Have you tried to attach a monitor and keyboard direct to your HA device, to see if your can access the web UI there ? … or CLI

EDIT: As you provide no logs, i guess you haven’t looked there, in your “analyzes” , but would be a good idea, also(in worse case enable Debug), to get additional tracing of what’s going on , in HA … could be as simple as a network issue, but with the lack of info anyone would only be able to “speculate”

5

I checked the logs last week before I did a clean install. Nothing special there.

Attaching a monitor is a good idea. What kind of logs should I look for?

A network issue is not the case. Since I can access HA directly after the reboot through the web interface for few seconds. And I can still ping it. And the health page is working as well.

6

I attached a monitor and also rebooted the system. Now SSH is working…

ha host logs

...
[    2.877885] systemd[1]: Condition check resulted in Huge Pages File System being skipped.
[    2.883357] systemd[1]: Mounting POSIX Message Queue File System...
[    2.891770] systemd[1]: Mounting Kernel Debug File System...
[    2.900163] systemd[1]: Mounting Kernel Trace File System...
[    2.909218] systemd[1]: Started D-Bus System Message Bus.
[    2.922453] systemd[1]: Starting Home Assistant OS Agent...
[    2.934467] systemd[1]: Starting Create List of Static Device Nodes...
[    2.944548] systemd[1]: Starting Load Kernel Module configfs...
[    2.954330] systemd[1]: Starting Load Kernel Module drm...
[    2.964120] systemd[1]: Starting Load Kernel Module fuse...
[    2.976607] systemd[1]: Starting Journal Service...
[    2.985933] systemd[1]: Starting Remount Root and Kernel File Systems...
[    2.997297] systemd[1]: Starting Wait Until Kernel Time Synchronized...
[    3.007671] systemd[1]: Starting Coldplug All udev Devices...
[    3.017090] systemd[1]: Starting Disk Manager...
[    3.028889] systemd[1]: Starting HassOS ZRAM swap...
[    3.038641] systemd[1]: Starting HassOS ZRAM tmp...
[    3.049794] systemd[1]: Starting HassOS ZRAM var...
[    3.070451] systemd[1]: Mounted POSIX Message Queue File System.
[    3.074326] fuse: init (API version 7.32)
[    3.080974] systemd[1]: Mounted Kernel Debug File System.
[    3.086798] systemd[1]: Mounted Kernel Trace File System.
[    3.097423] systemd[1]: Finished Create List of Static Device Nodes.
[    3.103684] systemd[1]: [email protected]: Deactivated successfully.
[    3.109006] systemd[1]: Finished Load Kernel Module configfs.
[    3.114886] systemd[1]: [email protected]: Deactivated successfully.
[    3.118864] systemd[1]: Finished Load Kernel Module drm.
[    3.124770] systemd[1]: [email protected]: Deactivated successfully.
[    3.129323] zram2: detected capacity change from 0 to 16777216
[    3.129568] zram1: detected capacity change from 0 to 33554432
[    3.130402] systemd[1]: Finished Load Kernel Module fuse.
[    3.136038] zram0: detected capacity change from 0 to 994201600
[    3.143534] systemd[1]: Started Journal Service.
[    3.263317] audit: type=1334 audit(1634052244.987:2): prog-id=5 op=LOAD
[    3.266148] audit: type=1334 audit(1634052244.987:3): prog-id=6 op=LOAD
[    3.562653] rpivid-mem feb00000.hevc-decoder: rpivid-hevcmem initialised: Registers at 0xfeb00000 length 0x00010000
[    3.565228] rpivid-mem feb10000.rpivid-local-intc: rpivid-intcmem initialised: Registers at 0xfeb10000 length 0x00001000
[    3.569858] rpivid-mem feb20000.h264-decoder: rpivid-h264mem initialised: Registers at 0xfeb20000 length 0x00010000
[    3.572153] rpivid-mem feb30000.vp9-decoder: rpivid-vp9mem initialised: Registers at 0xfeb30000 length 0x00010000
[    3.595041] snd_bcm2835: module is from the staging directory, the quality is unknown, you have been warned.
[    3.601414] vc_sm_cma: module is from the staging directory, the quality is unknown, you have been warned.
[    3.606366] bcm2835_audio bcm2835_audio: card created with 4 channels
[    3.618206] bcm2835_vc_sm_cma_probe: Videocore shared memory driver
[    3.619658] bcm2835_audio bcm2835_audio: card created with 4 channels
[    3.620240] [vc_sm_connected_init]: start
[    3.638131] usbcore: registered new interface driver cp210x
[    3.643708] [vc_sm_connected_init]: installed successfully
[    3.651571] usbserial: USB Serial support registered for cp210x
[    3.659613] cp210x 1-1.3:1.0: cp210x converter detected
[    3.675571] videodev: Linux video capture interface: v2.00
[    3.687184] usb 1-1.3: cp210x converter now attached to ttyUSB0
[    3.690677] cp210x 1-1.4:1.0: cp210x converter detected
[    3.696716] bcm2835_mmal_vchiq: module is from the staging directory, the quality is unknown, you have been warned.
[    3.696849] bcm2835_mmal_vchiq: module is from the staging directory, the quality is unknown, you have been warned.
[    3.712189] bcm2835_isp: module is from the staging directory, the quality is unknown, you have been warned.
[    3.714764] usb 1-1.4: cp210x converter now attached to ttyUSB1
[    3.717566] bcm2835_codec: module is from the staging directory, the quality is unknown, you have been warned.
[    3.719091] bcm2835_v4l2: module is from the staging directory, the quality is unknown, you have been warned.
[    3.727877] bcm2835-isp bcm2835-isp: Device node output[0] registered as /dev/video13
[    3.730183] bcm2835-isp bcm2835-isp: Device node capture[0] registered as /dev/video14
[    3.732527] bcm2835-codec bcm2835-codec: Device registered as /dev/video10
[    3.738240] bcm2835-codec bcm2835-codec: Loaded V4L2 decode
[    3.756623] checking generic (3e163000 960000) vs hw (0 ffffffffffffffff)
[    3.756638] fb0: switching to vc4drmfb from simple
[    3.756824] bcm2835-isp bcm2835-isp: Device node capture[1] registered as /dev/video15
[    3.762173] Console: switching to colour dummy device 80x25
[    3.766963] bcm2835-isp bcm2835-isp: Device node stats[2] registered as /dev/video16
[    3.767211] bcm2835-isp bcm2835-isp: Register output node 0 with media controller
[    3.767428] bcm2835-isp bcm2835-isp: Register capture node 1 with media controller
[    3.767455] bcm2835-isp bcm2835-isp: Register capture node 2 with media controller
[    3.767468] bcm2835-isp bcm2835-isp: Register capture node 3 with media controller
[    3.768050] vc4-drm gpu: bound fe600000.firmwarekms (ops vc4_fkms_ops [vc4])
[    3.769251] [drm] Initialized vc4 0.0.0 20140616 for gpu on minor 0
[    3.769375] bcm2835-codec bcm2835-codec: Device registered as /dev/video11
[    3.769424] bcm2835-codec bcm2835-codec: Loaded V4L2 encode
[    3.773391] [drm] Initialized v3d 1.0.0 20180419 for fec00000.v3d on minor 1
[    3.793471] bcm2835-codec bcm2835-codec: Device registered as /dev/video12
[    3.793515] bcm2835-codec bcm2835-codec: Loaded V4L2 isp
[    3.793736] bcm2835-isp bcm2835-isp: Device node output[0] registered as /dev/video20
[    3.794812] bcm2835-isp bcm2835-isp: Device node capture[0] registered as /dev/video21
[    3.795128] bcm2835-isp bcm2835-isp: Device node capture[1] registered as /dev/video22
[    3.796478] bcm2835-isp bcm2835-isp: Device node stats[2] registered as /dev/video23
[    3.796513] bcm2835-isp bcm2835-isp: Register output node 0 with media controller
[    3.796530] bcm2835-isp bcm2835-isp: Register capture node 1 with media controller
[    3.796543] bcm2835-isp bcm2835-isp: Register capture node 2 with media controller
[    3.796560] bcm2835-isp bcm2835-isp: Register capture node 3 with media controller
[    3.796667] bcm2835-isp bcm2835-isp: Loaded V4L2 bcm2835-isp
[    3.800859] bcm2835-codec bcm2835-codec: Device registered as /dev/video18
[    3.800904] bcm2835-codec bcm2835-codec: Loaded V4L2 image_fx
[    3.854857] cfg80211: Loading compiled-in X.509 certificates for regulatory database
[    3.868005] cfg80211: Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7'
[    3.886174] brcmfmac: F1 signature read @0x18000000=0x15264345
[    3.896200] brcmfmac: brcmf_fw_alloc_request: using brcm/brcmfmac43455-sdio for chip BCM4345/6
[    3.905516] usbcore: registered new interface driver brcmfmac
[    4.039677] Console: switching to colour frame buffer device 480x135
[    4.093430] random: crng init done
[    4.093437] random: 7 urandom warning(s) missed due to ratelimiting
[    4.106790] vc4-drm gpu: [drm] fb0: vc4drmfb frame buffer device
[    4.111107] brcmfmac: brcmf_fw_alloc_request: using brcm/brcmfmac43455-sdio for chip BCM4345/6
[    4.112046] brcmfmac: brcmf_fw_alloc_request: using brcm/brcmfmac43455-sdio for chip BCM4345/6
[    4.120390] brcmfmac: brcmf_c_preinit_dcmds: Firmware: BCM4345/6 wl0: Jan  4 2021 19:56:29 version 7.45.229 (617f1f5 CY) FWID 01-2dbd9d2e
[    4.242652] EXT4-fs (zram1): mounted filesystem without journal. Opts: nobarrier
[    4.255881] Adding 970896k swap on /dev/zram0.  Priority:-2 extents:1 across:970896k SSFS
[    4.259508] FAT-fs (sda1): Volume was not properly unmounted. Some data may be corrupt. Please run fsck.
[    4.276299] EXT4-fs (zram2): mounted filesystem without journal. Opts: nobarrier
[    5.334823] EXT4-fs (sda7): mounted filesystem with ordered data mode. Opts: (null)
[    5.613532] EXT4-fs (sda8): mounted filesystem with ordered data mode. Opts: (null)
[    5.673164] EXT4-fs (sda8): resizing filesystem from 121918209 to 121918209 blocks
[    5.734621] systemd-journald[125]: Received client request to flush runtime journal.
[    5.791501] systemd-journald[125]: File /var/log/journal/01b10b9a890542be96db213b2938f6df/system.journal corrupted or uncleanly shut down, renaming and replacing.
[    6.364824] systemd-journald[125]: File /var/log/journal/01b10b9a890542be96db213b2938f6df/user-1005.journal corrupted or uncleanly shut down, renaming and replacing.
[    6.443134] audit: type=1334 audit(1650213618.983:4): prog-id=7 op=LOAD
[    6.448248] audit: type=1334 audit(1650213618.991:5): prog-id=8 op=LOAD
[    6.553776] uart-pl011 fe201000.serial: no DMA platform data
[    6.716719] audit: type=1334 audit(1650213619.259:6): prog-id=9 op=LOAD
[    6.716905] audit: type=1334 audit(1650213619.259:7): prog-id=10 op=LOAD
[    6.741372] systemd-journald[125]: Failed to read journal file /var/log/journal/01b10b9a890542be96db213b2938f6df/user-1001.journal for rotation, trying to move it out of the way: Text file busy
[    6.762842] systemd-journald[125]: Failed to read journal file /var/log/journal/01b10b9a890542be96db213b2938f6df/user-1004.journal for rotation, trying to move it out of the way: Text file busy
[    7.166452] Bluetooth: Core ver 2.22
[    7.166530] NET: Registered protocol family 31
[    7.166536] Bluetooth: HCI device and connection manager initialized
[    7.166551] Bluetooth: HCI socket layer initialized
[    7.166560] Bluetooth: L2CAP socket layer initialized
[    7.166576] Bluetooth: SCO socket layer initialized
[    7.175447] Bluetooth: HCI UART driver ver 2.3
[    7.175461] Bluetooth: HCI UART protocol H4 registered
[    7.175527] Bluetooth: HCI UART protocol Three-wire (H5) registered
[    7.175685] Bluetooth: HCI UART protocol Broadcom registered
[    7.424484] bcmgenet fd580000.ethernet: configuring instance for external RGMII (RX delay)
[    7.424711] bcmgenet fd580000.ethernet eth0: Link is Down
[    7.469296] brcmfmac: brcmf_cfg80211_set_power_mgmt: power save enabled
[    7.498428] Bluetooth: BNEP (Ethernet Emulation) ver 1.3
[    7.498441] Bluetooth: BNEP filters: protocol multicast
[    7.498456] Bluetooth: BNEP socket layer initialized
[    7.513678] NET: Registered protocol family 38
[   11.523931] bcmgenet fd580000.ethernet eth0: Link is Up - 1Gbps/Full - flow control off
[   11.523963] IPv6: ADDRCONF(NETDEV_CHANGE): eth0: link becomes ready
[   31.715861] cam-dummy-reg: disabling
[   31.715885] cam1-reg: disabling
[   36.810055] audit: type=1400 audit(1650216158.274:8): apparmor="STATUS" operation="profile_load" profile="unconfined" name="2ad9b828_ebusd" pid=472 comm="apparmor_parser"
[   36.810088] audit: type=1400 audit(1650216158.274:8): apparmor="STATUS" operation="profile_load" profile="unconfined" name="2ad9b828_ebusd///usr/bin/ebusd" pid=472 comm="apparmor_parser"
[   36.837661] audit: type=1400 audit(1650216158.298:9): apparmor="STATUS" operation="profile_load" profile="unconfined" name="hassio-supervisor" pid=474 comm="apparmor_parser"
[   36.837684] audit: type=1400 audit(1650216158.298:9): apparmor="STATUS" operation="profile_load" profile="unconfined" name="hassio-supervisor///usr/bin/gdbus" pid=474 comm="apparmor_parser"
[   36.837698] audit: type=1400 audit(1650216158.298:9): apparmor="STATUS" operation="profile_load" profile="unconfined" name="hassio-supervisor///usr/bin/git" pid=474 comm="apparmor_parser"
[   37.739975] audit: type=1334 audit(1650216159.210:10): prog-id=10 op=UNLOAD
[   37.740001] audit: type=1334 audit(1650216159.210:11): prog-id=9 op=UNLOAD
[   37.905446] audit: type=1400 audit(1650216159.374:12): apparmor="STATUS" operation="profile_load" profile="unconfined" name="docker-default" pid=500 comm="apparmor_parser"
[   38.707921] audit: type=1325 audit(1650216160.174:13): table=nat family=2 entries=5 op=xt_replace pid=538 subj==unconfined comm="iptables"
[   38.716465] audit: type=1325 audit(1650216160.186:14): table=filter family=2 entries=4 op=xt_replace pid=540 subj==unconfined comm="iptables"
[   38.768790] Initializing XFRM netlink socket
[   42.101648] kauditd_printk_skb: 65 callbacks suppressed
[   42.101655] audit: type=1325 audit(1650216163.570:80): table=nat family=2 entries=19 op=xt_replace pid=964 subj==unconfined comm="iptables"
[   42.110752] audit: type=1325 audit(1650216163.578:81): table=filter family=2 entries=28 op=xt_replace pid=966 subj==unconfined comm="iptables"
[   42.120157] audit: type=1325 audit(1650216163.590:82): table=nat family=2 entries=18 op=xt_replace pid=968 subj==unconfined comm="iptables"
[   43.115550] audit: type=1325 audit(1650216164.582:83): table=nat family=2 entries=17 op=xt_replace pid=1033 subj==unconfined comm="iptables"
[   43.126485] audit: type=1325 audit(1650216164.594:84): table=filter family=2 entries=27 op=xt_replace pid=1035 subj==unconfined comm="iptables"
[   43.137772] audit: type=1325 audit(1650216164.606:85): table=nat family=2 entries=16 op=xt_replace pid=1037 subj==unconfined comm="iptables"
[   43.674486] audit: type=1325 audit(1650216165.142:86): table=nat family=2 entries=15 op=xt_replace pid=1072 subj==unconfined comm="iptables"
[   43.685264] audit: type=1325 audit(1650216165.154:87): table=filter family=2 entries=26 op=xt_replace pid=1074 subj==unconfined comm="iptables"
[   43.694624] audit: type=1325 audit(1650216165.162:88): table=nat family=2 entries=14 op=xt_replace pid=1076 subj==unconfined comm="iptables"
[   43.979754] audit: type=1325 audit(1650216165.446:89): table=nat family=2 entries=13 op=xt_replace pid=1093 subj==unconfined comm="iptables"
[   44.239147] hassio: port 1(veth888d54c) entered blocking state
[   44.239163] hassio: port 1(veth888d54c) entered disabled state
[   44.239610] device veth888d54c entered promiscuous mode
[   44.593376] cgroup: cgroup: disabling cgroup2 socket matching due to net_prio or net_cls activation
[   45.054929] eth0: renamed from veth79eefd6
[   45.073288] IPv6: ADDRCONF(NETDEV_CHANGE): veth888d54c: link becomes ready
[   45.073420] hassio: port 1(veth888d54c) entered blocking state
[   45.073431] hassio: port 1(veth888d54c) entered forwarding state
[   45.073586] IPv6: ADDRCONF(NETDEV_CHANGE): hassio: link becomes ready
[   46.068846] docker0: port 1(veth8b7dd16) entered blocking state
[   46.068860] docker0: port 1(veth8b7dd16) entered disabled state
[   46.069292] device veth8b7dd16 entered promiscuous mode
[   46.104566] hassio: port 2(veth4729f9b) entered blocking state
[   46.104581] hassio: port 2(veth4729f9b) entered disabled state
[   46.104946] device veth4729f9b entered promiscuous mode
[   46.105568] hassio: port 2(veth4729f9b) entered blocking state
[   46.105582] hassio: port 2(veth4729f9b) entered forwarding state
[   46.590670] eth0: renamed from veth71d7c89
[   46.609537] hassio: port 2(veth4729f9b) entered disabled state
[   46.609753] IPv6: ADDRCONF(NETDEV_CHANGE): veth8b7dd16: link becomes ready
[   46.609919] docker0: port 1(veth8b7dd16) entered blocking state
[   46.609930] docker0: port 1(veth8b7dd16) entered forwarding state
[   46.610168] IPv6: ADDRCONF(NETDEV_CHANGE): docker0: link becomes ready
[   46.832809] eth1: renamed from veth3387e9e
[   46.865527] IPv6: ADDRCONF(NETDEV_CHANGE): veth4729f9b: link becomes ready
[   46.865727] hassio: port 2(veth4729f9b) entered blocking state
[   46.865740] hassio: port 2(veth4729f9b) entered forwarding state
[   51.756646] kauditd_printk_skb: 46 callbacks suppressed
[   51.756653] audit: type=1334 audit(1650216173.226:136): prog-id=11 op=LOAD
[   51.756778] audit: type=1334 audit(1650216173.226:137): prog-id=12 op=LOAD
[   52.108162] audit: type=1334 audit(1650216173.578:138): prog-id=13 op=LOAD
[   52.108251] audit: type=1334 audit(1650216173.578:139): prog-id=14 op=LOAD
[   53.496802] audit: type=1400 audit(1650216174.962:140): apparmor="STATUS" operation="profile_replace" info="same as current profile, skipping" profile="unconfined" name="2ad9b828_ebusd" pid=1940 comm="apparmor_parser"
[   53.496839] audit: type=1400 audit(1650216174.962:140): apparmor="STATUS" operation="profile_replace" info="same as current profile, skipping" profile="unconfined" name="2ad9b828_ebusd///usr/bin/ebusd" pid=1940 comm="apparmor_parser"
[   53.522541] audit: type=1400 audit(1650216174.986:141): apparmor="STATUS" operation="profile_replace" info="same as current profile, skipping" profile="unconfined" name="hassio-supervisor" pid=1942 comm="apparmor_parser"
[   53.522606] audit: type=1400 audit(1650216174.986:141): apparmor="STATUS" operation="profile_replace" info="same as current profile, skipping" profile="unconfined" name="hassio-supervisor///usr/bin/gdbus" pid=1942 comm="apparmor_parser"
[   53.522646] audit: type=1400 audit(1650216174.986:141): apparmor="STATUS" operation="profile_replace" info="same as current profile, skipping" profile="unconfined" name="hassio-supervisor///usr/bin/git" pid=1942 comm="apparmor_parser"
[   53.774441] hassio: port 3(vethc54b699) entered blocking state
[   53.774455] hassio: port 3(vethc54b699) entered disabled state
[   53.774648] device vethc54b699 entered promiscuous mode
[   53.774711] audit: type=1700 audit(1650216175.242:142): dev=vethc54b699 prom=256 old_prom=0 auid=4294967295 uid=0 gid=0 ses=4294967295
[   54.378699] eth0: renamed from veth2c4d511
[   54.397480] IPv6: ADDRCONF(NETDEV_CHANGE): vethc54b699: link becomes ready
[   54.397638] hassio: port 3(vethc54b699) entered blocking state
[   54.397650] hassio: port 3(vethc54b699) entered forwarding state
[   54.773743] hassio: port 4(veth698f920) entered blocking state
[   54.773756] hassio: port 4(veth698f920) entered disabled state
[   54.774211] device veth698f920 entered promiscuous mode
[   55.443337] eth0: renamed from veth9dbea49
[   55.465052] IPv6: ADDRCONF(NETDEV_CHANGE): veth698f920: link becomes ready
[   55.465182] hassio: port 4(veth698f920) entered blocking state
[   55.465189] hassio: port 4(veth698f920) entered forwarding state
[   55.856565] hassio: port 5(veth026f6e3) entered blocking state
[   55.856580] hassio: port 5(veth026f6e3) entered disabled state
[   55.857168] device veth026f6e3 entered promiscuous mode
[   56.530605] eth0: renamed from veth6899b9d
[   56.548980] IPv6: ADDRCONF(NETDEV_CHANGE): veth026f6e3: link becomes ready
[   56.549111] hassio: port 5(veth026f6e3) entered blocking state
[   56.549118] hassio: port 5(veth026f6e3) entered forwarding state
[   59.051674] hassio: port 6(veth9b4f7f7) entered blocking state
[   59.051689] hassio: port 6(veth9b4f7f7) entered disabled state
[   59.052060] device veth9b4f7f7 entered promiscuous mode
[   59.052145] kauditd_printk_skb: 32 callbacks suppressed
[   59.052150] audit: type=1700 audit(1650216180.518:175): dev=veth9b4f7f7 prom=256 old_prom=0 auid=4294967295 uid=0 gid=0 ses=4294967295
[   59.102611] audit: type=1325 audit(1650216180.570:176): table=nat family=2 entries=15 op=xt_replace pid=3455 subj==unconfined comm="iptables"
[   59.112529] audit: type=1325 audit(1650216180.582:177): table=filter family=2 entries=30 op=xt_replace pid=3457 subj==unconfined comm="iptables"
[   59.124223] audit: type=1325 audit(1650216180.594:178): table=nat family=2 entries=16 op=xt_replace pid=3459 subj==unconfined comm="iptables"
[   59.148021] audit: type=1325 audit(1650216180.618:179): table=nat family=2 entries=17 op=xt_replace pid=3478 subj==unconfined comm="iptables"
[   59.161508] audit: type=1325 audit(1650216180.630:180): table=filter family=2 entries=31 op=xt_replace pid=3483 subj==unconfined comm="iptables"
[   59.173258] audit: type=1325 audit(1650216180.642:181): table=nat family=2 entries=18 op=xt_replace pid=3485 subj==unconfined comm="iptables"
[   59.201366] audit: type=1325 audit(1650216180.670:182): table=nat family=2 entries=19 op=xt_replace pid=3508 subj==unconfined comm="iptables"
[   59.212690] audit: type=1325 audit(1650216180.682:183): table=filter family=2 entries=32 op=xt_replace pid=3519 subj==unconfined comm="iptables"
[   59.225405] audit: type=1325 audit(1650216180.694:184): table=nat family=2 entries=20 op=xt_replace pid=3532 subj==unconfined comm="iptables"
[   59.595906] Bluetooth: RFCOMM TTY layer initialized
[   59.595937] Bluetooth: RFCOMM socket layer initialized
[   59.595977] Bluetooth: RFCOMM ver 1.11
[   60.006065] eth0: renamed from vetha4b16f5
[   60.029524] IPv6: ADDRCONF(NETDEV_CHANGE): veth9b4f7f7: link becomes ready
[   60.029704] hassio: port 6(veth9b4f7f7) entered blocking state
[   60.029715] hassio: port 6(veth9b4f7f7) entered forwarding state
[   60.446323] hassio: port 7(vethad4faa0) entered blocking state
[   60.446336] hassio: port 7(vethad4faa0) entered disabled state
[   60.446638] device vethad4faa0 entered promiscuous mode
[   61.153641] eth0: renamed from veth5536495
[   61.173739] IPv6: ADDRCONF(NETDEV_CHANGE): vethad4faa0: link becomes ready
[   61.173861] hassio: port 7(vethad4faa0) entered blocking state
[   61.173868] hassio: port 7(vethad4faa0) entered forwarding state
[   66.713782] hassio: port 8(veth59c3e23) entered blocking state
[   66.713800] hassio: port 8(veth59c3e23) entered disabled state
[   66.714231] device veth59c3e23 entered promiscuous mode
[   66.714323] kauditd_printk_skb: 24 callbacks suppressed
[   66.714328] audit: type=1700 audit(1650216188.182:209): dev=veth59c3e23 prom=256 old_prom=0 auid=4294967295 uid=0 gid=0 ses=4294967295
[   67.552434] audit: type=1325 audit(1650216189.018:210): table=nat family=2 entries=0 op=xt_register pid=4517 subj==unconfined comm="iptables"
[   67.569894] audit: type=1325 audit(1650216189.038:211): table=filter family=2 entries=0 op=xt_register pid=4518 subj==unconfined comm="iptables"
[   67.609658] audit: type=1325 audit(1650216189.078:212): table=nat family=2 entries=5 op=xt_replace pid=4525 subj==unconfined comm="iptables"
[   67.614008] audit: type=1325 audit(1650216189.082:213): table=nat family=2 entries=7 op=xt_replace pid=4529 subj==unconfined comm="iptables"
[   67.621630] audit: type=1325 audit(1650216189.090:214): table=nat family=2 entries=8 op=xt_replace pid=4531 subj==unconfined comm="iptables"
[   67.625740] audit: type=1325 audit(1650216189.094:215): table=nat family=2 entries=10 op=xt_replace pid=4532 subj==unconfined comm="iptables"
[   67.631531] audit: type=1325 audit(1650216189.098:216): table=nat family=2 entries=11 op=xt_replace pid=4533 subj==unconfined comm="iptables"
[   67.637887] audit: type=1325 audit(1650216189.106:217): table=nat family=2 entries=12 op=xt_replace pid=4534 subj==unconfined comm="iptables"
[   67.643588] audit: type=1325 audit(1650216189.110:218): table=nat family=2 entries=13 op=xt_replace pid=4535 subj==unconfined comm="iptables"
[   67.681331] eth0: renamed from veth89e3a64
[   67.709231] IPv6: ADDRCONF(NETDEV_CHANGE): veth59c3e23: link becomes ready
[   67.709349] hassio: port 8(veth59c3e23) entered blocking state
[   67.709355] hassio: port 8(veth59c3e23) entered forwarding state
[   69.044984] hassio: port 9(veth24c640b) entered blocking state
[   69.044998] hassio: port 9(veth24c640b) entered disabled state
[   69.045258] device veth24c640b entered promiscuous mode
[   70.268675] eth0: renamed from vethcd53ed2
[   70.290335] IPv6: ADDRCONF(NETDEV_CHANGE): veth24c640b: link becomes ready
[   70.290504] hassio: port 9(veth24c640b) entered blocking state
[   70.290512] hassio: port 9(veth24c640b) entered forwarding state
[   76.018244] veth5536495: renamed from eth0
[   76.069865] hassio: port 7(vethad4faa0) entered disabled state
[   76.106667] hassio: port 7(vethad4faa0) entered disabled state
[   76.108301] device vethad4faa0 left promiscuous mode
[   76.108343] hassio: port 7(vethad4faa0) entered disabled state
[   76.108403] kauditd_printk_skb: 15 callbacks suppressed
[   76.108408] audit: type=1700 audit(1650216197.574:234): dev=vethad4faa0 prom=0 old_prom=256 auid=4294967295 uid=0 gid=0 ses=4294967295
[   76.321110] audit: type=1325 audit(1650216197.790:235): table=nat family=2 entries=15 op=xt_unregister pid=305 subj==unconfined comm="kworker/u8:2"
[   76.321149] audit: type=1325 audit(1650216197.790:236): table=filter family=2 entries=4 op=xt_unregister pid=305 subj==unconfined comm="kworker/u8:2"
[   82.591755] audit: type=1334 audit(1650216204.062:237): prog-id=12 op=UNLOAD
[   82.591780] audit: type=1334 audit(1650216204.062:238): prog-id=11 op=UNLOAD
[   82.612092] audit: type=1334 audit(1650216204.082:239): prog-id=14 op=UNLOAD
[   82.612125] audit: type=1334 audit(1650216204.082:240): prog-id=13 op=UNLOAD
[  126.107484] hassio: port 7(vethaa24932) entered blocking state
[  126.107500] hassio: port 7(vethaa24932) entered disabled state
[  126.107731] device vethaa24932 entered promiscuous mode
[  126.107872] audit: type=1700 audit(1650216247.578:241): dev=vethaa24932 prom=256 old_prom=0 auid=4294967295 uid=0 gid=0 ses=4294967295
[  126.829744] audit: type=1325 audit(1650216248.298:242): table=nat family=2 entries=0 op=xt_register pid=7847 subj==unconfined comm="iptables"
[  126.839379] audit: type=1325 audit(1650216248.306:243): table=filter family=2 entries=0 op=xt_register pid=7848 subj==unconfined comm="iptables"
[  126.855652] audit: type=1325 audit(1650216248.326:244): table=nat family=2 entries=5 op=xt_replace pid=7851 subj==unconfined comm="iptables"
[  126.862897] audit: type=1325 audit(1650216248.330:245): table=nat family=2 entries=7 op=xt_replace pid=7852 subj==unconfined comm="iptables"
[  126.876801] audit: type=1325 audit(1650216248.346:246): table=nat family=2 entries=8 op=xt_replace pid=7854 subj==unconfined comm="iptables"
[  126.883461] audit: type=1325 audit(1650216248.350:247): table=nat family=2 entries=10 op=xt_replace pid=7855 subj==unconfined comm="iptables"
[  126.890134] audit: type=1325 audit(1650216248.358:248): table=nat family=2 entries=11 op=xt_replace pid=7856 subj==unconfined comm="iptables"
[  126.898776] audit: type=1325 audit(1650216248.366:249): table=nat family=2 entries=12 op=xt_replace pid=7857 subj==unconfined comm="iptables"
[  126.905954] audit: type=1325 audit(1650216248.374:250): table=nat family=2 entries=13 op=xt_replace pid=7858 subj==unconfined comm="iptables"
[  126.944889] eth0: renamed from veth00b63a2
[  126.978238] IPv6: ADDRCONF(NETDEV_CHANGE): vethaa24932: link becomes ready
[  126.978391] hassio: port 7(vethaa24932) entered blocking state
[  126.978399] hassio: port 7(vethaa24932) entered forwarding state
[  127.478058] hassio: port 10(veth858f868) entered blocking state
[  127.478072] hassio: port 10(veth858f868) entered disabled state
[  127.478559] device veth858f868 entered promiscuous mode
[  128.572789] eth0: renamed from vetha5b81c2
[  128.594114] IPv6: ADDRCONF(NETDEV_CHANGE): veth858f868: link becomes ready
[  128.594269] hassio: port 10(veth858f868) entered blocking state
[  128.594277] hassio: port 10(veth858f868) entered forwarding state
[  130.357467] hassio: port 11(vethaf541aa) entered blocking state
[  130.357483] hassio: port 11(vethaf541aa) entered disabled state
[  130.357735] device vethaf541aa entered promiscuous mode
[  131.535114] kauditd_printk_skb: 19 callbacks suppressed
[  131.535124] audit: type=1325 audit(1650216253.002:270): table=nat family=2 entries=0 op=xt_register pid=8555 subj==unconfined comm="iptables"
[  131.549215] audit: type=1325 audit(1650216253.018:271): table=filter family=2 entries=0 op=xt_register pid=8556 subj==unconfined comm="iptables"
[  131.574605] audit: type=1325 audit(1650216253.042:272): table=nat family=2 entries=5 op=xt_replace pid=8559 subj==unconfined comm="iptables"
[  131.586749] audit: type=1325 audit(1650216253.054:273): table=nat family=2 entries=7 op=xt_replace pid=8560 subj==unconfined comm="iptables"
[  131.603778] audit: type=1325 audit(1650216253.074:274): table=nat family=2 entries=8 op=xt_replace pid=8562 subj==unconfined comm="iptables"
[  131.614938] audit: type=1325 audit(1650216253.082:275): table=nat family=2 entries=10 op=xt_replace pid=8564 subj==unconfined comm="iptables"
[  131.625922] audit: type=1325 audit(1650216253.094:276): table=nat family=2 entries=11 op=xt_replace pid=8565 subj==unconfined comm="iptables"
[  131.636969] audit: type=1325 audit(1650216253.106:277): table=nat family=2 entries=12 op=xt_replace pid=8566 subj==unconfined comm="iptables"
[  131.645308] audit: type=1325 audit(1650216253.114:278): table=nat family=2 entries=13 op=xt_replace pid=8567 subj==unconfined comm="iptables"
[  131.655157] audit: type=1325 audit(1650216253.122:279): table=nat family=2 entries=14 op=xt_replace pid=8568 subj==unconfined comm="iptables"
[  131.712732] eth0: renamed from veth6914fd6
[  131.742021] IPv6: ADDRCONF(NETDEV_CHANGE): vethaf541aa: link becomes ready
[  131.742220] hassio: port 11(vethaf541aa) entered blocking state
[  131.742231] hassio: port 11(vethaf541aa) entered forwarding state
[  137.035195] audit: type=1334 audit(1650216258.502:280): prog-id=15 op=LOAD
[  137.036493] audit: type=1334 audit(1650216258.506:281): prog-id=16 op=LOAD
[  138.125281] audit: type=1334 audit(1650216259.594:282): prog-id=17 op=LOAD
[  138.125957] audit: type=1334 audit(1650216259.594:283): prog-id=18 op=LOAD
[  167.407178] hassio: port 12(veth1fbd97a) entered blocking state
[  167.407191] hassio: port 12(veth1fbd97a) entered disabled state
[  167.407514] device veth1fbd97a entered promiscuous mode
[  167.407580] audit: type=1700 audit(1650216288.874:284): dev=veth1fbd97a prom=256 old_prom=0 auid=4294967295 uid=0 gid=0 ses=4294967295
[  168.086048] audit: type=1325 audit(1650216289.554:285): table=nat family=2 entries=0 op=xt_register pid=9446 subj==unconfined comm="iptables"
[  168.098391] audit: type=1325 audit(1650216289.566:286): table=filter family=2 entries=0 op=xt_register pid=9447 subj==unconfined comm="iptables"
[  168.114931] audit: type=1325 audit(1650216289.582:287): table=nat family=2 entries=5 op=xt_replace pid=9450 subj==unconfined comm="iptables"
[  168.128016] audit: type=1325 audit(1650216289.598:288): table=nat family=2 entries=7 op=xt_replace pid=9453 subj==unconfined comm="iptables"
[  168.135877] audit: type=1334 audit(1650216289.606:289): prog-id=16 op=UNLOAD
[  168.135901] audit: type=1334 audit(1650216289.606:290): prog-id=15 op=UNLOAD
[  168.137341] audit: type=1325 audit(1650216289.606:291): table=nat family=2 entries=8 op=xt_replace pid=9455 subj==unconfined comm="iptables"
[  168.141878] audit: type=1325 audit(1650216289.610:292): table=nat family=2 entries=10 op=xt_replace pid=9456 subj==unconfined comm="iptables"
[  168.148618] audit: type=1325 audit(1650216289.618:293): table=nat family=2 entries=11 op=xt_replace pid=9457 subj==unconfined comm="iptables"
[  168.215590] eth0: renamed from veth1c23f24
[  168.257642] IPv6: ADDRCONF(NETDEV_CHANGE): veth1fbd97a: link becomes ready
[  168.257825] hassio: port 12(veth1fbd97a) entered blocking state
[  168.257834] hassio: port 12(veth1fbd97a) entered forwarding state
7

ha supervisor logs

22-04-17 19:25:10 INFO (MainThread) [supervisor.hardware.monitor] Detecting HardwareAction.ADD hardware /dev/hidraw1 - None
22-04-17 19:25:34 ERROR (MainThread) [supervisor.homeassistant.api] Error on call http://172.30.32.1:8123/api/config: 
22-04-17 19:26:10 ERROR (MainThread) [supervisor.homeassistant.api] Error on call http://172.30.32.1:8123/api/config: 
22-04-17 19:26:27 ERROR (MainThread) [supervisor.homeassistant.api] Error on call http://172.30.32.1:8123/api/config: 
22-04-17 19:26:46 ERROR (MainThread) [supervisor.homeassistant.api] Error on call http://172.30.32.1:8123/api/config: 
22-04-17 19:26:48 ERROR (MainThread) [supervisor.homeassistant.api] Error on call http://172.30.32.1:8123/api/config: 
22-04-17 19:26:48 WARNING (MainThread) [supervisor.misc.tasks] Watchdog miss API response from Home Assistant
22-04-17 19:27:22 ERROR (MainThread) [supervisor.homeassistant.api] Error on call http://172.30.32.1:8123/api/config: 
22-04-17 19:27:58 ERROR (MainThread) [supervisor.homeassistant.api] Error on call http://172.30.32.1:8123/api/config: 
22-04-17 19:28:34 ERROR (MainThread) [supervisor.homeassistant.api] Error on call http://172.30.32.1:8123/api/config: 
22-04-17 19:29:08 ERROR (MainThread) [supervisor.homeassistant.api] Error on call http://172.30.32.1:8123/api/config: 
22-04-17 19:29:10 ERROR (MainThread) [supervisor.homeassistant.api] Error on call http://172.30.32.1:8123/api/config: 
22-04-17 19:29:19 ERROR (MainThread) [supervisor.homeassistant.api] Error on call http://172.30.32.1:8123/api/config: 
22-04-17 19:29:19 ERROR (MainThread) [supervisor.misc.tasks] Watchdog found a problem with Home Assistant API!
22-04-17 19:29:19 INFO (SyncWorker_1) [supervisor.docker.interface] Restarting ghcr.io/home-assistant/raspberrypi4-64-homeassistant
22-04-17 19:29:46 ERROR (MainThread) [supervisor.homeassistant.api] Error on call http://172.30.32.1:8123/api/config: 
22-04-17 19:30:22 ERROR (MainThread) [supervisor.homeassistant.api] Error on call http://172.30.32.1:8123/api/config: 
22-04-17 19:30:58 ERROR (MainThread) [supervisor.homeassistant.api] Error on call http://172.30.32.1:8123/api/config: 
22-04-17 19:31:34 ERROR (MainThread) [supervisor.homeassistant.api] Error on call http://172.30.32.1:8123/api/config: 
22-04-17 19:32:10 ERROR (MainThread) [supervisor.homeassistant.api] Error on call http://172.30.32.1:8123/api/config: 
22-04-17 19:32:25 INFO (MainThread) [supervisor.host.network] Updating local network information
22-04-17 19:32:46 ERROR (MainThread) [supervisor.homeassistant.api] Error on call http://172.30.32.1:8123/api/config: 
22-04-17 19:32:59 WARNING (MainThread) [supervisor.homeassistant.websocket] Connection is closed
22-04-17 19:32:59 ERROR (MainThread) [supervisor.homeassistant.api] Error on call http://172.30.32.1:8123/api/config: [Errno 104] Connection reset by peer
22-04-17 19:33:00 INFO (MainThread) [supervisor.homeassistant.core] Wait until Home Assistant is ready
22-04-17 19:33:09 INFO (MainThread) [supervisor.resolution.evaluate] Starting system evaluation with state CoreState.RUNNING
22-04-17 19:33:10 INFO (MainThread) [supervisor.resolution.evaluate] System evaluation complete
22-04-17 19:33:10 INFO (MainThread) [supervisor.updater] Fetching update data from https://version.home-assistant.io/stable.json
22-04-17 19:33:10 INFO (MainThread) [supervisor.store.git] Update add-on https://github.com/sabeechen/hassio-google-drive-backup repository
22-04-17 19:33:10 INFO (MainThread) [supervisor.store.git] Update add-on https://github.com/LukasGrebe/ha-addons/ repository
22-04-17 19:33:10 INFO (MainThread) [supervisor.store.git] Update add-on https://github.com/home-assistant/addons repository
22-04-17 19:33:11 INFO (MainThread) [supervisor.store] Loading add-ons from store: 26 all - 0 new - 0 remove
22-04-17 19:33:11 INFO (MainThread) [supervisor.store] Loading add-ons from store: 26 all - 0 new - 0 remove
22-04-17 19:33:16 WARNING (MainThread) [supervisor.addons.options] Option 'foreground' does not exist in the schema for eBUSd (2ad9b828_ebusd)
22-04-17 19:33:30 INFO (MainThread) [supervisor.api.proxy] Home Assistant WebSocket API request initialize
22-04-17 19:33:30 INFO (MainThread) [supervisor.api.proxy] WebSocket access from a0d7b954_nodered
22-04-17 19:33:30 INFO (MainThread) [supervisor.homeassistant.core] Detect a running Home Assistant instance
22-04-17 19:33:31 INFO (MainThread) [supervisor.api.proxy] Home Assistant WebSocket API request running
22-04-17 19:34:18 INFO (MainThread) [supervisor.api.proxy] Home Assistant WebSocket API error: Received message 257:None is not str
22-04-17 19:34:18 INFO (MainThread) [supervisor.api.proxy] Home Assistant WebSocket API connection is closed
22-04-17 19:34:54 ERROR (MainThread) [supervisor.homeassistant.api] Error on call http://172.30.32.1:8123/api/config: 
22-04-17 19:35:30 ERROR (MainThread) [supervisor.homeassistant.api] Error on call http://172.30.32.1:8123/api/config: 
22-04-17 19:36:00 ERROR (MainThread) [supervisor.homeassistant.api] Error on call http://172.30.32.1:8123/api/config: 
22-04-17 19:36:00 WARNING (MainThread) [supervisor.misc.tasks] Watchdog miss API response from Home Assistant
22-04-17 19:36:06 ERROR (MainThread) [supervisor.homeassistant.api] Error on call http://172.30.32.1:8123/api/config: 
22-04-17 19:36:42 ERROR (MainThread) [supervisor.homeassistant.api] Error on call http://172.30.32.1:8123/api/config: 
22-04-17 19:37:18 ERROR (MainThread) [supervisor.homeassistant.api] Error on call http://172.30.32.1:8123/api/config: 
22-04-17 19:37:54 ERROR (MainThread) [supervisor.homeassistant.api] Error on call http://172.30.32.1:8123/api/config: 
22-04-17 19:38:30 ERROR (MainThread) [supervisor.homeassistant.api] Error on call http://172.30.32.1:8123/api/config: 
22-04-17 19:38:31 ERROR (MainThread) [supervisor.homeassistant.api] Error on call http://172.30.32.1:8123/api/config: 
22-04-17 19:38:31 ERROR (MainThread) [supervisor.misc.tasks] Watchdog found a problem with Home Assistant API!
22-04-17 19:38:31 INFO (SyncWorker_0) [supervisor.docker.interface] Restarting ghcr.io/home-assistant/raspberrypi4-64-homeassistant
22-04-17 19:39:03 ERROR (MainThread) [supervisor.homeassistant.api] Error on call http://172.30.32.1:8123/api/config: 
22-04-17 19:39:06 ERROR (MainThread) [supervisor.homeassistant.api] Error on call http://172.30.32.1:8123/api/config: 
22-04-17 19:39:42 ERROR (MainThread) [supervisor.homeassistant.api] Error on call http://172.30.32.1:8123/api/config: 
22-04-17 19:40:18 ERROR (MainThread) [supervisor.homeassistant.api] Error on call http://172.30.32.1:8123/api/config: 
22-04-17 19:40:54 ERROR (MainThread) [supervisor.homeassistant.api] Error on call http://172.30.32.1:8123/api/config: 
22-04-17 19:41:30 ERROR (MainThread) [supervisor.homeassistant.api] Error on call http://172.30.32.1:8123/api/config: 
22-04-17 19:42:06 ERROR (MainThread) [supervisor.homeassistant.api] Error on call http://172.30.32.1:8123/api/config: 
22-04-17 19:42:11 ERROR (MainThread) [supervisor.homeassistant.api] Error on call http://172.30.32.1:8123/api/config: [Errno 104] Connection reset by peer
22-04-17 19:42:12 INFO (MainThread) [supervisor.homeassistant.core] Wait until Home Assistant is ready
22-04-17 19:42:21 INFO (MainThread) [supervisor.resolution.evaluate] Starting system evaluation with state CoreState.RUNNING
22-04-17 19:42:21 INFO (MainThread) [supervisor.resolution.evaluate] System evaluation complete
22-04-17 19:42:21 INFO (MainThread) [supervisor.updater] Fetching update data from https://version.home-assistant.io/stable.json
22-04-17 19:42:21 INFO (MainThread) [supervisor.store.git] Update add-on https://github.com/home-assistant/addons repository
22-04-17 19:42:21 INFO (MainThread) [supervisor.store.git] Update add-on https://github.com/sabeechen/hassio-google-drive-backup repository
22-04-17 19:42:22 INFO (MainThread) [supervisor.store.git] Update add-on https://github.com/LukasGrebe/ha-addons/ repository
22-04-17 19:42:23 INFO (MainThread) [supervisor.store] Loading add-ons from store: 26 all - 0 new - 0 remove
22-04-17 19:42:23 INFO (MainThread) [supervisor.store] Loading add-ons from store: 26 all - 0 new - 0 remove
22-04-17 19:42:27 WARNING (MainThread) [supervisor.addons.options] Option 'foreground' does not exist in the schema for eBUSd (2ad9b828_ebusd)
22-04-17 19:42:41 INFO (MainThread) [supervisor.api.proxy] Home Assistant WebSocket API request initialize
22-04-17 19:42:41 INFO (MainThread) [supervisor.api.proxy] WebSocket access from a0d7b954_nodered
22-04-17 19:42:41 INFO (MainThread) [supervisor.homeassistant.core] Detect a running Home Assistant instance
22-04-17 19:42:42 INFO (MainThread) [supervisor.api.proxy] Home Assistant WebSocket API request running
22-04-17 19:43:29 INFO (MainThread) [supervisor.api.proxy] Home Assistant WebSocket API error: Received message 257:None is not str
22-04-17 19:43:29 INFO (MainThread) [supervisor.api.proxy] Home Assistant WebSocket API connection is closed
22-04-17 19:44:05 ERROR (MainThread) [supervisor.homeassistant.api] Error on call http://172.30.32.1:8123/api/config: 
22-04-17 19:44:25 INFO (MainThread) [supervisor.api.middleware.security] /network/info access from a0d7b954_ssh
22-04-17 19:44:25 INFO (MainThread) [supervisor.api.middleware.security] /network/info access from a0d7b954_ssh
22-04-17 19:44:25 INFO (MainThread) [supervisor.api.middleware.security] /host/info access from a0d7b954_ssh
22-04-17 19:44:25 INFO (MainThread) [supervisor.api.middleware.security] /core/info access from a0d7b954_ssh
22-04-17 19:44:34 INFO (MainThread) [supervisor.api.middleware.security] /host/logs access from a0d7b954_ssh
22-04-17 19:44:41 ERROR (MainThread) [supervisor.homeassistant.api] Error on call http://172.30.32.1:8123/api/config: 
22-04-17 19:44:44 ERROR (MainThread) [supervisor.homeassistant.api] Error on call http://172.30.32.1:8123/api/config: 
22-04-17 19:45:12 ERROR (MainThread) [supervisor.homeassistant.api] Error on call http://172.30.32.1:8123/api/config: 
22-04-17 19:45:12 WARNING (MainThread) [supervisor.misc.tasks] Watchdog miss API response from Home Assistant
22-04-17 19:45:17 ERROR (MainThread) [supervisor.homeassistant.api] Error on call http://172.30.32.1:8123/api/config: 
22-04-17 19:45:53 ERROR (MainThread) [supervisor.homeassistant.api] Error on call http://172.30.32.1:8123/api/config: 
22-04-17 19:46:29 ERROR (MainThread) [supervisor.homeassistant.api] Error on call http://172.30.32.1:8123/api/config: 
22-04-17 19:47:05 ERROR (MainThread) [supervisor.homeassistant.api] Error on call http://172.30.32.1:8123/api/config: 
22-04-17 19:47:41 ERROR (MainThread) [supervisor.homeassistant.api] Error on call http://172.30.32.1:8123/api/config: 
22-04-17 19:47:43 ERROR (MainThread) [supervisor.homeassistant.api] Error on call http://172.30.32.1:8123/api/config: 
22-04-17 19:47:43 ERROR (MainThread) [supervisor.misc.tasks] Watchdog found a problem with Home Assistant API!
22-04-17 19:47:43 INFO (SyncWorker_1) [supervisor.docker.interface] Restarting ghcr.io/home-assistant/raspberrypi4-64-homeassistant
22-04-17 19:48:10 INFO (MainThread) [supervisor.api.middleware.security] /supervisor/logs access from a0d7b954_ssh
8

Last week after the reinstall, observer showed all green, now this is the result:

image
image1328×484 31.8 KB

9

I didn’t see it as part of your troubleshooting, but have you tried a different install drive?

I had issues with a PiHole which worked fine right up until it didn’t.

It would load so far run for a bit then stop.
I suspected a corrupt/failed drive, replaced it with a new boot one and it’s been 100% since.

10

It’s an M2 SSD which is few months old. Shouldn’t I see drive errors somewhere if there is something wrong with the drive?

11

As it’s happening on the same day, its as though there’s a scheduled background process that’s either corrupting something or maybe causing the Pi to struggle with excessive consumption or lack of power or overheating the unit.

You’ve already removed corruption in the software by reinstalling (assuming there wasn’t anything in your backup causing issues).
Next step would be to start small/cheap and work your way up

If possible, format the SSD and run some diagnostics on it to make sure it’s healthy.
For hardware, try a different power supply/cable, drive, an alternate Pi (if you have one).

It would also worth trying a vanilla install of HA with a couple basic automations running to see if it’s stable over a couple weeks which would validate if your current setup is a root cause

Sorry, that’s probably not ideal, but hopefully might give some ideas and hopefully you get it back to 100% again soon.

12

Seems something is causing it to end up in the state “unhealthy” ,…, start by disabling “google-drive” backup, and some other “potential” customizations loaded by configuration.yaml , such as things you see in HOST/Supervisor log , which seems to struggling with the network

when you are at it, change Logger: from info to Debug

I’ts more like some configurations, than a “harddisk” failure … so start with disabling your backup ( hardly no need for it currently anyway :slight_smile:
PS: and if you haven’t followed up on latest upgrades for awhile, you should even try to “commend out” what ever you can in configuration.yaml , as a-lot lately has become a part of core, or intergration/YAML, and therefore should be removed from configuration.yaml … and im pretty sure that what i see is not the full startup-log, you would see that under /Configuration/Settings/Logs

EDIT i assume that above ip is allowed in your network settings, thou SSL and/ or (i.e D-DuckDns) and anyone of your Custom-Add-Ons could be part of the “unhealthy” state, i.e eBUS doesn’t seems like a “stable” to run

13

I tried stopping the addons, but I figured out that HA is restarting automatically every few minutes, and thus the addons are started again.
@boheme61 Do you know a way to disable autostart from addons through the CLI? If I read the docs correctly, I can only stop them.

I installed all updates within a week after they came available and I didn’t install something new (weeks) before this started happening.

14

In Regards to the Add-Ons you can stop them in Configuration/Add-Ons, there you can also … prevent auto-start(during system boot) of the add-ons, in Cli you can do a-lot with addons, thou seems like disable autostart is not 1 of them , type " ad -h "

Why HA is restarting i don’t know, but you can also type "resolution healthcheck " not that i think it would say much.

PS: in CLI you can type -h after each command ( i.e " su op -h "

But again, check your configuration.yaml, and commend-out things there that might be related to the errors/integrations

Some of the errors you show here, are mentioned in several Topics in the Forum, thou i don’t know whether those will “apply” to your situation

EDIT: And i would also change Logger ( in configuration.yaml ) from Info > Debug , so you getmore info in regards to why it’s restarting, and also whether some integration/configuration causes the instability

… and the minute you get access to UI, go to /Add-ons, and disable Auto-Start on boot ( on each Add-ons That causes erros MQTT,eBUS etc., and check your configuration.yaml, change to Debug, and commend-out references to same integrations and other custome-parts that not required for a “startup” and reboot system again
i.e " commend-out automations in configuration.yaml is also worth a try, if you know you have a lot automation-scripts

PS: Also as you have some “problems” in HOST log i would make sure that i not just “restart” HA but Reboot Host every time, whether the errors in HOST.log is due to network or corrupt-file issues i don’t know … your HOST-log is very different from mine, as i run Homeassistant OS, in VMware-image

15

Hm options does seem to be missing from the cli for addons. It think it’s because POST /addons/{slug}/options also accepts the options provided by the addon on the configuration tab in addition to the check boxes on the first tab. Would be impossible to enumerate out all possible inputs like the other options ones in the cli.

However you can still do it from the command line, just a bit more difficult. There is a rest API, as I noted the one you want is POST /addons/{slug}/options. You can hit that using curl. I think if you just post this as the body you should be good {"boot":"manual"}. I am a little worried that will wipe out your addons configuration though. You can either provide that too or just use the cli to get info for each addon and save that to a file. So you can come back and recover it later when things are working.

Last bit is you will need authentication to hit this API with curl. Since you are somewhere with access to the cli the supervisor access token should be in an environmental variable called SUPERVISOR_TOKEN.

So in the end your curl call should look something like this:

curl -X POST \
  -H "Authorization: Bearer $(printenv SUPERVISOR_TOKEN)" \
  -H "Content-Type: application/json" \
  -d '{"boot":"manual"}' \
  http://supervisor/addons/core_mariadb/options

I did just type all that out on my phone so if there’s a typo I’m sorry. But hopefully it’s close enough you can take it from there.

16

I’ve managed to disable all add-ons. It didn’t change a thing.
Which logs should I be looking at? core? supervisor? host?

17

Configuration/settings/logs , and did you enabled Debug ? and restart
how does your configuration.yaml looks like ?
which errors do you see now ?

EDIT: i don’t mean restart, but host-Reboot

18

I managed to find the cause…

2022-04-19 08:45:38 WARNING (MainThread) [homeassistant.helpers.frame] Detected integration that accesses the database without the database executor; Use homeassistant.components.recorder.get_instance(hass).async_add_executor_job() for faster database operations. Please report issue to the custom component author for irrigation_unlimited using this method at custom_components/irrigation_unlimited/history.py, line 142: data = history.get_significant_states(

HA freezes after this line in the log. If you want long enough, HA restarts automatically.
If I disable this integration (GitHub - rgc99/irrigation_unlimited: ♒Irrigation controller for Home Assistant), HA functions normally.

Question remains: what’s wrong here. And why did it cause issues out of the blue?

19

Great to hear you finally found the root-cause ,

I wouldn’t say “out of the Blue” , beside it’s a very “complex” custom integration, that would lead to problems if your not totally aware of what it’s depended upon, other thing is … You never said when you installed 2022.4, or whether you’ve done some other changes(or updates) in your HA

20

Before the first incident I didn’t perform updates (nor to HA, nor to addons). After I got HA up again I’ve upgraded to 2022.4.

I’ve used that integration without any issues for over a year => that’s the context for “out of the blue” :slight_smile: