Lost access to Home assistant CLI : OCI runtime exec failed

Montreal666 · March 21, 2024, 2:22am

Running latest HAOS on a Virtualbox VM / Windows 11

Home assistant and frontend works as usual but since a few days I have lost access to the CLI:

at the end of the typical startup log, the “OCI runtime exec failed…” message blinks a few times, I never get the typical CLI welcome screen/logo and end up with a blank screen.

I then use CTL-ALT-F2 to login manually with the result above

Any clue what could be wrong and how to regain access ?
Or some guidance on how to troubleshoot this.

Thank you!

Montreal666 · March 23, 2024, 12:19pm

Anyone?

Or let me know what further details I should provide.

How can I extract the OS startup log?

Thank you!

francisp · March 23, 2024, 12:29pm

Try

docker pull ghcr.io/home-assistant/amd64-hassio-cli:2024.03.1

boheme61 · March 23, 2024, 12:29pm

Im not sure why you can’t "retrieve this in the GUI ?

If you have i.e SSH access this is another alternative

Montreal666 · March 23, 2024, 8:16pm

thanks for chiming in, here’s the result:

Montreal666 · March 23, 2024, 10:06pm

here’s what the CLI loop looks like:

https://www.dropbox.com/scl/fi/zj8h2xsklqczmnku9hpgr/Recording-2024-03-23-175945.mp4?rlkey=6mlvgcu39xokzttqmrx171psf&dl=0

Montreal666 · March 23, 2024, 10:29pm

and a glimpse of the initial OS log, prior to the above loop.

https://www.dropbox.com/scl/fi/1lsz3noifwas1i2j77o9i/Recording-2024-03-23-182727.mp4?rlkey=gzf2o2o425g35fp3q8owxr0nn&dl=0

Montreal666 · March 23, 2024, 10:42pm

I meant the text log from the OS startup (above video);
maybe there is something in there to pinpoint the issue?

boheme61 · March 23, 2024, 10:46pm

In /Settings/System/Logs, you click the top-right Header/Down-Arrow , and pick whichever logfile you have there !

Host is equal to OS, however not exactly like you see in the Cli, i know !

PS: Above the Logs, there is “Repairs” you could check there, if you have luck there is something there

Montreal666 · March 23, 2024, 11:00pm

thanks. yes definitely something wrong in there… but would need expert eyes on the root cause.

Mar 23 22:54:58 homeassistant systemd[1]: [email protected]: Consumed 1.321s CPU time.
Mar 23 22:54:58 homeassistant systemd[1]: [email protected]: Scheduled restart job, restart counter is at 327.
Mar 23 22:54:58 homeassistant systemd[1]: Stopped Home Assistant CLI.
Mar 23 22:54:58 homeassistant systemd[1]: [email protected]: Consumed 1.321s CPU time.
Mar 23 22:54:58 homeassistant systemd[1]: Started Home Assistant CLI.
Mar 23 22:54:59 homeassistant systemd[1]: run-docker-runtime\x2drunc-moby-f846d1a04f0bba3c2f9e5fdd8a44161b5621cfd6eb2f5929a7d3ca776735de95-runc.NmsVkT.mount: Deactivated successfully.
Mar 23 22:55:00 homeassistant dockerd[493]: time="2024-03-23T22:55:00.558044459Z" level=error msg="stream copy error: reading from a closed fifo"
Mar 23 22:55:00 homeassistant dockerd[493]: time="2024-03-23T22:55:00.993029364Z" level=error msg="Error running exec c99ad1d0f40b176bf83dcecb28defbb1edcde3954bbd4478fc7e9ff6a8d93a02 in container: OCI runtime exec failed: exec failed: unable to start container process: exec /usr/bin/cli.sh: exec format error: unknown"
Mar 23 22:55:01 homeassistant dockerd[493]: time="2024-03-23T22:55:01.025239219Z" level=error msg="failed to close container stdin" container=f846d1a04f0bba3c2f9e5fdd8a44161b5621cfd6eb2f5929a7d3ca776735de95 error="process does not exist c99ad1d0f40b176bf83dcecb28defbb1edcde3954bbd4478fc7e9ff6a8d93a02: not found" module=libcontainerd namespace=moby
Mar 23 22:55:01 homeassistant systemd[1]: [email protected]: Deactivated successfully.
Mar 23 22:55:01 homeassistant systemd[1]: [email protected]: Consumed 1.161s CPU time.
Mar 23 22:55:01 homeassistant systemd[1]: [email protected]: Scheduled restart job, restart counter is at 328.
Mar 23 22:55:01 homeassistant systemd[1]: Stopped Home Assistant CLI.
Mar 23 22:55:01 homeassistant systemd[1]: [email protected]: Consumed 1.161s CPU time.
Mar 23 22:55:02 homeassistant systemd[1]: Started Home Assistant CLI.
Mar 23 22:55:07 homeassistant dockerd[493]: time="2024-03-23T22:55:07.078973665Z" level=error msg="stream copy error: reading from a closed fifo"
Mar 23 22:55:07 homeassistant systemd[1]: run-docker-runtime\x2drunc-moby-4867f2b1de43c6bc1d492b88c70ad370426084eca2f414a17a0038324a14e1ef-runc.NT6Uwn.mount: Deactivated successfully.
Mar 23 22:55:07 homeassistant dockerd[493]: time="2024-03-23T22:55:07.529607446Z" level=error msg="Error running exec 88966e767a19778e1b4b08d23caaca0702e8eb148996e7b7302fcf91c3334987 in container: OCI runtime exec failed: exec failed: unable to start container process: exec /usr/bin/cli.sh: exec format error: unknown"
Mar 23 22:55:07 homeassistant dockerd[493]: time="2024-03-23T22:55:07.589283994Z" level=error msg="failed to close container stdin" container=f846d1a04f0bba3c2f9e5fdd8a44161b5621cfd6eb2f5929a7d3ca776735de95 error="process does not exist 88966e767a19778e1b4b08d23caaca0702e8eb148996e7b7302fcf91c3334987: not found" module=libcontainerd namespace=moby
Mar 23 22:55:08 homeassistant systemd[1]: [email protected]: Deactivated successfully.
Mar 23 22:55:08 homeassistant systemd[1]: [email protected]: Consumed 2.446s CPU time.
Mar 23 22:55:08 homeassistant systemd[1]: [email protected]: Scheduled restart job, restart counter is at 329.
Mar 23 22:55:08 homeassistant systemd[1]: Stopped Home Assistant CLI.
Mar 23 22:55:08 homeassistant systemd[1]: [email protected]: Consumed 2.446s CPU time.
Mar 23 22:55:08 homeassistant systemd[1]: Started Home Assistant CLI.
Mar 23 22:55:12 homeassistant dockerd[493]: time="2024-03-23T22:55:12.198359470Z" level=error msg="stream copy error: reading from a closed fifo"
Mar 23 22:55:12 homeassistant dockerd[493]: time="2024-03-23T22:55:12.321461559Z" level=error msg="Error running exec c864f6adc8cc7f5e980dfeb964bfa922dfc9a6a732fe355e8f2353d2011e518b in container: OCI runtime exec failed: exec failed: unable to start container process: exec /usr/bin/cli.sh: exec format error: unknown"
Mar 23 22:55:12 homeassistant dockerd[493]: time="2024-03-23T22:55:12.366059718Z" level=error msg="failed to close container stdin" container=f846d1a04f0bba3c2f9e5fdd8a44161b5621cfd6eb2f5929a7d3ca776735de95 error="process does not exist c864f6adc8cc7f5e980dfeb964bfa922dfc9a6a732fe355e8f2353d2011e518b: not found" module=libcontainerd namespace=moby
Mar 23 22:55:12 homeassistant systemd[1]: [email protected]: Deactivated successfully.
Mar 23 22:55:12 homeassistant systemd[1]: [email protected]: Consumed 1.647s CPU time.
Mar 23 22:55:12 homeassistant systemd[1]: [email protected]: Scheduled restart job, restart counter is at 330.
Mar 23 22:55:12 homeassistant systemd[1]: Stopped Home Assistant CLI.
Mar 23 22:55:12 homeassistant systemd[1]: [email protected]: Consumed 1.647s CPU time.
Mar 23 22:55:13 homeassistant systemd[1]: Started Home Assistant CLI.
Mar 23 22:55:17 homeassistant dockerd[493]: time="2024-03-23T22:55:17.619967527Z" level=error msg="stream copy error: reading from a closed fifo"
Mar 23 22:55:17 homeassistant dockerd[493]: time="2024-03-23T22:55:17.858034365Z" level=error msg="Error running exec 5623db6b7ac2a8ed37ebba240995199f9c56e179a181cee4d4115d1bc007a502 in container: OCI runtime exec failed: exec failed: unable to start container process: exec /usr/bin/cli.sh: exec format error: unknown"
Mar 23 22:55:18 homeassistant dockerd[493]: time="2024-03-23T22:55:18.058872048Z" level=error msg="failed to close container stdin" container=f846d1a04f0bba3c2f9e5fdd8a44161b5621cfd6eb2f5929a7d3ca776735de95 error="process does not exist 5623db6b7ac2a8ed37ebba240995199f9c56e179a181cee4d4115d1bc007a502: not found" module=libcontainerd namespace=moby
Mar 23 22:55:18 homeassistant systemd[1]: [email protected]: Deactivated successfully.
Mar 23 22:55:18 homeassistant systemd[1]: [email protected]: Consumed 4.489s CPU time.
Mar 23 22:55:18 homeassistant systemd[1]: [email protected]: Scheduled restart job, restart counter is at 331.
Mar 23 22:55:18 homeassistant systemd[1]: Stopped Home Assistant CLI.
Mar 23 22:55:18 homeassistant systemd[1]: [email protected]: Consumed 4.489s CPU time.
Mar 23 22:55:18 homeassistant systemd[1]: Started Home Assistant CLI.
Mar 23 22:55:21 homeassistant dockerd[493]: time="2024-03-23T22:55:21.046469140Z" level=error msg="stream copy error: reading from a closed fifo"
Mar 23 22:55:21 homeassistant dockerd[493]: time="2024-03-23T22:55:21.209565483Z" level=error msg="Error running exec a7479ab5a60dbcb7b841e09c0ddc37e461e56178d6e6d04488e39ead3c7c53a2 in container: OCI runtime exec failed: exec failed: unable to start container process: exec /usr/bin/cli.sh: exec format error: unknown"
Mar 23 22:55:21 homeassistant dockerd[493]: time="2024-03-23T22:55:21.238033712Z" level=error msg="failed to close container stdin" container=f846d1a04f0bba3c2f9e5fdd8a44161b5621cfd6eb2f5929a7d3ca776735de95 error="process does not exist a7479ab5a60dbcb7b841e09c0ddc37e461e56178d6e6d04488e39ead3c7c53a2: not found" module=libcontainerd namespace=moby
Mar 23 22:55:21 homeassistant systemd[1]: [email protected]: Deactivated successfully.
Mar 23 22:55:21 homeassistant systemd[1]: [email protected]: Consumed 1.850s CPU time.
Mar 23 22:55:21 homeassistant systemd[1]: [email protected]: Scheduled restart job, restart counter is at 332.
Mar 23 22:55:21 homeassistant systemd[1]: Stopped Home Assistant CLI.
Mar 23 22:55:21 homeassistant systemd[1]: [email protected]: Consumed 1.850s CPU time.
Mar 23 22:55:21 homeassistant systemd[1]: Started Home Assistant CLI.
Mar 23 22:55:24 homeassistant dockerd[493]: time="2024-03-23T22:55:24.075396482Z" level=error msg="stream copy error: reading from a closed fifo"
Mar 23 22:55:24 homeassistant dockerd[493]: time="2024-03-23T22:55:24.355175455Z" level=error msg="Error running exec 9329e0f5b15c933f021ad7e4a52eda035622fbcd10ef3ae1a0dc7e8c27049ea0 in container: OCI runtime exec failed: exec failed: unable to start container process: exec /usr/bin/cli.sh: exec format error: unknown"
Mar 23 22:55:24 homeassistant dockerd[493]: time="2024-03-23T22:55:24.428763490Z" level=error msg="failed to close container stdin" container=f846d1a04f0bba3c2f9e5fdd8a44161b5621cfd6eb2f5929a7d3ca776735de95 error="process does not exist 9329e0f5b15c933f021ad7e4a52eda035622fbcd10ef3ae1a0dc7e8c27049ea0: not found" module=libcontainerd namespace=moby
Mar 23 22:55:24 homeassistant systemd[1]: [email protected]: Deactivated successfully.
Mar 23 22:55:24 homeassistant systemd[1]: [email protected]: Consumed 1.693s CPU time.
Mar 23 22:55:24 homeassistant systemd[1]: [email protected]: Scheduled restart job, restart counter is at 333.
Mar 23 22:55:24 homeassistant systemd[1]: Stopped Home Assistant CLI.
Mar 23 22:55:24 homeassistant systemd[1]: [email protected]: Consumed 1.693s CPU time.
Mar 23 22:55:24 homeassistant systemd[1]: Started Home Assistant CLI.
Mar 23 22:55:27 homeassistant dockerd[493]: time="2024-03-23T22:55:27.248787294Z" level=error msg="stream copy error: reading from a closed fifo"
Mar 23 22:55:27 homeassistant dockerd[493]: time="2024-03-23T22:55:27.428300983Z" level=error msg="Error running exec a472def4e4a3ac03687e3eff8182ba23688aed3d03fa7ab013f4d6cb9682d5bf in container: OCI runtime exec failed: exec failed: unable to start container process: exec /usr/bin/cli.sh: exec format error: unknown"
Mar 23 22:55:27 homeassistant dockerd[493]: time="2024-03-23T22:55:27.488178831Z" level=error msg="failed to close container stdin" container=f846d1a04f0bba3c2f9e5fdd8a44161b5621cfd6eb2f5929a7d3ca776735de95 error="process does not exist a472def4e4a3ac03687e3eff8182ba23688aed3d03fa7ab013f4d6cb9682d5bf: not found" module=libcontainerd namespace=moby
Mar 23 22:55:27 homeassistant systemd[1]: [email protected]: Deactivated successfully.
Mar 23 22:55:27 homeassistant systemd[1]: [email protected]: Consumed 1.394s CPU time.
Mar 23 22:55:27 homeassistant systemd[1]: [email protected]: Scheduled restart job, restart counter is at 334.
Mar 23 22:55:27 homeassistant systemd[1]: Stopped Home Assistant CLI.
Mar 23 22:55:27 homeassistant systemd[1]: [email protected]: Consumed 1.394s CPU time.
Mar 23 22:55:27 homeassistant systemd[1]: Started Home Assistant CLI.
Mar 23 22:55:28 homeassistant dockerd[493]: time="2024-03-23T22:55:28.687684736Z" level=error msg="stream copy error: reading from a closed fifo"
Mar 23 22:55:28 homeassistant dockerd[493]: time="2024-03-23T22:55:28.929427831Z" level=error msg="Error running exec 3c8209653f9299591cd80f7311c47a6aaaa29b3db1c21dda2bfbb77f161b847d in container: OCI runtime exec failed: exec failed: unable to start container process: exec /usr/bin/cli.sh: exec format error: unknown"
Mar 23 22:55:29 homeassistant dockerd[493]: time="2024-03-23T22:55:29.027198287Z" level=error msg="failed to close container stdin" container=f846d1a04f0bba3c2f9e5fdd8a44161b5621cfd6eb2f5929a7d3ca776735de95 error="process does not exist 3c8209653f9299591cd80f7311c47a6aaaa29b3db1c21dda2bfbb77f161b847d: not found" module=libcontainerd namespace=moby
Mar 23 22:55:29 homeassistant systemd[1]: [email protected]: Deactivated successfully.
Mar 23 22:55:29 homeassistant systemd[1]: [email protected]: Scheduled restart job, restart counter is at 335.
Mar 23 22:55:29 homeassistant systemd[1]: Stopped Home Assistant CLI.
Mar 23 22:55:29 homeassistant systemd[1]: Started Home Assistant CLI.
Mar 23 22:55:29 homeassistant dockerd[493]: time="2024-03-23T22:55:29.816804536Z" level=error msg="stream copy error: reading from a closed fifo"
Mar 23 22:55:29 homeassistant dockerd[493]: time="2024-03-23T22:55:29.870406647Z" level=error msg="Error running exec a096be40d1ca563270ced5e40fb443152d8258c31c5b01d23e4ae4d5e7e0766a in container: OCI runtime exec failed: exec failed: unable to start container process: exec /usr/bin/cli.sh: exec format error: unknown"
Mar 23 22:55:29 homeassistant dockerd[493]: time="2024-03-23T22:55:29.907978286Z" level=error msg="failed to close container stdin" container=f846d1a04f0bba3c2f9e5fdd8a44161b5621cfd6eb2f5929a7d3ca776735de95 error="process does not exist a096be40d1ca563270ced5e40fb443152d8258c31c5b01d23e4ae4d5e7e0766a: not found" module=libcontainerd namespace=moby
Mar 23 22:55:29 homeassistant systemd[1]: [email protected]: Deactivated successfully.
Mar 23 22:55:29 homeassistant systemd[1]: [email protected]: Scheduled restart job, restart counter is at 336.
Mar 23 22:55:29 homeassistant systemd[1]: Stopped Home Assistant CLI.
Mar 23 22:55:29 homeassistant systemd[1]: Started Home Assistant CLI.
Mar 23 22:55:31 homeassistant dockerd[493]: time="2024-03-23T22:55:31.164295335Z" level=error msg="stream copy error: reading from a closed fifo"
Mar 23 22:55:31 homeassistant dockerd[493]: time="2024-03-23T22:55:31.169364606Z" level=error msg="Error running exec a2ed247c093c99472a7668c2ca037537debc4138d5e0169be3caca97a152aab3 in container: OCI runtime exec failed: exec failed: unable to start container process: exec /usr/bin/cli.sh: exec format error: unknown"
Mar 23 22:55:31 homeassistant dockerd[493]: time="2024-03-23T22:55:31.197763056Z" level=error msg="failed to close container stdin" container=f846d1a04f0bba3c2f9e5fdd8a44161b5621cfd6eb2f5929a7d3ca776735de95 error="process does not exist a2ed247c093c99472a7668c2ca037537debc4138d5e0169be3caca97a152aab3: not found" module=libcontainerd namespace=moby
Mar 23 22:55:31 homeassistant systemd[1]: [email protected]: Deactivated successfully.
Mar 23 22:55:31 homeassistant systemd[1]: [email protected]: Scheduled restart job, restart counter is at 337.
Mar 23 22:55:31 homeassistant systemd[1]: Stopped Home Assistant CLI.
Mar 23 22:55:31 homeassistant systemd[1]: [email protected]: Start request repeated too quickly.
Mar 23 22:55:31 homeassistant systemd[1]: [email protected]: Failed with result 'start-limit-hit'.
Mar 23 22:55:31 homeassistant systemd[1]: Failed to start Home Assistant CLI.
Mar 23 22:56:10 homeassistant systemd[1]: run-docker-runtime\x2drunc-moby-4867f2b1de43c6bc1d492b88c70ad370426084eca2f414a17a0038324a14e1ef-runc.qbv7np.mount: Deactivated successfully.
Mar 23 22:56:16 homeassistant systemd[1]: run-docker-runtime\x2drunc-moby-4e524cfe97213543eda452daed7e6cf4c468e2ef3118ec797daf6cd3a99e394a-runc.UyoKao.mount: Deactivated successfully.
Mar 23 22:56:28 homeassistant kernel: audit: type=1334 audit(1711234588.920:624): prog-id=143 op=LOAD
Mar 23 22:56:28 homeassistant systemd-timesyncd[467]: Network configuration changed, trying to establish connection.
Mar 23 22:56:28 homeassistant systemd-timesyncd[467]: Contacted time server 162.159.200.123:123 (time.cloudflare.com).
Mar 23 22:56:29 homeassistant systemd[1]: Started Journal Gateway Service.
Mar 23 22:56:30 homeassistant systemd-journal-gatewayd[29387]: microhttpd: MHD_OPTION_EXTERNAL_LOGGER is not the first option specified for the daemon. Some messages may be printed by the standard MHD logger.
Mar 23 22:56:42 homeassistant systemd[1]: run-docker-runtime\x2drunc-moby-4867f2b1de43c6bc1d492b88c70ad370426084eca2f414a17a0038324a14e1ef-runc.ASvOqg.mount: Deactivated successfully.

boheme61 · March 23, 2024, 11:18pm

While you are in the sections of Settings, in the bottom you see which OS, Core and Supervisor you are running on

Do you have any idea what this " namespace=moby " is for Container ?

Montreal666 · March 23, 2024, 11:20pm

No, googled a bit but looks like a generic name.

Looks like an issue with some corrupt or missing add-on?
Any way to have visibility/manage containers? Portainer maybe?

boheme61 · March 23, 2024, 11:23pm

Do you have “VS Code” add-on ?

Montreal666 · March 23, 2024, 11:25pm

yes I do have it installed

boheme61 · March 23, 2024, 11:26pm

Try to disable it, or disable all add-ons

Also make sure you are on latest, Core

Montreal666 · March 23, 2024, 11:29pm

Montreal666 · March 23, 2024, 11:30pm

will try do disable VScode then all add-ons an re-enable one by one…

Montreal666 · March 24, 2024, 12:23am

even with all add-ons disabled, I still get the same behavior.

Some container not uninstalled properly or corrupt?
I probably need to have some sort of container cleanup done.
Open to recommendations…

Mar 24 00:19:51 homeassistant dockerd[482]: time="2024-03-24T00:19:51.217201797Z" level=error msg="failed to close container stdin" container=0866f461ee7f3096c7dd6d2819bb215da7988a1aea715d90860dd3181e193d05 error="process does not exist de46fce6f7f8572d27f72635572f8cd6e9ebfaf9e6e4f74969641480223cb17f: not found" module=libcontainerd namespace=moby
Mar 24 00:19:51 homeassistant systemd[1]: [email protected]: Deactivated successfully.
Mar 24 00:19:51 homeassistant systemd[1]: [email protected]: Scheduled restart job, restart counter is at 7.
Mar 24 00:19:51 homeassistant systemd[1]: Stopped Home Assistant CLI.
Mar 24 00:19:51 homeassistant systemd[1]: Started Home Assistant CLI.
Mar 24 00:19:56 homeassistant dockerd[482]: time="2024-03-24T00:19:56.651604992Z" level=error msg="stream copy error: reading from a closed fifo"
Mar 24 00:19:56 homeassistant dockerd[482]: time="2024-03-24T00:19:56.706551861Z" level=error msg="Error running exec ed2bdba14a6ddbeef2caf7641b572cb834b9816769a9862bfb93dc56b1312d3a in container: OCI runtime exec failed: exec failed: unable to start container process: exec /usr/bin/cli.sh: exec format error: unknown"
Mar 24 00:19:56 homeassistant dockerd[482]: time="2024-03-24T00:19:56.801919509Z" level=error msg="failed to close container stdin" container=0866f461ee7f3096c7dd6d2819bb215da7988a1aea715d90860dd3181e193d05 error="process does not exist ed2bdba14a6ddbeef2caf7641b572cb834b9816769a9862bfb93dc56b1312d3a: not found" module=libcontainerd namespace=moby
Mar 24 00:19:56 homeassistant systemd[1]: [email protected]: Deactivated successfully.
Mar 24 00:19:56 homeassistant systemd[1]: [email protected]: Scheduled restart job, restart counter is at 8.
Mar 24 00:19:56 homeassistant systemd[1]: Stopped Home Assistant CLI.
Mar 24 00:19:56 homeassistant systemd[1]: Started Home Assistant CLI.
Mar 24 00:20:02 homeassistant dockerd[482]: time="2024-03-24T00:20:02.895280892Z" level=error msg="stream copy error: reading from a closed fifo"
Mar 24 00:20:03 homeassistant dockerd[482]: time="2024-03-24T00:20:03.015679129Z" level=error msg="Error running exec 4d9e84bb921624f17f2f45e7f8fa4ee20ff8dbbb95173d2ff0703bf4f5e2a855 in container: OCI runtime exec failed: exec failed: unable to start container process: exec /usr/bin/cli.sh: exec format error: unknown"
Mar 24 00:20:03 homeassistant dockerd[482]: time="2024-03-24T00:20:03.074977081Z" level=error msg="failed to close container stdin" container=0866f461ee7f3096c7dd6d2819bb215da7988a1aea715d90860dd3181e193d05 error="process does not exist 4d9e84bb921624f17f2f45e7f8fa4ee20ff8dbbb95173d2ff0703bf4f5e2a855: not found" module=libcontainerd namespace=moby
Mar 24 00:20:03 homeassistant systemd[1]: [email protected]: Deactivated successfully.
Mar 24 00:20:03 homeassistant systemd[1]: [email protected]: Consumed 1.070s CPU time.
Mar 24 00:20:03 homeassistant systemd[1]: [email protected]: Scheduled restart job, restart counter is at 9.
Mar 24 00:20:03 homeassistant systemd[1]: Stopped Home Assistant CLI.
Mar 24 00:20:03 homeassistant systemd[1]: [email protected]: Consumed 1.070s CPU time.
Mar 24 00:20:03 homeassistant systemd[1]: Started Home Assistant CLI.
Mar 24 00:20:08 homeassistant dockerd[482]: time="2024-03-24T00:20:08.600109063Z" level=error msg="stream copy error: reading from a closed fifo"
Mar 24 00:20:08 homeassistant dockerd[482]: time="2024-03-24T00:20:08.656581841Z" level=error msg="Error running exec 83bdd9675c6583edc6787b5dc04640543355e57ddb73ef330f029635ecc47795 in container: OCI runtime exec failed: exec failed: unable to start container process: exec /usr/bin/cli.sh: exec format error: unknown"
Mar 24 00:20:08 homeassistant dockerd[482]: time="2024-03-24T00:20:08.675653555Z" level=error msg="failed to close container stdin" container=0866f461ee7f3096c7dd6d2819bb215da7988a1aea715d90860dd3181e193d05 error="process does not exist 83bdd9675c6583edc6787b5dc04640543355e57ddb73ef330f029635ecc47795: not found" module=libcontainerd namespace=moby
Mar 24 00:20:08 homeassistant systemd[1]: [email protected]: Deactivated successfully.
Mar 24 00:20:08 homeassistant systemd[1]: [email protected]: Scheduled restart job, restart counter is at 10.
Mar 24 00:20:08 homeassistant systemd[1]: Stopped Home Assistant CLI.
Mar 24 00:20:08 homeassistant systemd[1]: Started Home Assistant CLI.
Mar 24 00:20:10 homeassistant systemd[1]: systemd-hostnamed.service: Deactivated successfully.
Mar 24 00:20:12 homeassistant systemd[1]: systemd-timedated.service: Deactivated successfully.
Mar 24 00:20:13 homeassistant kernel: kauditd_printk_skb: 1 callbacks suppressed
Mar 24 00:20:13 homeassistant kernel: audit: type=1334 audit(1711239613.712:208): prog-id=54 op=UNLOAD
Mar 24 00:20:13 homeassistant kernel: audit: type=1334 audit(1711239613.712:209): prog-id=53 op=UNLOAD
Mar 24 00:20:13 homeassistant kernel: audit: type=1334 audit(1711239613.712:210): prog-id=52 op=UNLOAD
Mar 24 00:20:13 homeassistant kernel: audit: type=1334 audit(1711239613.932:211): prog-id=51 op=UNLOAD
Mar 24 00:20:13 homeassistant kernel: audit: type=1334 audit(1711239613.932:212): prog-id=50 op=UNLOAD
Mar 24 00:20:13 homeassistant kernel: audit: type=1334 audit(1711239613.932:213): prog-id=49 op=UNLOAD
Mar 24 00:20:13 homeassistant systemd[1]: dev-virtio\x2dports-org.qemu.guest_agent.0.device: Job dev-virtio\x2dports-org.qemu.guest_agent.0.device/start timed out.
Mar 24 00:20:13 homeassistant systemd[1]: Timed out waiting for device /dev/virtio-ports/org.qemu.guest_agent.0.
Mar 24 00:20:13 homeassistant systemd[1]: Dependency failed for QEMU Guest Agent.
Mar 24 00:20:13 homeassistant systemd[1]: qemu-guest.service: Job qemu-guest.service/start failed with result 'dependency'.
Mar 24 00:20:13 homeassistant systemd[1]: dev-virtio\x2dports-org.qemu.guest_agent.0.device: Job dev-virtio\x2dports-org.qemu.guest_agent.0.device/start failed with result 'timeout'.
Mar 24 00:20:13 homeassistant systemd[1]: Reached target Multi-User System.
Mar 24 00:20:14 homeassistant systemd[1]: Startup finished in 16.907s (kernel) + 1min 30.752s (userspace) = 1min 47.659s.
Mar 24 00:20:14 homeassistant dockerd[482]: time="2024-03-24T00:20:14.590872762Z" level=error msg="stream copy error: reading from a closed fifo"
Mar 24 00:20:14 homeassistant dockerd[482]: time="2024-03-24T00:20:14.680536798Z" level=error msg="Error running exec b8e34439eeeea4f34f8d673a80d8cd338f9083d4c8e1ed8322050ac4641ebd85 in container: OCI runtime exec failed: exec failed: unable to start container process: exec /usr/bin/cli.sh: exec format error: unknown"
Mar 24 00:20:14 homeassistant dockerd[482]: time="2024-03-24T00:20:14.724674518Z" level=error msg="failed to close container stdin" container=0866f461ee7f3096c7dd6d2819bb215da7988a1aea715d90860dd3181e193d05 error="process does not exist b8e34439eeeea4f34f8d673a80d8cd338f9083d4c8e1ed8322050ac4641ebd85: not found" module=libcontainerd namespace=moby
Mar 24 00:20:14 homeassistant systemd[1]: [email protected]: Deactivated successfully.
Mar 24 00:20:14 homeassistant systemd[1]: [email protected]: Scheduled restart job, restart counter is at 11.
Mar 24 00:20:14 homeassistant systemd[1]: Stopped Home Assistant CLI.
Mar 24 00:20:14 homeassistant systemd[1]: Started Home Assistant CLI.
Mar 24 00:20:15 homeassistant dockerd[482]: time="2024-03-24T00:20:15.735680637Z" level=error msg="stream copy error: reading from a closed fifo"
Mar 24 00:20:15 homeassistant dockerd[482]: time="2024-03-24T00:20:15.760390141Z" level=error msg="Error running exec da76278fd01d2d73604d55c445ad5f7f1c2010743d6057de4f9619dd00f9d056 in container: OCI runtime exec failed: exec failed: unable to start container process: exec /usr/bin/cli.sh: exec format error: unknown"
Mar 24 00:20:15 homeassistant dockerd[482]: time="2024-03-24T00:20:15.851718311Z" level=error msg="failed to close container stdin" container=0866f461ee7f3096c7dd6d2819bb215da7988a1aea715d90860dd3181e193d05 error="process does not exist da76278fd01d2d73604d55c445ad5f7f1c2010743d6057de4f9619dd00f9d056: not found" module=libcontainerd namespace=moby
Mar 24 00:20:15 homeassistant systemd[1]: [email protected]: Deactivated successfully.
Mar 24 00:20:15 homeassistant systemd[1]: [email protected]: Consumed 1.231s CPU time.
Mar 24 00:20:15 homeassistant systemd[1]: [email protected]: Scheduled restart job, restart counter is at 12.
Mar 24 00:20:15 homeassistant systemd[1]: Stopped Home Assistant CLI.
Mar 24 00:20:15 homeassistant systemd[1]: [email protected]: Consumed 1.231s CPU time.
Mar 24 00:20:15 homeassistant systemd[1]: Started Home Assistant CLI.
Mar 24 00:20:16 homeassistant dockerd[482]: time="2024-03-24T00:20:16.972071890Z" level=error msg="stream copy error: reading from a closed fifo"
Mar 24 00:20:17 homeassistant dockerd[482]: time="2024-03-24T00:20:17.063679976Z" level=error msg="Error running exec 3d9c9cae918fa73ce258670ff55579ee21c02b5a2c675a8c3e989756d2278735 in container: OCI runtime exec failed: exec failed: unable to start container process: exec /usr/bin/cli.sh: exec format error: unknown"
Mar 24 00:20:17 homeassistant dockerd[482]: time="2024-03-24T00:20:17.065348375Z" level=error msg="failed to close container stdin" container=0866f461ee7f3096c7dd6d2819bb215da7988a1aea715d90860dd3181e193d05 error="process does not exist 3d9c9cae918fa73ce258670ff55579ee21c02b5a2c675a8c3e989756d2278735: not found" module=libcontainerd namespace=moby
Mar 24 00:20:17 homeassistant systemd[1]: [email protected]: Deactivated successfully.
Mar 24 00:20:17 homeassistant systemd[1]: [email protected]: Scheduled restart job, restart counter is at 13.
Mar 24 00:20:17 homeassistant systemd[1]: Stopped Home Assistant CLI.
Mar 24 00:20:17 homeassistant systemd[1]: Started Home Assistant CLI.
Mar 24 00:20:17 homeassistant dockerd[482]: time="2024-03-24T00:20:17.427175023Z" level=error msg="stream copy error: reading from a closed fifo"
Mar 24 00:20:17 homeassistant dockerd[482]: time="2024-03-24T00:20:17.466665250Z" level=error msg="Error running exec 642da74930fd7f9956f5d777d2c058c048f6e673af8ba3461574822cb0849c28 in container: OCI runtime exec failed: exec failed: unable to start container process: exec /usr/bin/cli.sh: exec format error: unknown"
Mar 24 00:20:17 homeassistant dockerd[482]: time="2024-03-24T00:20:17.470972192Z" level=error msg="failed to close container stdin" container=0866f461ee7f3096c7dd6d2819bb215da7988a1aea715d90860dd3181e193d05 error="process does not exist 642da74930fd7f9956f5d777d2c058c048f6e673af8ba3461574822cb0849c28: not found" module=libcontainerd namespace=moby
Mar 24 00:20:17 homeassistant systemd[1]: [email protected]: Deactivated successfully.
Mar 24 00:20:17 homeassistant systemd[1]: [email protected]: Scheduled restart job, restart counter is at 14.
Mar 24 00:20:17 homeassistant systemd[1]: Stopped Home Assistant CLI.
Mar 24 00:20:17 homeassistant systemd[1]: Started Home Assistant CLI.
Mar 24 00:20:17 homeassistant dockerd[482]: time="2024-03-24T00:20:17.876569943Z" level=error msg="stream copy error: reading from a closed fifo"
Mar 24 00:20:17 homeassistant dockerd[482]: time="2024-03-24T00:20:17.896632101Z" level=error msg="Error running exec e3e5f89e1a32202090492e382f12afc77aa36e18bf5042a073c13ced58ad97fc in container: OCI runtime exec failed: exec failed: unable to start container process: exec /usr/bin/cli.sh: exec format error: unknown"
Mar 24 00:20:17 homeassistant dockerd[482]: time="2024-03-24T00:20:17.944616647Z" level=error msg="failed to close container stdin" container=0866f461ee7f3096c7dd6d2819bb215da7988a1aea715d90860dd3181e193d05 error="process does not exist e3e5f89e1a32202090492e382f12afc77aa36e18bf5042a073c13ced58ad97fc: not found" module=libcontainerd namespace=moby
Mar 24 00:20:17 homeassistant systemd[1]: [email protected]: Deactivated successfully.
Mar 24 00:20:17 homeassistant systemd[1]: [email protected]: Scheduled restart job, restart counter is at 15.
Mar 24 00:20:17 homeassistant systemd[1]: Stopped Home Assistant CLI.
Mar 24 00:20:17 homeassistant systemd[1]: [email protected]: Start request repeated too quickly.
Mar 24 00:20:17 homeassistant systemd[1]: [email protected]: Failed with result 'start-limit-hit'.
Mar 24 00:20:17 homeassistant systemd[1]: Failed to start Home Assistant CLI.
Mar 24 00:20:58 homeassistant systemd[1]: Starting Bluetooth service...
Mar 24 00:20:58 homeassistant bluetoothd[3788]: Bluetooth daemon 5.72
Mar 24 00:20:58 homeassistant systemd[1]: Started Bluetooth service.
Mar 24 00:20:58 homeassistant bluetoothd[3788]: Starting SDP server
Mar 24 00:20:58 homeassistant kernel: Bluetooth: BNEP (Ethernet Emulation) ver 1.3
Mar 24 00:20:58 homeassistant kernel: Bluetooth: BNEP filters: protocol multicast
Mar 24 00:20:58 homeassistant kernel: Bluetooth: BNEP socket layer initialized
Mar 24 00:20:58 homeassistant bluetoothd[3788]: Bluetooth management interface 1.22 initialized
Mar 24 00:20:58 homeassistant kernel: audit: type=1334 audit(1711239658.555:214): prog-id=55 op=LOAD
Mar 24 00:20:58 homeassistant kernel: audit: type=1334 audit(1711239658.565:215): prog-id=56 op=LOAD
Mar 24 00:20:58 homeassistant kernel: audit: type=1334 audit(1711239658.565:216): prog-id=57 op=LOAD
Mar 24 00:20:58 homeassistant systemd[1]: Starting Hostname Service...
Mar 24 00:20:58 homeassistant systemd[1]: Started Hostname Service.
Mar 24 00:21:03 homeassistant kernel: audit: type=1334 audit(1711239663.205:217): prog-id=58 op=LOAD
Mar 24 00:21:03 homeassistant systemd-timesyncd[470]: Network configuration changed, trying to establish connection.
Mar 24 00:21:03 homeassistant systemd-timesyncd[470]: Contacted time server 162.159.200.1:123 (time.cloudflare.com).
Mar 24 00:21:03 homeassistant systemd[1]: Started Journal Gateway Service.
Mar 24 00:21:03 homeassistant systemd-journal-gatewayd[3794]: microhttpd: MHD_OPTION_EXTERNAL_LOGGER is not the first option specified for the daemon. Some messages may be printed by the standard MHD logger.

boheme61 · March 24, 2024, 12:56am

hmmm weird , yeah seems not related to the Add-Ons, yes i was also started to thinking about something corrupt.

Unfortunately there are no specific backup-files for the OS upgrades( nor Supervisor ) … Not even a full-backup backups the OS etc, only what under /Homeassistant
I would try to Rollback to a previous Core, or a FullBackup ( Not that i think it would help in this case)
You can change default-Logger-level in config.yaml, but i don’t think that counts for the OS, but you could try to change default to DEBUG, and reboot, maybe it reveals more

Im Running VMWare in Windows10, so occasionally( when i anyway have to shutdown HA to reboot Windows ) i even copy the whole VM folder (which is on a separate disk, than Windows)

Montreal666 · April 12, 2024, 5:05pm

Solution: Installed a new VM + HAOS; restored backup. All good now. Thx