Update to core 2024.0.1 seems to have broken my instance

Installation
1

Hi all,

I updated core to 2024.10.1, which went fine. After rebooting my instance (which lives on a NUC, FWIW) homeassistant won’t load. Looking at the docker logs for supervisor, I see the following:

# docker ps
CONTAINER ID   IMAGE                                                    COMMAND               CREATED             STATUS              PORTS                                   NAMES
26546657c19c   ghcr.io/home-assistant/amd64-hassio-supervisor:latest    "/init"               About an hour ago   Up About a minute                                           hassio_supervisor
d3ab8e7db545   ghcr.io/home-assistant/amd64-hassio-observer:2023.06.0   "/usr/bin/observer"   7 weeks ago         Up 57 minutes       0.0.0.0:4357->80/tcp, :::4357->80/tcp   hassio_observer

2024-10-07 10:26:01.723 WARNING (MainThread) [supervisor.plugins.base] Error on installing cli plugin, retrying in 30sec
2024-10-07 10:26:31.727 INFO (MainThread) [supervisor.docker.interface] Downloading docker image ghcr.io/home-assistant/amd64-hassio-cli with tag 2024.09.0.
2024-10-07 10:26:32.152 ERROR (MainThread) [supervisor.docker.interface] Can't install ghcr.io/home-assistant/amd64-hassio-cli:2024.09.0: 500 Server Error for http+docker://localhost/v1.45/images/ghcr.io/home-assistant/amd64-hassio-cli:2024.09.0/json: Internal Server Error ("layer does not exist")
2024-10-07 10:26:32.153 WARNING (MainThread) [supervisor.plugins.base] Error on installing cli plugin, retrying in 30sec
2024-10-07 10:27:02.172 INFO (MainThread) [supervisor.docker.interface] Downloading docker image ghcr.io/home-assistant/amd64-hassio-cli with tag 2024.09.0.
2024-10-07 10:27:02.602 ERROR (MainThread) [supervisor.docker.interface] Can't install ghcr.io/home-assistant/amd64-hassio-cli:2024.09.0: 500 Server Error for http+docker://localhost/v1.45/images/ghcr.io/home-assistant/amd64-hassio-cli:2024.09.0/json: Internal Server Error ("layer does not exist")
2024-10-07 10:27:02.602 WARNING (MainThread) [supervisor.plugins.base] Error on installing cli plugin, retrying in 30sec
2024-10-07 10:27:32.605 INFO (MainThread) [supervisor.docker.interface] Downloading docker image ghcr.io/home-assistant/amd64-hassio-cli with tag 2024.09.0.
2024-10-07 10:27:32.979 ERROR (MainThread) [supervisor.docker.interface] Can't install ghcr.io/home-assistant/amd64-hassio-cli:2024.09.0: 500 Server Error for http+docker://localhost/v1.45/images/ghcr.io/home-assistant/amd64-hassio-cli:2024.09.0/json: Internal Server Error ("layer does not exist")
2024-10-07 10:27:32.980 WARNING (MainThread) [supervisor.plugins.base] Error on installing cli plugin, retrying in 30sec
2024-10-07 10:28:03.011 INFO (MainThread) [supervisor.docker.interface] Downloading docker image ghcr.io/home-assistant/amd64-hassio-cli with tag 2024.09.0.
2024-10-07 10:28:03.445 ERROR (MainThread) [supervisor.docker.interface] Can't install ghcr.io/home-assistant/amd64-hassio-cli:2024.09.0: 500 Server Error for http+docker://localhost/v1.45/images/ghcr.io/home-assistant/amd64-hassio-cli:2024.09.0/json: Internal Server Error ("layer does not exist")
2024-10-07 10:28:03.445 WARNING (MainThread) [supervisor.plugins.base] Error on installing cli plugin, retrying in 30sec
2024-10-07 10:28:33.476 INFO (MainThread) [supervisor.docker.interface] Downloading docker image ghcr.io/home-assistant/amd64-hassio-cli with tag 2024.09.0.
2024-10-07 10:28:33.849 ERROR (MainThread) [supervisor.docker.interface] Can't install ghcr.io/home-assistant/amd64-hassio-cli:2024.09.0: 500 Server Error for http+docker://localhost/v1.45/images/ghcr.io/home-assistant/amd64-hassio-cli:2024.09.0/json: Internal Server Error ("layer does not exist")
2024-10-07 10:28:33.849 WARNING (MainThread) [supervisor.plugins.base] Error on installing cli plugin, retrying in 30sec
2024-10-07 10:29:03.876 INFO (MainThread) [supervisor.docker.interface] Downloading docker image ghcr.io/home-assistant/amd64-hassio-cli with tag 2024.09.0.
2024-10-07 10:29:04.323 ERROR (MainThread) [supervisor.docker.interface] Can't install ghcr.io/home-assistant/amd64-hassio-cli:2024.09.0: 500 Server Error for http+docker://localhost/v1.45/images/ghcr.io/home-assistant/amd64-hassio-cli:2024.09.0/json: Internal Server Error ("layer does not exist")
2024-10-07 10:29:04.324 WARNING (MainThread) [supervisor.plugins.base] Error on installing cli plugin, retrying in 30sec
2024-10-07 10:29:34.330 INFO (MainThread) [supervisor.docker.interface] Downloading docker image ghcr.io/home-assistant/amd64-hassio-cli with tag 2024.09.0.
2024-10-07 10:29:34.734 ERROR (MainThread) [supervisor.docker.interface] Can't install ghcr.io/home-assistant/amd64-hassio-cli:2024.09.0: 500 Server Error for http+docker://localhost/v1.45/images/ghcr.io/home-assistant/amd64-hassio-cli:2024.09.0/json: Internal Server Error ("layer does not exist")
2024-10-07 10:29:34.734 WARNING (MainThread) [supervisor.plugins.base] Error on installing cli plugin, retrying in 30sec
2024-10-07 10:30:04.765 INFO (MainThread) [supervisor.docker.interface] Downloading docker image ghcr.io/home-assistant/amd64-hassio-cli with tag 2024.09.0.
2024-10-07 10:30:05.204 ERROR (MainThread) [supervisor.docker.interface] Can't install ghcr.io/home-assistant/amd64-hassio-cli:2024.09.0: 500 Server Error for http+docker://localhost/v1.45/images/ghcr.io/home-assistant/amd64-hassio-cli:2024.09.0/json: Internal Server Error ("layer does not exist")
2024-10-07 10:30:05.205 WARNING (MainThread) [supervisor.plugins.base] Error on installing cli plugin, retrying in 30sec
2024-10-07 10:30:35.236 INFO (MainThread) [supervisor.docker.interface] Downloading docker image ghcr.io/home-assistant/amd64-hassio-cli with tag 2024.09.0.
2024-10-07 10:30:35.660 ERROR (MainThread) [supervisor.docker.interface] Can't install ghcr.io/home-assistant/amd64-hassio-cli:2024.09.0: 500 Server Error for http+docker://localhost/v1.45/images/ghcr.io/home-assistant/amd64-hassio-cli:2024.09.0/json: Internal Server Error ("layer does not exist")
2024-10-07 10:30:35.661 WARNING (MainThread) [supervisor.plugins.base] Error on installing cli plugin, retrying in 30sec

I’ve tried removing the image using and pulling it down again:

docker rmi  ghcr.io/home-assistant/amd64-hassio-cli:2024.09.0

Error response from daemon: unrecognized image ID sha256:86d243c62d0cb220f7152372930813f0656c2579d565248d24e47ab0118a448f

docker pull  ghcr.io/home-assistant/amd64-hassio-cli:2024.09.0

2024.09.0: Pulling from home-assistant/amd64-hassio-cli
Digest: sha256:c631f9281be54bb49f10d065c23d3d31dcb14bc6537108ee8e2a003e62e86496
Status: Downloaded newer image for ghcr.io/home-assistant/amd64-hassio-cli:2024.09.0
ghcr.io/home-assistant/amd64-hassio-cli:2024.09.0

But to no avail. So the instance is dead in the water at this point :confused: . Has anyone else run into this? Any suggestions for a path forward?

2

For anyone else running into a similar issue, the solution was to blow away /mnt/data/docker per Help! Home Assistant cannot start after forced reboot: Audio layer cannot be installed? - #11 by agners. I’m not sure how the overlay bits got corrupted, but this solved it and everything appears to be up and running without issue now.