Supervised Install Leaves Addons In a Broken State, Until the Supervisor is Upgraded

Hi, I’ve been happily performing a Supervised install of HA on a Debian Bullseye machine for months; this is a VirtualBox VM I use for development, and I’ve always made sure I meet the Debian pre-requisites here: https://github.com/home-assistant/architecture/blob/6da4482d171f2ef04de9320d313526653b5818b4/adr/0014-home-assistant-supervised.md and follow the installation procedure described here: Installing Home Assistant Supervised on Debian 11

But for some reason, yesterday, it stopped working. Everything appears to have gone as normal. But when I logon to HA and go to the Addons page its just hangs (spinning blue circle of death).
If I examine /usr/share/hassio/addons then this is messed-up, there are only three directories, data, git, and local (core is missing), and the git directory which normally contains the repository.json files is empty.

So this is why addons aren’t working, but why is it in this state?

http://127.0.0.1:8123/config/repairs reports no problems. But if I look at: http://127.0.0.1:8123/config/updates this is odd, the installed version is given as: 2022.08.dev1905, with the available version as 2022.08.3, despite on my production machine (a Pi4) the latest available version is shown as 2022.08.06? If I manually upgrade to 2022.08.3 that seems to go ok, and fixes the addons problem.

But I’m just a bit surprised by what has happened, and whether there may be other issues with the installation I’ve not yet come across?

If I look at /var/log/syslog for what might have happened during the installation then the first error I can see is: /etc/systemd/system/hassio-apparmor.service:4: Failed to add dependency on %SERVICE_DOCKER%, ignoring: Invalid argument

This error has been reported before, supposedly as an apparmor problem, but on Debian bullseye it is installed and enabled by default and I even checked it was enabled before the install using aa-status, below is the aa-status post installation.

So does anyone know what I could / should do next? Thanks.

$ sudo aa-status
apparmor module is loaded.
11 profiles are loaded.
11 profiles are in enforce mode.
  /usr/bin/man
  /usr/sbin/chronyd
  docker-default
  hassio-supervisor
  hassio-supervisor///usr/bin/gdbus
  hassio-supervisor///usr/bin/git
  lsb_release
  man_filter
  man_groff
  nvidia_modprobe
  nvidia_modprobe//kmod
0 profiles are in complain mode.
43 processes have profiles defined.
43 processes are in enforce mode.
  /usr/sbin/chronyd (368)  
  /usr/sbin/chronyd (371)  
  /package/admin/s6-2.11.1.0/command/s6-svscan (27198) docker-default
  /package/admin/s6-2.11.1.0/command/s6-supervise (27253) docker-default
  /package/admin/s6-linux-init-1.0.7.3/command/s6-linux-init-shutdownd (27255) docker-default
  /package/admin/s6-2.11.1.0/command/s6-supervise (27260) docker-default
  /package/admin/s6-2.11.1.0/command/s6-supervise (27261) docker-default
  /package/admin/s6-2.11.1.0/command/s6-ipcserverd (27268) docker-default
  /bin/s6-svscan (27384) docker-default
  /bin/s6-supervise (27460) docker-default
  /bin/s6-supervise (27630) docker-default
  /usr/bin/coredns (27633) docker-default
  /package/admin/s6-2.11.1.0/command/s6-svscan (27750) docker-default
  /package/admin/s6-2.11.1.0/command/s6-supervise (27805) docker-default
  /package/admin/s6-linux-init-1.0.7.3/command/s6-linux-init-shutdownd (27807) docker-default
  /package/admin/s6-2.11.1.0/command/s6-supervise (27812) docker-default
  /package/admin/s6-2.11.1.0/command/s6-supervise (27813) docker-default
  /package/admin/s6-2.11.1.0/command/s6-ipcserverd (27820) docker-default
  /package/admin/s6-2.11.1.0/command/s6-supervise (28000) docker-default
  /package/admin/s6-2.11.1.0/command/s6-supervise (28001) docker-default
  /usr/bin/pulseaudio (28003) docker-default
  /usr/bin/bash (28004) docker-default
  /usr/bin/bash (28018) docker-default
  /usr/bin/udevadm (28020) docker-default
  /bin/s6-svscan (28124) docker-default
  /bin/s6-supervise (28198) docker-default
  /bin/s6-supervise (28340) docker-default
  /usr/bin/observer (28343) docker-default
  /bin/s6-svscan (28420) docker-default
  /bin/s6-supervise (28461) docker-default
  /bin/s6-supervise (28610) docker-default
  /usr/bin/mdns-repeater (28613) docker-default
  /package/admin/s6-2.11.1.0/command/s6-svscan (29449) hassio-supervisor
  /package/admin/s6-2.11.1.0/command/s6-supervise (29490) hassio-supervisor
  /package/admin/s6-linux-init-1.0.7.3/command/s6-linux-init-shutdownd (29493) hassio-supervisor
  /package/admin/s6-2.11.1.0/command/s6-supervise (29499) hassio-supervisor
  /package/admin/s6-2.11.1.0/command/s6-supervise (29500) hassio-supervisor
  /package/admin/s6-2.11.1.0/command/s6-ipcserverd (29507) hassio-supervisor
  /package/admin/s6-2.11.1.0/command/s6-supervise (29544) hassio-supervisor
  /package/admin/s6-2.11.1.0/command/s6-supervise (29545) hassio-supervisor
  /usr/bin/bash (29547) hassio-supervisor
  /usr/local/bin/python3.9 (29550) hassio-supervisor
  /bin/busybox (29943) hassio-supervisor
0 processes are in complain mode.
0 processes are unconfined but have a profile defined.

Relevant section of /var/log/syslog

Aug 20 05:37:38 bullseye systemd-resolved[25935]: Using system hostname 'vbox-ha'.
Aug 20 05:37:38 bullseye systemd[1]: Started Network Name Resolution.
Aug 20 05:37:38 bullseye systemd[1]: Reached target Host and Network Name Lookups.
Aug 20 05:37:38 bullseye dbus-daemon[255]: [system] Successfully activated service 'org.freedesktop.resolve1'
Aug 20 05:37:38 bullseye systemd[1]: Stopping Docker Application Container Engine...
Aug 20 05:37:38 bullseye dockerd[24669]: time="2022-08-20T05:37:38.359601719Z" level=info msg="Processing signal 'terminated'"
Aug 20 05:37:38 bullseye dockerd[24669]: time="2022-08-20T05:37:38.360431772Z" level=info msg="stopping event stream following graceful shutdown" error="<nil>" module=libcontainerd namespace=moby
Aug 20 05:37:38 bullseye dockerd[24669]: time="2022-08-20T05:37:38.360813283Z" level=info msg="Daemon shutdown complete"
Aug 20 05:37:38 bullseye systemd[1]: docker.service: Succeeded.
Aug 20 05:37:38 bullseye systemd[1]: Stopped Docker Application Container Engine.
Aug 20 05:37:38 bullseye systemd[1]: Starting Docker Application Container Engine...
Aug 20 05:37:38 bullseye dockerd[25969]: time="2022-08-20T05:37:38.426636421Z" level=info msg="Starting up"
Aug 20 05:37:38 bullseye dockerd[25969]: time="2022-08-20T05:37:38.428794490Z" level=info msg="parsed scheme: \"unix\"" module=grpc
Aug 20 05:37:38 bullseye dockerd[25969]: time="2022-08-20T05:37:38.428821411Z" level=info msg="scheme \"unix\" not registered, fallback to default scheme" module=grpc
Aug 20 05:37:38 bullseye dockerd[25969]: time="2022-08-20T05:37:38.428843476Z" level=info msg="ccResolverWrapper: sending update to cc: {[{unix:///run/containerd/containerd.sock  <nil> 0 <nil>}] <nil> <nil>}" m
odule=grpc
Aug 20 05:37:38 bullseye dockerd[25969]: time="2022-08-20T05:37:38.428877732Z" level=info msg="ClientConn switching balancer to \"pick_first\"" module=grpc
Aug 20 05:37:38 bullseye dockerd[25969]: time="2022-08-20T05:37:38.430593167Z" level=info msg="parsed scheme: \"unix\"" module=grpc
Aug 20 05:37:38 bullseye dockerd[25969]: time="2022-08-20T05:37:38.430620472Z" level=info msg="scheme \"unix\" not registered, fallback to default scheme" module=grpc
Aug 20 05:37:38 bullseye dockerd[25969]: time="2022-08-20T05:37:38.430638300Z" level=info msg="ccResolverWrapper: sending update to cc: {[{unix:///run/containerd/containerd.sock  <nil> 0 <nil>}] <nil> <nil>}" m
odule=grpc
Aug 20 05:37:38 bullseye dockerd[25969]: time="2022-08-20T05:37:38.430646637Z" level=info msg="ClientConn switching balancer to \"pick_first\"" module=grpc
Aug 20 05:37:38 bullseye systemd[1]: var-lib-docker-overlay2-check\x2doverlayfs\x2dsupport2061720158-merged.mount: Succeeded.
Aug 20 05:37:38 bullseye systemd[895]: var-lib-docker-overlay2-check\x2doverlayfs\x2dsupport2061720158-merged.mount: Succeeded.
Aug 20 05:37:38 bullseye dockerd[25969]: time="2022-08-20T05:37:38.448107766Z" level=info msg="Loading containers: start."
Aug 20 05:37:38 bullseye dockerd[25969]: time="2022-08-20T05:37:38.603011824Z" level=info msg="Default bridge (docker0) is assigned with an IP address 172.17.0.0/16. Daemon option --bip can be used to set a pre
ferred IP address"
Aug 20 05:37:38 bullseye dockerd[25969]: time="2022-08-20T05:37:38.651959688Z" level=info msg="Loading containers: done."
Aug 20 05:37:38 bullseye systemd[895]: var-lib-docker-overlay2-opaque\x2dbug\x2dcheck3960008762-merged.mount: Succeeded.
Aug 20 05:37:38 bullseye systemd[1]: var-lib-docker-overlay2-opaque\x2dbug\x2dcheck3960008762-merged.mount: Succeeded.
Aug 20 05:37:38 bullseye dockerd[25969]: time="2022-08-20T05:37:38.665711263Z" level=info msg="Docker daemon" commit=a89b842 graphdriver(s)=overlay2 version=20.10.17
Aug 20 05:37:38 bullseye dockerd[25969]: time="2022-08-20T05:37:38.665784215Z" level=info msg="Daemon has completed initialization"
Aug 20 05:37:38 bullseye systemd[1]: Started Docker Application Container Engine.
Aug 20 05:37:38 bullseye dockerd[25969]: time="2022-08-20T05:37:38.683064683Z" level=info msg="API listen on /run/docker.sock"
Aug 20 05:37:39 bullseye systemd[1]: Reloading.
Aug 20 05:37:39 bullseye systemd[1]: /etc/systemd/system/hassio-apparmor.service:4: Failed to add dependency on %SERVICE_DOCKER%, ignoring: Invalid argument
Aug 20 05:37:39 bullseye systemd[1]: Reloading.
Aug 20 05:37:40 bullseye systemd[1]: Starting Hass.io AppArmor...
Aug 20 05:37:40 bullseye kernel: [  489.952690] audit: type=1400 audit(1660973860.267:10): apparmor="STATUS" operation="profile_load" profile="unconfined" name="hassio-supervisor" pid=26144 comm="apparmor_parse
r"
Aug 20 05:37:40 bullseye kernel: [  489.953478] audit: type=1400 audit(1660973860.267:11): apparmor="STATUS" operation="profile_load" profile="unconfined" name="hassio-supervisor///usr/bin/gdbus" pid=26144 comm
="apparmor_parser"
Aug 20 05:37:40 bullseye systemd[1]: Finished Hass.io AppArmor.
Aug 20 05:37:40 bullseye kernel: [  489.954385] audit: type=1400 audit(1660973860.271:12): apparmor="STATUS" operation="profile_load" profile="unconfined" name="hassio-supervisor///usr/bin/git" pid=26144 comm="
apparmor_parser"
Aug 20 05:37:40 bullseye systemd[1]: Starting Hass.io supervisor...
Aug 20 05:37:40 bullseye docker[26148]: Error response from daemon: No such container: hassio_supervisor
Aug 20 05:37:40 bullseye systemd[1]: Started Hass.io supervisor.
Aug 20 05:37:40 bullseye hassio-supervisor[26223]: Error: No such object: hassio_supervisor
Aug 20 05:37:40 bullseye hassio-supervisor[26252]: jq: error: Could not open file /usr/share/hassio/updater.json: No such file or directory
Aug 20 05:37:40 bullseye hassio-supervisor[26155]: [WARNING] Supervisor image missing, downloading a fresh one: latest
Aug 20 05:37:41 bullseye hassio-supervisor[26266]: latest: Pulling from home-assistant/amd64-hassio-supervisor