Upgrading HAOS 12.1 to 12.3 fails on RPi 3

Hey,
I have tried to upgrade HAOS from 12.1 to 12.3 on my RPi 3 several times now and it fails every time.

Tried:

  1. Normal upgrade through web UI = fail :x:
  2. Flashing new 12.3 and boot = fail :x:
  3. Flashing new 12.1 and boot = success :negative_squared_cross_mark: and can restore backup thankfully

Logs from #2 are:

s6-rc: info: service s6rc-oneshot-runner: starting
s6-rc: info: service s6rc-oneshot-runner successfully started
s6-rc: info: service fix-attrs: starting
s6-rc: info: service fix-attrs successfully started
s6-rc: info: service legacy-cont-init: starting
cont-init: info: running /etc/cont-init.d/udev.sh
[17:07:12] INFO: Using udev information from host
cont-init: info: /etc/cont-init.d/udev.sh exited 0
s6-rc: info: service legacy-cont-init successfully started
s6-rc: info: service legacy-services: starting
services-up: info: copying legacy longrun supervisor (no readiness notification)
services-up: info: copying legacy longrun watchdog (no readiness notification)
s6-rc: info: service legacy-services successfully started
[17:07:13] INFO: Starting local supervisor watchdog...
2024-05-14 17:07:21.273 INFO (MainThread) [__main__] Initializing Supervisor setup
2024-05-14 17:07:21.323 INFO (MainThread) [supervisor.docker.network] Can't find Supervisor network, creating a new network
2024-05-14 17:07:21.864 INFO (MainThread) [supervisor.bootstrap] Setting up coresys for machine: raspberrypi3-64
2024-05-14 17:07:21.884 INFO (MainThread) [supervisor.docker.supervisor] Attaching to Supervisor ghcr.io/home-assistant/aarch64-hassio-supervisor with version 2024.05.1
2024-05-14 17:07:21.884 INFO (MainThread) [supervisor.docker.supervisor] Connecting Supervisor to hassio-network
2024-05-14 17:07:22.180 INFO (MainThread) [supervisor.resolution.evaluate] Starting system evaluation with state initialize
2024-05-14 17:07:22.191 INFO (MainThread) [supervisor.resolution.evaluate] System evaluation complete
2024-05-14 17:07:22.194 INFO (MainThread) [__main__] Setting up Supervisor
2024-05-14 17:07:22.581 INFO (MainThread) [supervisor.api] Starting API on 172.30.32.2
2024-05-14 17:07:22.817 INFO (MainThread) [supervisor.hardware.monitor] Started Supervisor hardware monitor
2024-05-14 17:07:22.823 INFO (MainThread) [supervisor.dbus.manager] Connected to system D-Bus.
2024-05-14 17:07:22.825 INFO (MainThread) [supervisor.dbus.agent] Load dbus interface io.hass.os
2024-05-14 17:07:22.827 INFO (MainThread) [supervisor.dbus.hostname] Load dbus interface org.freedesktop.hostname1
2024-05-14 17:07:22.830 INFO (MainThread) [supervisor.dbus.logind] Load dbus interface org.freedesktop.login1
2024-05-14 17:07:22.832 INFO (MainThread) [supervisor.dbus.network] Load dbus interface org.freedesktop.NetworkManager
2024-05-14 17:07:22.836 INFO (MainThread) [supervisor.dbus.rauc] Load dbus interface de.pengutronix.rauc
2024-05-14 17:07:22.839 INFO (MainThread) [supervisor.dbus.resolved] Load dbus interface org.freedesktop.resolve1
2024-05-14 17:07:22.842 INFO (MainThread) [supervisor.dbus.systemd] Load dbus interface org.freedesktop.systemd1
2024-05-14 17:07:22.844 INFO (MainThread) [supervisor.dbus.timedate] Load dbus interface org.freedesktop.timedate1
2024-05-14 17:07:23.702 INFO (MainThread) [supervisor.host.services] Updating service information
2024-05-14 17:07:23.723 INFO (MainThread) [supervisor.host.sound] Updating PulseAudio information
2024-05-14 17:07:23.740 WARNING (SyncWorker_0) [supervisor.host.sound] Can't update PulseAudio data: Failed to connect to pulseaudio server
2024-05-14 17:07:24.014 INFO (MainThread) [supervisor.host.network] Updating local network information
2024-05-14 17:07:24.179 INFO (MainThread) [supervisor.host.apparmor] Loading AppArmor Profiles: {'hassio-supervisor'}
2024-05-14 19:07:24.381 INFO (MainThread) [supervisor.docker.monitor] Started docker events monitor
2024-05-14 19:07:24.392 INFO (MainThread) [supervisor.updater] Fetching update data from https://version.home-assistant.io/stable.json
2024-05-14 19:07:24.602 INFO (MainThread) [supervisor.docker.interface] Found ghcr.io/home-assistant/aarch64-hassio-cli versions: [<AwesomeVersion CalVer '2024.05.0'>]
2024-05-14 19:07:24.629 INFO (MainThread) [supervisor.docker.interface] Attaching to ghcr.io/home-assistant/aarch64-hassio-cli with version 2024.05.0
2024-05-14 19:07:24.686 INFO (MainThread) [supervisor.plugins.cli] Starting CLI plugin
2024-05-14 19:07:25.930 INFO (MainThread) [supervisor.docker.cli] Starting CLI ghcr.io/home-assistant/aarch64-hassio-cli with version 2024.05.0 - 172.30.32.5
2024-05-14 19:07:26.277 INFO (MainThread) [supervisor.docker.interface] Found ghcr.io/home-assistant/aarch64-hassio-dns versions: [<AwesomeVersion CalVer '2024.04.0'>]
2024-05-14 19:07:26.302 INFO (MainThread) [supervisor.docker.interface] Attaching to ghcr.io/home-assistant/aarch64-hassio-dns with version 2024.04.0
2024-05-14 19:07:26.370 INFO (MainThread) [supervisor.plugins.dns] Starting CoreDNS plugin
2024-05-14 19:07:27.861 INFO (MainThread) [supervisor.docker.dns] Starting DNS ghcr.io/home-assistant/aarch64-hassio-dns with version 2024.04.0 - 172.30.32.3
2024-05-14 19:07:27.864 INFO (MainThread) [supervisor.plugins.dns] Updated /etc/resolv.conf
2024-05-14 19:07:27.945 INFO (MainThread) [supervisor.docker.interface] Found ghcr.io/home-assistant/aarch64-hassio-audio versions: [<AwesomeVersion CalVer '2023.12.0'>]
2024-05-14 19:07:27.974 INFO (MainThread) [supervisor.docker.interface] Attaching to ghcr.io/home-assistant/aarch64-hassio-audio with version 2023.12.0
2024-05-14 19:07:28.705 INFO (MainThread) [supervisor.plugins.audio] Starting Audio plugin
2024-05-14 19:07:30.700 INFO (MainThread) [supervisor.docker.audio] Starting Audio ghcr.io/home-assistant/aarch64-hassio-audio with version 2023.12.0 - 172.30.32.4
2024-05-14 19:07:30.792 INFO (MainThread) [supervisor.docker.interface] Found ghcr.io/home-assistant/aarch64-hassio-observer versions: [<AwesomeVersion CalVer '2023.06.0'>]
2024-05-14 19:07:30.817 INFO (MainThread) [supervisor.docker.interface] Attaching to ghcr.io/home-assistant/aarch64-hassio-observer with version 2023.06.0
2024-05-14 19:07:30.939 INFO (MainThread) [supervisor.plugins.observer] Starting observer plugin
2024-05-14 19:07:32.725 INFO (MainThread) [supervisor.docker.observer] Starting Observer ghcr.io/home-assistant/aarch64-hassio-observer with version 2023.06.0 - 172.30.32.6
2024-05-14 19:07:32.797 INFO (MainThread) [supervisor.docker.interface] Found ghcr.io/home-assistant/aarch64-hassio-multicast versions: [<AwesomeVersion CalVer '2024.03.0'>]
2024-05-14 19:07:32.827 INFO (MainThread) [supervisor.docker.interface] Attaching to ghcr.io/home-assistant/aarch64-hassio-multicast with version 2024.03.0
2024-05-14 19:07:32.890 INFO (MainThread) [supervisor.plugins.multicast] Starting Multicast plugin
2024-05-14 19:07:33.867 INFO (MainThread) [supervisor.docker.multicast] Starting Multicast ghcr.io/home-assistant/aarch64-hassio-multicast with version 2024.03.0 - Host
2024-05-14 19:07:33.873 INFO (MainThread) [supervisor.homeassistant.secrets] Loaded 0 Home Assistant secrets
2024-05-14 19:07:33.926 INFO (MainThread) [supervisor.docker.interface] No version found for ghcr.io/home-assistant/raspberrypi3-64-homeassistant
2024-05-14 19:07:33.927 INFO (MainThread) [supervisor.homeassistant.core] No Home Assistant Docker image ghcr.io/home-assistant/raspberrypi3-64-homeassistant found.
2024-05-14 19:07:33.963 INFO (MainThread) [supervisor.docker.interface] Attaching to ghcr.io/home-assistant/raspberrypi3-64-homeassistant with version landingpage
2024-05-14 19:07:33.964 INFO (MainThread) [supervisor.homeassistant.core] Using preinstalled landingpage
2024-05-14 19:07:33.989 INFO (MainThread) [supervisor.homeassistant.core] Starting HomeAssistant landingpage
2024-05-14 19:07:34.049 INFO (MainThread) [supervisor.homeassistant.module] Update pulse/client.config: /data/tmp/homeassistant_pulse
2024-05-14 19:07:35.138 INFO (MainThread) [supervisor.docker.homeassistant] Starting Home Assistant ghcr.io/home-assistant/raspberrypi3-64-homeassistant with version landingpage
2024-05-14 19:07:35.364 INFO (MainThread) [supervisor.os.manager] Detect Home Assistant Operating System 12.3 / BootSlot A
2024-05-14 19:07:35.388 INFO (MainThread) [supervisor.store.git] Cloning add-on https://github.com/home-assistant/addons repository
2024-05-14 19:07:35.393 INFO (MainThread) [supervisor.store.git] Cloning add-on https://github.com/esphome/home-assistant-addon repository
2024-05-14 19:07:35.401 INFO (MainThread) [supervisor.store.git] Cloning add-on https://github.com/hassio-addons/repository repository
2024-05-14 19:07:40.350 INFO (MainThread) [supervisor.store] Loading add-ons from store: 77 all - 77 new - 0 remove
2024-05-14 19:07:40.480 INFO (MainThread) [supervisor.addons.manager] Found 0 installed add-ons
2024-05-14 19:07:40.576 INFO (MainThread) [supervisor.backups.manager] Found 0 backup files
2024-05-14 19:07:40.577 INFO (MainThread) [supervisor.discovery] Loaded 0 messages
2024-05-14 19:07:40.577 INFO (MainThread) [supervisor.ingress] Loaded 0 ingress sessions
2024-05-14 19:07:40.577 INFO (MainThread) [supervisor.resolution.check] Starting system checks with state setup
2024-05-14 19:07:40.578 INFO (MainThread) [supervisor.resolution.checks.base] Run check for disabled_data_disk/system
2024-05-14 19:07:40.579 INFO (MainThread) [supervisor.resolution.checks.base] Run check for multiple_data_disks/system
2024-05-14 19:07:40.579 INFO (MainThread) [supervisor.resolution.check] System checks complete
2024-05-14 19:07:40.580 INFO (MainThread) [supervisor.resolution.evaluate] Starting system evaluation with state setup
2024-05-14 19:07:40.581 INFO (MainThread) [supervisor.resolution.evaluate] System evaluation complete
2024-05-14 19:07:40.582 INFO (MainThread) [supervisor.jobs] 'ResolutionFixup.run_autofix' blocked from execution, system is not running - setup
2024-05-14 19:07:40.582 INFO (MainThread) [supervisor.resolution.evaluate] Starting system evaluation with state setup
2024-05-14 19:07:40.583 INFO (MainThread) [supervisor.resolution.evaluate] System evaluation complete
2024-05-14 19:07:40.586 INFO (MainThread) [__main__] Running Supervisor
2024-05-14 19:07:40.615 INFO (MainThread) [supervisor.os.manager] Rauc: A - marked slot kernel.0 as good
2024-05-14 19:07:40.655 INFO (MainThread) [supervisor.addons.manager] Phase 'initialize' starting 0 add-ons
2024-05-14 19:07:40.766 INFO (MainThread) [supervisor.addons.manager] Phase 'system' starting 0 add-ons
2024-05-14 19:07:40.767 INFO (MainThread) [supervisor.addons.manager] Phase 'services' starting 0 add-ons
2024-05-14 19:07:40.783 INFO (MainThread) [supervisor.core] Skipping start of Home Assistant
2024-05-14 19:07:40.783 INFO (MainThread) [supervisor.addons.manager] Phase 'application' starting 0 add-ons
2024-05-14 19:07:40.802 INFO (MainThread) [supervisor.misc.tasks] All core tasks are scheduled
2024-05-14 19:07:40.806 INFO (MainThread) [supervisor.core] Supervisor is up and running
2024-05-14 19:07:40.809 INFO (MainThread) [supervisor.homeassistant.core] Home Assistant setup
2024-05-14 19:07:40.810 INFO (MainThread) [supervisor.docker.interface] Updating image ghcr.io/home-assistant/raspberrypi3-64-homeassistant:landingpage to ghcr.io/home-assistant/raspberrypi3-64-homeassistant:2024.5.3
2024-05-14 19:07:40.811 INFO (MainThread) [supervisor.docker.interface] Downloading docker image ghcr.io/home-assistant/raspberrypi3-64-homeassistant with tag 2024.5.3.
2024-05-14 19:07:40.812 INFO (MainThread) [supervisor.host.info] Updating local host information
2024-05-14 19:07:40.821 INFO (MainThread) [supervisor.resolution.check] Starting system checks with state running
2024-05-14 19:07:40.822 INFO (MainThread) [supervisor.resolution.checks.base] Run check for dns_server_failed/dns_server
2024-05-14 19:07:40.858 INFO (MainThread) [supervisor.resolution.checks.base] Run check for security/core
2024-05-14 19:07:40.859 INFO (MainThread) [supervisor.resolution.checks.base] Run check for pwned/addon
2024-05-14 19:07:40.862 INFO (MainThread) [supervisor.resolution.checks.base] Run check for disabled_data_disk/system
2024-05-14 19:07:40.862 INFO (MainThread) [supervisor.resolution.checks.base] Run check for ipv4_connection_problem/system
2024-05-14 19:07:40.863 INFO (MainThread) [supervisor.resolution.checks.base] Run check for docker_config/system
2024-05-14 19:07:40.863 INFO (MainThread) [supervisor.resolution.checks.base] Run check for trust/supervisor
2024-05-14 19:07:40.897 INFO (MainThread) [supervisor.resolution.checks.base] Run check for dns_server_ipv6_error/dns_server
2024-05-14 19:07:40.915 INFO (MainThread) [supervisor.resolution.checks.base] Run check for no_current_backup/system
2024-05-14 19:07:40.916 INFO (MainThread) [supervisor.resolution.module] Create new suggestion create_full_backup - system / None
2024-05-14 19:07:40.916 INFO (MainThread) [supervisor.resolution.module] Create new issue no_current_backup - system / None
2024-05-14 19:07:40.917 INFO (MainThread) [supervisor.resolution.checks.base] Run check for free_space/system
2024-05-14 19:07:40.918 INFO (MainThread) [supervisor.resolution.checks.base] Run check for multiple_data_disks/system
2024-05-14 19:07:40.919 INFO (MainThread) [supervisor.resolution.check] System checks complete
2024-05-14 19:07:40.919 INFO (MainThread) [supervisor.resolution.evaluate] Starting system evaluation with state running
2024-05-14 19:07:40.978 INFO (MainThread) [supervisor.host.services] Updating service information
2024-05-14 19:07:41.005 INFO (MainThread) [supervisor.host.network] Updating local network information
2024-05-14 19:07:41.622 INFO (MainThread) [supervisor.host.sound] Updating PulseAudio information
2024-05-14 19:07:41.655 INFO (MainThread) [supervisor.host.manager] Host information reload completed
2024-05-14 19:07:42.077 INFO (MainThread) [supervisor.resolution.evaluate] System evaluation complete
2024-05-14 19:07:42.078 INFO (MainThread) [supervisor.resolution.fixup] Starting system autofix at state running
2024-05-14 19:07:42.079 INFO (MainThread) [supervisor.resolution.fixup] System autofix complete
2024-05-14 19:08:30.419 INFO (MainThread) [supervisor.hardware.monitor] Detecting remove hardware /dev/ttyACM1 - /dev/serial/by-id/usb-dresden_elektronik_ingenieurtechnik_GmbH_ConBee_II_DE2199020-if00
2024-05-14 19:08:30.432 INFO (MainThread) [supervisor.hardware.monitor] Detecting remove hardware /dev/bus/usb/001/007 - None
2024-05-14 19:08:34.697 INFO (MainThread) [supervisor.hardware.monitor] Detecting add hardware /dev/bus/usb/001/009 - None
2024-05-14 19:08:34.706 INFO (MainThread) [supervisor.hardware.monitor] Detecting add hardware /dev/ttyACM1 - /dev/serial/by-id/usb-dresden_elektronik_ingenieurtechnik_GmbH_ConBee_II_DE2199020-if00
2024-05-14 19:08:34.708 ERROR (MainThread) [asyncio] Task exception was never retrieved
future: <Task finished name='Task-444' coro=<HomeAssistant._hardware_events() done, defined at /usr/src/supervisor/supervisor/homeassistant/module.py:326> exception=AwesomeVersionCompareException("Can't compare <unknown landingpage> and <CalVer 2021.9.0>")>
Traceback (most recent call last):
  File "/usr/src/supervisor/supervisor/homeassistant/module.py", line 331, in _hardware_events
    or self.version < "2021.9.0"
       ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.12/site-packages/awesomeversion/awesomeversion.py", line 172, in __lt__
    raise AwesomeVersionCompareException(
awesomeversion.exceptions.AwesomeVersionCompareException: Can't compare <unknown landingpage> and <CalVer 2021.9.0>
2024-05-14 19:08:36.549 INFO (MainThread) [supervisor.hardware.monitor] Detecting add hardware /dev/bus/usb/001/009 - None
2024-05-14 19:08:36.559 INFO (MainThread) [supervisor.hardware.monitor] Detecting add hardware /dev/ttyACM1 - /dev/serial/by-id/usb-dresden_elektronik_ingenieurtechnik_GmbH_ConBee_II_DE2199020-if00
2024-05-14 19:08:36.562 ERROR (MainThread) [asyncio] Task exception was never retrieved
future: <Task finished name='Task-448' coro=<HomeAssistant._hardware_events() done, defined at /usr/src/supervisor/supervisor/homeassistant/module.py:326> exception=AwesomeVersionCompareException("Can't compare <unknown landingpage> and <CalVer 2021.9.0>")>
Traceback (most recent call last):
  File "/usr/src/supervisor/supervisor/homeassistant/module.py", line 331, in _hardware_events
    or self.version < "2021.9.0"
       ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.12/site-packages/awesomeversion/awesomeversion.py", line 172, in __lt__
    raise AwesomeVersionCompareException(
awesomeversion.exceptions.AwesomeVersionCompareException: Can't compare <unknown landingpage> and <CalVer 2021.9.0>
2024-05-14 19:10:34.314 INFO (MainThread) [supervisor.hardware.monitor] Detecting remove hardware /dev/ttyACM1 - /dev/serial/by-id/usb-dresden_elektronik_ingenieurtechnik_GmbH_ConBee_II_DE2199020-if00
2024-05-14 19:10:34.329 INFO (MainThread) [supervisor.hardware.monitor] Detecting remove hardware /dev/bus/usb/001/009 - None

Hm, the errors seem related to changes in harware configuration while the landing page was running. Did you see the welcome page?

While there are errors in the logs, it seems that download of the Core started:

2024-05-14 19:07:40.811 INFO (MainThread) [supervisor.docker.interface] Downloading docker image ghcr.io/home-assistant/raspberrypi3-64-homeassistant with tag 2024.5.3.

I think if you’d wait long enough, it should work ultimately.

As for why the update fails it is hard to tell without logs. If this continues to be a problem, open an issue in the Home Assistant Operating System GitHub issue tracker.

Hi @agners ,

I did another attempt with #2 (flash a fresh image, restore etc)

First boot I got this (with the same log as above):

Left it there for a while and then the screen appeared to upload a backup so I did that. Then it took a long time and several reboots it seems until it could start correctly.
But finally it worked BUT a simple reboot afterwards means HA to “reboot” several times, at least dashboard gets partly available and then “disconnected” …currently not reachable for a long time.

Nah, I stick with 12.1 for now

RPi 3B running HA OS12.1 will NOT properly update to 12.3. It starts up and loads various items the pauses at the loading of ZHA and instead of comming through it the system reboots and it gets stuck in that loop.

Likewise I will restore it back to my fullbackup at 12.1 till this is resolved. For reference I have been through the process of reflashing the SD card and onboarding several times and it does the same thing each time. The SD card is fine as when it restores to backup everything is working fine, and the 12.1 update caused no problems.

2 Likes

Same here. 12.3 killed my ZHA setup. Had to delete it and rename each entity when they all came back with new default names. I seem to be running OK on 12.2 now, although HA is using about 50% more memory than it did before.

I was a bit surprised. Never had a problem with an OS update before. This one took me a few days to recover from, and I’m still not done.

Issues with OS 12.3 have been accumulating here:

Issues · home-assistant/operating-system · GitHub

1 Like

After changing Aeotec z-stick from gen5 to gen5+, I upgraded to RPi v4 and now running 12.3

Therein lies a clue to the problem. If HAOS 12.2 uses 50% more memory then that could be the issue, the RPi3 B I have has 1GB of RAM and 70-78% is normally used with my HAOS 12.1 install. It looks likely that HAOS 12.3 will probably use more RAM than HAOS 12.2, so I guess I need a hardware platform upgrade to run HAOS 12.3 with my HA setup.

Or try increasing your swap file size to 2 gb.

As I have an micro SD card for external memory it is not ideal to create a swap file that can cause regularly writes to the SD resulting ultimately in its failure. I have already had one SD card fail on me using HA.
I think its time to update to hardware wiith more RAM so that a swap file setup is not required. It appears that HAOS V12.4 does the same thing as V12.3, crashing the RPi3 at attempt to run up ZHA.

Here is my view on SD card reliability: SD Card Reliability.

All problems with HAOS update now fixed after moving from RPi3 to VM on a NUC. My son set the NUC up with the VM and it works much better now there are no memory constraints affecting the system. Further more its very fast, so restoring a backup (87MB) takes a couple of minutes not tens of minutes. I think based on this I would recomend migrating from RPi3. Just create a full backup first so you can restore on the HA setup on a new machine.