Backup files incomplete

DG-Lt · February 28, 2024, 4:25pm

Hi,

Short description:
Samba backups of the past two weeks contain only 3 *.tar.gz files and no /backup.json (or many other files)
please help to resolve this

Longer version:
core-2024.1.5
supervisor-2024.02.0
Home Assistant OS 11.5
running on a laptop with Intel plus SSD.

Today I decided to run all the updates:

As usual I invoked the Manual Samba Backup and waited. After a few minutes I noticed it is done successfully. It raised suspicion because it was like 6 times quicker than usual.
I went to my NAS storage and saw a 12GB backup. seems normal.
went to HA->Settings->System->Backups and notice there are only older that 2 weeks backups visible. (see image)
then I look at the Supervisor logs and see errors:

24-02-28 17:42:58 INFO (MainThread) [supervisor.backups.manager] Found 11 backup files
24-02-28 17:42:58 ERROR (MainThread) [supervisor.backups.backup] Can't read backup tarfile /data/backup/aab52cf6.tar: "filename './backup.json' not found"
24-02-28 17:42:58 ERROR (MainThread) [supervisor.backups.backup] Can't read backup tarfile /data/backup/9a25b40e.tar: "filename './backup.json' not found"
24-02-28 17:42:58 ERROR (MainThread) [supervisor.backups.backup] Can't read backup tarfile /data/backup/1faa2102.tar: "filename './backup.json' not found"
24-02-28 17:42:58 ERROR (MainThread) [supervisor.backups.backup] Can't read backup tarfile /data/backup/a5610052.tar: "filename './backup.json' not found"
24-02-28 17:42:58 ERROR (MainThread) [supervisor.backups.backup] Can't read backup tarfile /data/backup/c6eea917.tar: "filename './backup.json' not found"
24-02-28 17:42:58 ERROR (MainThread) [supervisor.backups.backup] Can't read backup tarfile /data/backup/c95b72f5.tar: "filename './backup.json' not found"

I download the backup from my NAS to my windows machine and open with 7zip. I see that the backup does not contain many of the Add-ons despite the fact that supervisor logs show everything have been backed up succesfully:

24-02-28 17:43:18 INFO (MainThread) [supervisor.api.middleware.security] /backups/new/full access from 15d21743_samba_backup
24-02-28 17:43:18 INFO (MainThread) [supervisor.backups.manager] Backup f3f51eb9 starting stage addon_repositories
24-02-28 17:43:18 INFO (MainThread) [supervisor.backups.manager] Backup f3f51eb9 starting stage docker_config
24-02-28 17:43:18 INFO (MainThread) [supervisor.backups.manager] Creating new full backup with slug f3f51eb9
24-02-28 17:43:18 INFO (MainThread) [supervisor.backups.manager] Backup f3f51eb9 starting stage addons
24-02-28 17:43:18 INFO (MainThread) [supervisor.addons.addon] Building backup for add-on a0d7b954_grafana
24-02-28 17:43:18 INFO (MainThread) [supervisor.addons.addon] Finish backup for addon a0d7b954_grafana
24-02-28 17:43:18 INFO (MainThread) [supervisor.addons.addon] Building backup for add-on a0d7b954_sonweb
24-02-28 17:43:18 INFO (MainThread) [supervisor.addons.addon] Finish backup for addon a0d7b954_sonweb
24-02-28 17:43:18 INFO (MainThread) [supervisor.addons.addon] Building backup for add-on a0d7b954_influxdb
24-02-28 17:44:35 INFO (MainThread) [supervisor.addons.addon] Finish backup for addon a0d7b954_influxdb
24-02-28 17:44:35 INFO (MainThread) [supervisor.addons.addon] Building backup for add-on a0d7b954_glances
24-02-28 17:44:35 INFO (MainThread) [supervisor.addons.addon] Finish backup for addon a0d7b954_glances
24-02-28 17:44:35 INFO (MainThread) [supervisor.addons.addon] Building backup for add-on core_ssh
24-02-28 17:44:35 INFO (MainThread) [supervisor.addons.addon] Finish backup for addon core_ssh
24-02-28 17:44:35 INFO (MainThread) [supervisor.addons.addon] Building backup for add-on a0d7b954_logviewer
24-02-28 17:44:35 INFO (MainThread) [supervisor.addons.addon] Finish backup for addon a0d7b954_logviewer
24-02-28 17:44:35 INFO (MainThread) [supervisor.addons.addon] Building backup for add-on a0d7b954_nut
24-02-28 17:44:35 INFO (MainThread) [supervisor.addons.addon] Finish backup for addon a0d7b954_nut
24-02-28 17:44:35 INFO (MainThread) [supervisor.addons.addon] Building backup for add-on core_samba
24-02-28 17:44:35 INFO (MainThread) [supervisor.addons.addon] Finish backup for addon core_samba
24-02-28 17:44:35 INFO (MainThread) [supervisor.addons.addon] Building backup for add-on a0d7b954_vscode
24-02-28 17:44:35 INFO (MainThread) [supervisor.addons.addon] Finish backup for addon a0d7b954_vscode
24-02-28 17:44:35 INFO (MainThread) [supervisor.addons.addon] Building backup for add-on core_configurator
24-02-28 17:44:35 INFO (MainThread) [supervisor.addons.addon] Finish backup for addon core_configurator
24-02-28 17:44:35 INFO (MainThread) [supervisor.addons.addon] Building backup for add-on 15d21743_samba_backup
24-02-28 17:44:35 INFO (MainThread) [supervisor.addons.addon] Finish backup for addon 15d21743_samba_backup
24-02-28 17:44:36 INFO (MainThread) [supervisor.addons.addon] Building backup for add-on core_mariadb
24-02-28 17:44:57 INFO (MainThread) [supervisor.addons.addon] Finish backup for addon core_mariadb
24-02-28 17:44:57 INFO (MainThread) [supervisor.addons.addon] Building backup for add-on a0d7b954_phpmyadmin
24-02-28 17:44:57 INFO (MainThread) [supervisor.addons.addon] Finish backup for addon a0d7b954_phpmyadmin
24-02-28 17:44:57 INFO (MainThread) [supervisor.addons.addon] Building backup for add-on core_mosquitto
24-02-28 17:44:57 INFO (MainThread) [supervisor.addons.addon] Finish backup for addon core_mosquitto
24-02-28 17:44:57 INFO (MainThread) [supervisor.addons.addon] Building backup for add-on 5c53de3b_esphome
24-02-28 17:44:57 INFO (MainThread) [supervisor.addons.addon] Finish backup for addon 5c53de3b_esphome
24-02-28 17:44:57 INFO (MainThread) [supervisor.addons.addon] Building backup for add-on 193f5383_zigstar-cc2652p-flasher
24-02-28 17:44:57 INFO (MainThread) [supervisor.addons.addon] Finish backup for addon 193f5383_zigstar-cc2652p-flasher
24-02-28 17:44:57 INFO (MainThread) [supervisor.addons.addon] Building backup for add-on 45df7312_zigbee2mqtt
24-02-28 17:44:57 INFO (MainThread) [supervisor.addons.addon] Finish backup for addon 45df7312_zigbee2mqtt
24-02-28 17:44:57 INFO (MainThread) [supervisor.backups.manager] Backup f3f51eb9 starting stage home_assistant
24-02-28 17:44:57 INFO (MainThread) [supervisor.homeassistant.module] Backing up Home Assistant Core config folder
24-02-28 17:45:04 INFO (MainThread) [supervisor.homeassistant.module] Backup Home Assistant Core config folder done
24-02-28 17:45:04 INFO (MainThread) [supervisor.backups.manager] Backup f3f51eb9 starting stage folders
24-02-28 17:45:04 INFO (SyncWorker_5) [supervisor.backups.backup] Backing up folder share
24-02-28 17:45:04 INFO (SyncWorker_5) [supervisor.backups.backup] Backup folder share done
24-02-28 17:45:04 INFO (SyncWorker_7) [supervisor.backups.backup] Backing up folder addons/local
24-02-28 17:45:04 INFO (SyncWorker_7) [supervisor.backups.backup] Backup folder addons/local done
24-02-28 17:45:04 INFO (SyncWorker_8) [supervisor.backups.backup] Backing up folder ssl
24-02-28 17:45:07 INFO (SyncWorker_8) [supervisor.backups.backup] Backup folder ssl done
24-02-28 17:45:07 INFO (SyncWorker_3) [supervisor.backups.backup] Backing up folder media
24-02-28 17:45:07 INFO (SyncWorker_3) [supervisor.backups.backup] Backup folder media done
24-02-28 17:45:07 INFO (MainThread) [supervisor.backups.manager] Backup f3f51eb9 starting stage finishing_file
24-02-28 17:45:07 INFO (MainThread) [supervisor.backups.manager] Creating full backup with slug f3f51eb9 completed

when I downloaded one of the 2 week old backups I see that it contains lots of files.
tried to do a full reboot (including the Host) and repeat the backup. Backup file still incomplete.
tried to invoke backup from HA backup page. Backup file still incomplete.
the storage seems to have plenty of free space.
when the last correct backup was made I was on vacation and no changes were made to the system.

DG-Lt · February 28, 2024, 5:01pm

Update.

noticed that a backup only contains first 3 add-ons as listed in the supervisor logs. and the last one that makes it to the backup is the InfluxDB.

Tried to create a Partial backup with all options selected except InfluxDB.

And the backup succeeded. I can see it in HA backups list, and it contains all of the rest files inside.

So the problem can be isolated to the backup process of the InfluxDB.

tried to create a backup with InfluxDB add-on stopped. it resulted in the incomplete backup file again…

Any suggestions?

bembol · February 29, 2024, 8:58am

I’ve got exactly the same issue from last few weeks when I do a full backup I don’t see on on HA console, but backup itself is being created on SMB share. In supervisor logs I see it cannot read them properly from some reason

WallyR · February 29, 2024, 2:17pm

Make a purge and repack on your database and then try again.

Be aware that the process can eat a lot of ram and disk space, especially with a large Influx database!

JohnnyFive · February 29, 2024, 6:18pm

Backup issue fixed in Supervisor 2024.2.1

issue 4924

Pastaloverzzz · September 29, 2024, 9:26pm

I had this error today and the faulty backup wasn’t visible in the backup-list so in case anyone still has the error that 1 or more backup-files can’t be found, you can find and remove them via the CLI. (using Advanced SSH & Web terminal add-on) with the following commands
To find the file:

find /backup/*

You will get a list like:

/backup/02c1bfbf.tar
/backup/61249f3f.tar
/backup/a011c53d.tar
/backup/cd00009d.tar

You can remove the bad backup using command: (change XXXXXX to the correct backup)

rm /backup/XXXXXX.tar