So far I do not see any solution other than making an assumption that there are bugs on the current supervisor-install. I try to follow Kange-Who guide Installing Home Assistant Supervised on Debian 11 - Community Guides - Home Assistant Community (home-assistant.io) and try my old Debian 10 script which has been modified to cater Debian 11. Tested in multiply attempts and it keeps making some problems.
The problem is clear that hassio-supervisor when it first runs creates /etc/machine-id and `/var/lib/dbus/machine-id’ as a directory instead of files. Removing both directories won’t delete it as long hassio-supervisor is up and running.
Temporary solutions (thanks to @Tamsy) for his guide by making these steps.
$ service hassio-supervisor stop
$ rm -f /etc/machine-id
$ rm /var/lib/dbus/machine-id
$ dbus-uuidgen --ensure=/etc/machine-id
$ dbus-uuidgen --ensure
$ systemctl reboot
and you will have a working Docker + HA
P.S.
The problem only happen to Raspberry Pi 4, the same problem did not occur on my proxmox install running Debian 11 Cloud