After many days of testing I realized that at random my addons were not loading at all, same with my system tab that has the logs and supervisor info etc, my network usage was decreasing, cpu and ram usage was increasing. That time I was having either a home assisntant restart or addons staying frozen with integrations working.
The problem seems to be the odd home assistant OS DNS behaviour described here and in many more post at github:
Solution here:
I am using Home Assistant OS on Proxmox with pfSense running on the same VE.
Hope that I have helped !