Why HA start up on Debian Supervised is slower than VM?

Hi,
i recently got minisforum gk41 and experimented with various installation. It comes with windows so i first installed HassOS through VirtualBox (Linux-Other) and recovered my config. It worked pretty well and fast.

the issue was i owouldnt be able to use frigate efficiently on windows. So i moved to installing debian + supervised on that same machine.

Now everything works but the time it takes for Home assistant to get fully ready is so much longer on debian than it was on VM. Something is not right there or is itexpected?
I wonder why is that and if there are any way to fix it?