HA running on Rpi4 randomly disconnects from router(wired connection)

Hello,
My Rpi4 randomly disconnects from router even tho its connected through ethernet. I have x20 deco router and this is soooo strange because when disconnection happens(I know when it happens because I have automation in my Deco router to notify me) I can still access HA locally but when I open Deco app and search for HA in connected devices I can’t find it. Only way to connect my Rpi4 to router is to hard reset HA(shut down power source and back on). I’m running the latest version of HA and have bunch of devices connected and they all work perfect. I think that problem started when I setup remote access to my HA outside of my network. I use DuckDNS for access and disconnection happens totally randomly. HA can run for 2-3 days then disconnects or it can disconnect after 20 min of initial hard restart.
Any help would be appreciate.

Did you ever find a fix for this? Im experiencing this issue right now.