Denon does not show or appear when device is off or turned on

Denon does not show or appear when device is off or turned on. I have to restart HASS when my Denon is on to get it visible again.

My expected behavior would be that it would appear or stay visible since I have configured it.

I use denon and not denonavr (that does not work). Telnet is working great on Denon DN-500AV.