Zigbee devices stop working after (about) 2 hours

Hi all, hope you can help me.
Yesterday I got my new Zigbee 3.0 USB Dongle Plus (ZBDongle-E)
I have a few zigbee devices and previously was using an old zigate usb adapter without problems.
I installed my new ZBDongle, is was plug-and-play from HA and added tree devices.
I’m using ZHA (no, don’t want to use mqtt)

Everything seems to be working fine, my wireless switch button is doing automations as expected.
But then I go out for lunch and when I come back, no zigbee devices are working.
Thet still show up in HA, but no responding, no communication.

I can re-pair my button, and it will work until I leave it for a couple of hours, and will stop working.

Do you know what is causing this behavior? Is there something in the configuration?
Please help :frowning: