Delayed zigbee actions

Recently I upgraded from Raspberry Pi 4 to v5. Everything worked out well.
But now I do experience a delay when switching on my zigbee lights with my zigbee switch.

Actually this just applies for the lights in the kitchen and also not all of these light.

Is there any way to figure out what causes this delay?