Change ZHA group membership time-based

Hi
I successfully integrated all my ubisys S2 and J1.
But there is one special configuration:
I have two lights in my bathroom. On daytime, both should light up when I press the switch. But on night-time, just one of them should light up.
I successfully managed doing it with events (when light 1 turns on, light 2 should also turn on). But there is a small delay between, which I would like to get rid off (and I would like, that the switch works even if HA is not there).

So I played around with ZHA groups and group-bindings. I successfully managed to get the switch working on all lights currently in the group (and the delay is almost un-noticable).
But now, how can I remove a member from the group at 10pm and add it again on 5am?

Or does anyone has a better solution?

Thanks for any ideas :slight_smile:
Phil