Toggle button to switch hue bulbs behind a z-wave switch

Dear Community,

I face the situation, that I installed hue bulbs behind a (physical) button which again is connected to a z-wave switch.

So when pressing the physical button, the zwave switch powers off the hue bulb.
Then (of course) the hue bulb is not reachable anymore.

I am searching for a solution to keep the hue bulb reachable.

Thus I thought to establish the following toggle behaviour within home assistant:

Toggle state A)
by pressing the physical button the zwave switch powers on and the hue bulb is switches on too.

Toggle state B)
by pressing the physical switch again, only the hue bulb gets switched off (while still receiving power from the z-wave switch).

Does anyone have an idea, how to establish this?

Or maybe someone has an even smarter idea?

Thank you for your help in advance.