Z-Wave - Zooz zen71 800LR with smartbulb physical switch not "smart"

I have a Zooz Zen71 on/off 800LR switch I’ve installed and tried to follow the documentation on smart bulb mode, but when I turn on the light group in HA, then try to turn off the lights with the physical paddle the switch is unresponsive. I believe it still thinks the switch is “off” even when the lights are actually “on” I have to first up press for the switch to turn “on”(which does nothing since the lights are already on), then down press to turn “off” (which finally turns the lights off). I have an inovelli blue switch in a different room that I can turn on/off either digitally or remotely no matter where it was last turned on/off.

Is there a setting I’m missing somewhere?

Thank you

When you enable “smart bulb mode” on the ZEN71 you are disabling both Z-Wave and physical control of the switch, and enabling Central Scene events. When the physical switch is pressed it sends events to the hub (HA) for you to use to control the bulbs via an automation. What is the automation code you are using to control the bulbs?

https://www.support.getzooz.com/kb/article/1689-how-to-use-your-zen71-on-off-switch-with-smart-bulbs-on-home-assistant/

Just a very simple when switch is turned on, turn light group on.
if switch is turned off, turn light group off.

My understanding is that you need to use central scene events (zwave_js_value_notification event or event entities), not on or off.