Zooz Z-Wave Scene Controller not turning on

I just got a Zooz Zen32 scene controller for my outdoor light.
I created an automation to turn it on at Sunset. It does not trigger.
I am using basically the same config as the rest of my switches and outlets that trigger at sunset.
I also have one that turns it off at sunrise and it works fine. Any idea why one works and the other never even fires? No indication of it in the log.
Manually Triggering the switch in HA works, as does using the physical switch. Its just the one automation

Config -turn on

alias: Front Door sw on
description: Turns on Front Door at Sunset
triggers:
  - trigger: sun
    event: sunset
    offset: 0
conditions: []
actions:
  - type: turn_on
    device_id: e875e9f24e44b6576f1b95b300dd8a2d
    entity_id: 54224a860e9df443e192f43c40c33f0e
    domain: switch
mode: single

Config - Turn off

alias: Turn off front door sw at sunrise
description: ""
triggers:
  - trigger: sun
    event: sunrise
    offset: 0
conditions: []
actions:
  - type: turn_off
    device_id: e875e9f24e44b6576f1b95b300dd8a2d
    entity_id: 54224a860e9df443e192f43c40c33f0e
    domain: switch
mode: single