Automation very slow hue changing scene

Hi

I want to toilet licht to pick a scene based on the time of day. By day normal, By night dimed.
I made the following automation. While it does work it is realy slow, it takes 10-20sec. Can some1 point me in the correct direction.
-Maby its hue not being fast enough?
-Maby a hole different method?
-Now its reacting on classic physical switch, a hue switch would probably solve it but i dont feel like trowing extra money against it. They already have enouf of my money. Also this is also about learning and fixing the puzzle …

Thanks

alias: Toilet licht boven
description: ""
triggers:
  - type: turned_on
    device_id: a19fd4a724e731a2f8c5fd840940009e
    entity_id: c51f40bce424f887f75d11792d2afd1c
    domain: light
    trigger: device
    id: Toilet aan
conditions: []
actions:
  - choose:
      - conditions:
          - condition: trigger
            id:
              - Toilet aan
          - condition: state
            entity_id: schedule.schema_toilet_boven
            state:
              - "on"
        sequence:
          - action: scene.turn_on
            metadata: {}
            data: {}
            target:
              entity_id: scene.toilet_overdag
        alias: licht overdag
      - conditions:
          - condition: trigger
            id:
              - Toilet aan
          - condition: state
            entity_id: schedule.schema_toilet_boven
            state:
              - "off"
        sequence:
          - action: scene.turn_on
            metadata: {}
            data: {}
            target:
              entity_id: scene.toilet_avond
        alias: licht nacht
mode: single

You could try explicitly setting the transition time for the ‘scene.turn_on’ but I would have expected the transition time to be zero if not explicitly set.

What do you mean by a ‘classic physical switch’?

If you mean a dumb switch that kills power to the light when switched off, then the light needs to reconnect to your zigbee network when switched on and then react to the automation. You could get something like a Sonoff ZBMINIR2 that has a detached mode?