Ikea on/off switch - adaptive lighting

I bought Ikea Dirigera hub, colored bulbs and a Tradfri on/off switch.
Bulbs, and motion sensor (witch have nothing to do with this) are connected to the home assistant as a homekit controler but the on/off switch somehow isnt.
I installed the adaptive lighting…
The adaptive lighting works fine when I turn on the lights in the Home Assistant.
When I use the switch, it just turn on its last position via ikea app - the adaptive lighting doesn’t work.
I dont know how to do it so adaptive lighting work as it should.