Shelly RGBW2 set white brightness

In my setup I have an Ikea remote I use to toggle a Shelly RGBW2 white light on or off. I also would like to use this remote to controle the brightness.

However when I set the states attribute “brightness” the RGB part of the the Shelly RGBW2 is turned up or down in brightness.

The Shelly uses “White” to set this value but Home Assistant dropped this? When I use:
‘states.light..attributes.white’ then Home assistant turn the white light on BUT it changes the RGB brightness value.

Anyway to fix this behavior or should I use MQTT instead? For example how can I only set the white in the rgbw colors or leave the rgb values untouched?