Hue logic for controlling lights in room in HA?

Configuration
1

Before switching to HA I have used the Philips Hue app where the logic for controlling all lights in a room is a bit different from HA.

If a subset of all lights were turned on in a room, and I issued a command in the Hue app to change the color or intensity using the controls visible in the following picture only the lights that already were turned on would change state:
image

In HA I have used (helper) groups to group lights in a room and be able to control them in a similar fashion. However, if I change the color or brightness all lights in the group will be affected regardless of their previous state. This means that some lights that were off would be turned on when I change the color or brightness for example.

Is it possible to get the Hue room control logic in HA?

2

I have two Hue hubs, but only use color lights in a few places. But I control some rooms with more than one group. . . a group for all (on/off), plus groups for lights I want to control as subsets of a room lights. Be it from a dashboard or via voice, through Homekit, I have control of parts of a room:

Den group - 4 lights
Desk group - Desk, Floor
The corner light “Corner” and “Den.Globe” are individually controlled, as aren’t called for as much. Groups within a room may work for color needs too, depending on the goal.

I had toyed for a spell using Hue Scenes and Zones pulled into HA, but that didn’t work for me. But you might see if Hue Scenes/Zones would suit what you are after.