I’ve done my best to search and dig for the answer with no luck, hoping someone has encountered a similar issue. When I toggle any of these light groups on via the card, the lights turn on correctly, but the visible toggle in the card will go from on, to off, then on again.
It’s almost like it’s polling the devices for their actual state, which takes a few seconds and then updates the toggle.
Your assumption is correct.
When you click the toggle it turns on in an assumed state, then it reads the actual state and updates it to off and finally an update of the state occur that it is in fact on.
This behaviour is usually caused by the method for getting info into HA.
Especially pull methods are prone to this, but cloud push can also be slow if the provider is not beefing up their systems.