Lutron Caseta Issue

I have Lutron Casetas lights set up using home-kit first and then i also have them talking to my home assistant so i could set up a vacation routine. I see all my lights so that all works good. The issue I am having is if i turn in on using home assistant switches the switch turns off right away but the light is still on. I let it sit for a while to see if it had to realize that it was on but it never corrected itself. To turn off the light i have to turn the switch on and off really quickly.

Has anyone had this same issue or know how to correct it?

They are set up into home assistant using the lutron plug in not the homekit plugin.

same issue found here

If anyone comes to my post with this issue. No real fix found yet