Restrict entity actions to certain users

Hi, I am trying to restrict actions on an entity shown on my dashboard, let’s say I have a switch for a light, or open/close shutter, and I want only certain users to be able to send actions to those entities, how can I achieve this in home assistant?

I did try to look for workarounds and such, best I could do is restrict visibility to users, but the difference here is I am trying to keep it showing on dashboard, but only certain users can send actions.