How to differentiate between manual button press on Kasa Switches?

I have severe Kasa HS220 Dimmer switches installed. They’re working fine inside HA but I can’t seem to figure out how to detect whether a switch was toggled manually or via HA. How to go about this?

Most of the lights are automated via motion sensors and automations run via Node-Red. My main goal is to turn off the automations for a period of time if someone manually toggles a light or adjusts brightness.

Right now, the switch status is detected fine by HA but I don’t know if there’s a way to differentiate between what turned the switch on/off. The HA logs do show a different message in the logbook as seen in this screenshot based on whether a call service initiated it or if someone manually pressed the button but the “state” that I can poll for is still either on or off so i’m stuck.

Screenshot_20231023_132643_Samsung Internet|536x500