Notification Automation with Motion and Location

I have a very long driveway, with a motion sensor on it. Currently, I have an automation set up that sends my wife and me a notification when it detects motion, however, I am trying to figure out a way to use our phone locations with the zones to prevent it from sending us one when we are the ones that trigger it. I’m struggling to figure out how to avoid this as I realized I cannot just set it not to send notifications when I am in the home zone because then I won’t get anything when I am home.