GPS Tracking Issue

I have been having some issues with my GPS tracking with Home Assistant. Today was really annoying as I was outside blowing snow and the outdoor lights kept turning off on me bc it thought I wasn’t home. I have been having this problem for a while, but I am finally getting around to looking into it. I first started noticing it when Geo Location was added to the HA android app. I tried turning off all tracking in the app along with Wifi network detection and using just GPS Logger since it worked fine for a long time like that.

I have automations that lock my door, close the garage, and turn off the lights when our phones are not within the “home” zone. When I started having this problem I increased the size of the home zone to include a good chunk of my neighborhood and the problem has still persisted. To be honest, I don’t think it’s a problem so much with HA, but more with GPS logger. It used to only happen when I would go into the far back corner of the yard while doing yard work. When I would come back to the house the doors would be locked and garage doors closed. Today, it thought I wan’t home when I was literally 2 feet away from my back door. When I check the app it shows me not home. I open GPS Logger (which is always running) and in a second it updates and I’m home again. I wasn’t ever anywhere near the border of my zone for a few hours so I have no idea why it would get the coordinates of me being out of the zone.

I have attached a screenshot of my zone map and outlined my property lines to show how I can not come anywhere close to leaving my zone when I am within my property.

Any idea of how to fix this would be greatly appreciated.