It is probably triggering on gps position changes. What do you want to accomplish, i.e. when do you want it to trigger? Coming or leaving home, or reaching some other destination?
Edit: I do see your point in that it is weird that the state itself hasn’t changed, just the attributes. Adding a template condition using this should fix it, but then again it should be implicitly true: (untested, maybe I got some of the syntax slightly wrong):