I haven’t been able to solve this problem but found a work-around.
Using the Home Assistant Mobile app on your devices is a (better) solution to get a working device_tracker.
As for me, I haven’t tried any further. You could check for issues at home-assistant/core, and if there aren’t any already there, you could open one. But from what I understand, there’s not that much benefit from a device tracker over a binary sensor.