I’ve tracked down the culprit. It was the Icloud3 Device Tracker integration from HACS that creates a “device_tracker” folder in Custom_components and HA obviously doesn’t like that. Upon uninstalling in HACS and removing this folder, default device trackers work again.