This is currently possible with an automation. Check out this blueprint.
Currently devices with batteries show their battery percent on the top of the device page. Having a battery level as a repair alert is a good idea, though. You can currently do this with Spook, but it is not in core.
This sounds a lot like an automation you could make. Perhaps add a label to your device that contains the replacement date and use a battery percentage trigger to run your automation and make a notification.
This seems possible with the current UI cards. Add an Entity Card for the battery level and make its visibility conditioned upon the battery level being below a certain threshold.