Okay, I digged a little bit deeper and did find some threads with equivalent problems.
The solution should be:
Unfortunately I already renamed the old entity ID and named the new one after the old one, now the LTS is gone. But InfluxDB has me covered, as far as I can tell.
For reference the threads with proposed solutions: