SQL Sensor does not overwrite, if I change the query

Whenever I change a query in sql sensor, it creates a new entity for me instead of overwriting the existing one.
I then always have to search for the entity in the SQL integration, delete the old one and remove the _2 from the new one so that I have the new query on the old entity again.

How can I prevent this?

I am using the SQL integration (not yaml) and do not (!) have this issue. (docker / 2023.1.1)