This is not a permanent change. It is only for making non permanent changes to entities for debugging automations and scripts. The changes revert as soon as the entity updates its state or an attribute value.
The only way to change the source of a Utility Meter helper created with the UI is to delete it and create a new one.