It's easy to create HTTP binary sensor - how to delete one?

It’s easy to call http://IP_ADDRESS:8123/api/states/binary_sensor.DEVICE_NAME and have a bunch of sensors. But then - testing is over and you need to delete those? Restart of HASS is sometimes pain, especially when you have lots of sensors and components and other things.
Is there a way to delete what has been created?

Mine disappeared after a restart.

That’s exactly what I’m trying to avoid.

curl -X DELETE -H "Authorization: Bearer LONG_LIVED_ACCESS_TOKEN" http://IP_OF_HASSIO:8123/api/states/sensor.YOURNAME