Remove auto discovered devices

How can I remove auto discovered devices ?
I was playing around with autodiscovery and ended up with loads of sensors that I cannot select in the list of sensors. The UI complains that they have no UID but I cannot find any other config file where they show up. The configuration.yaml is almost empty.