disabling the device actually removes the entity from the system. What you see in that page is a “Known config” for the entity. Check back regularly and the delete option will be able to.
Mass deleting and mass disabling was added quite some time ago.