Deleting ESPHome Devices/Entities

What is the best way to delete ESPhome devices, and then replace with Zigbee using the same device/entity name? I seem to recall having a difficult time getting the name freed up when I attempted it before.

Just delete them and rename the entities

When I attempt to rename them using Zigbee2mqtt, I get an error that the name is not valid (ie already taken). I have deleted from both the esphome dashboard as well as the integration page.

You must also delete them from homeassistant

I’m aware, but the delete button is disabled.