Kasa devices that no longer exist show up in HA and can't be deleted

How do i remove them so devices that don’t even show up in the Kasa app and are not present in my home disappear and only valid devices/entities show in HA?

When you say “show up” do you mean on a dashboard? If so, have you tried clearing your browser cache? Otherwise, you might try rebooting HA (not simply restarting).