Adding encryption shows 'device needs reconfiguration' for each sensor?

Back when encryption was introduced I added it to all my devices. For some reason the integration went bad, I had a lot of intermittent problems, so I removed all the encryption again.
I’m now readding it to the devices.

When I add it, I get a message in HA that a device needs reconfiguration, but when I go to the devices page, the device is shown once per sensor.

If I remove the device before it is updated I sometimes see this: