Entities not available after Update to 2023.4.4

I have updatet all ESP devices to 2023.4.4. The update process went fine, all successful.

All ESPs are conneting to Wifi, an i can see the logs from Home Assitant management page.

But all entities are not available.

So for testing i delete one ESP from the integration and restart HA. The deleted device is recocnized again an i can readd it.

But after restart HA again, the entities are lost again.

Any ideas why that happends and what to do?

Complete restart of my NUC HAOS Installtion also not fix the problem.

Here some logs, maybe something is obviously:

Logger: homeassistant.config_entries
Source: components/esphome/__init__.py:641
First occurred: 11:37:33 (3 occurrences)
Last logged: 11:37:33

Error unloading entry nous-a1t-002 for esphome
Error unloading entry nous-a1t-004 for esphome
Error unloading entry Raumsensor for esphome
Traceback (most recent call last):
  File "/usr/src/homeassistant/homeassistant/config_entries.py", line 543, in async_unload
    result = await component.async_unload_entry(hass, self)
  File "/usr/src/homeassistant/homeassistant/components/esphome/__init__.py", line 647, in async_unload_entry
    entry_data = await _cleanup_instance(hass, entry)
  File "/usr/src/homeassistant/homeassistant/components/esphome/__init__.py", line 641, in _cleanup_instance
    await data.client.disconnect()
  File "/usr/local/lib/python3.10/site-packages/aioesphomeapi/client.py", line 298, in disconnect
    await self._connection.disconnect()
  File "/usr/local/lib/python3.10/site-packages/aioesphomeapi/connection.py", line 709, in disconnect
    await self.send_message_await_response(
  File "/usr/local/lib/python3.10/site-packages/aioesphomeapi/connection.py", line 606, in send_message_await_response
    res = await self.send_message_await_response_complex(
  File "/usr/local/lib/python3.10/site-packages/aioesphomeapi/connection.py", line 587, in send_message_await_response_complex
    self.send_message(send_msg)
  File "/usr/local/lib/python3.10/site-packages/aioesphomeapi/connection.py", line 499, in send_message
    frame_helper.write_packet(message_type, encoded)
  File "/usr/local/lib/python3.10/site-packages/aioesphomeapi/_frame_helper.py", line 348, in write_packet
    self._proto.encrypt(
  File "/usr/local/lib/python3.10/site-packages/noise/connection.py", line 132, in encrypt
    raise NoiseHandshakeError('Handshake not finished yet!')
noise.exceptions.NoiseHandshakeError: Handshake not finished yet!

Revert back to esphome 2023.3.2.

Now it goes like this:

Wenn i readd the Device, everthing looks fine. Also Firmwarestatus is ok.

Wenn i restart HA oder reboot the whole system, this happends:

Esphome Intgeration show a yellow frame and the reload button is missing.

And the Firmwarestatus is not available.

System is running on Home Assistant Core 2023.3.6

Entities are available and sensors and actors are working. When i delete a device an readd it again, everthing is back to normal til i restart HA oder reboot.

Looks like i mix two thinks.

After update to HA 2023.5 esphome is broken:

This i am referring in my first post.

The second Post is the situation after going back to HA 2023.4.6.