Lots of KeyError: None when adding entities after upgrading from 2022. Missing entity_id?

I just upgraded to 2023.01 from a late 2022 version. Almost everything went smoothly, but it seemed like after I installed hacs for the first time, I started seeing lots of errors like the below. However, removing hacs from the custom_components folder didn’t make the errors go away again.

At any rate, it seems like everything is still working. Based on the error, it seems like maybe homeassistant is complaining about a bunch of entities not having entity_id set? I do notice that I have many entities with weird ids that I’ve never seen before.

I have dozens of these errors relating to all of these integrations: tasmota, mqtt, airvisual, xiaomi_aqara

Any suggestions?

2023-05-01 22:11:50.474 ERROR (MainThread) [homeassistant.components.sensor] Error adding entities for domain sensor with platform tasmota
Traceback (most recent call last):
  File "/home/homeassistant/.virtualenvs/homeassistant-20230501/lib/python3.11/site-packages/homeassistant/helpers/entity_platform.py", line 455, in async_add_entities
    await asyncio.gather(*tasks)
  File "/home/homeassistant/.virtualenvs/homeassistant-20230501/lib/python3.11/site-packages/homeassistant/helpers/entity_platform.py", line 512, in _async_add_entity
    entity.add_to_platform_start(
  File "/home/homeassistant/.virtualenvs/homeassistant-20230501/lib/python3.11/site-packages/homeassistant/components/sensor/__init__.py", line 217, in add_to_platform_start
    self._async_read_entity_options()
  File "/home/homeassistant/.virtualenvs/homeassistant-20230501/lib/python3.11/site-packages/homeassistant/components/sensor/__init__.py", line 793, in _async_read_entity_options
    registry.async_update_entity_options(
  File "/home/homeassistant/.virtualenvs/homeassistant-20230501/lib/python3.11/site-packages/homeassistant/helpers/entity_registry.py", line 953, in async_update_entity_options
    old = self.entities[entity_id]
          ~~~~~~~~~~~~~^^^^^^^^^^^
  File "/usr/lib/python3.11/collections/__init__.py", line 1124, in __getitem__
    raise KeyError(key)
KeyError: None
2023-05-01 22:11:50.476 ERROR (MainThread) [homeassistant] Error doing job: Task exception was never retrieved
Traceback (most recent call last):
  File "/home/homeassistant/.virtualenvs/homeassistant-20230501/lib/python3.11/site-packages/homeassistant/helpers/entity_platform.py", line 455, in async_add_entities
    await asyncio.gather(*tasks)
  File "/home/homeassistant/.virtualenvs/homeassistant-20230501/lib/python3.11/site-packages/homeassistant/helpers/entity_platform.py", line 512, in _async_add_entity
    entity.add_to_platform_start(
  File "/home/homeassistant/.virtualenvs/homeassistant-20230501/lib/python3.11/site-packages/homeassistant/components/sensor/__init__.py", line 217, in add_to_platform_start
    self._async_read_entity_options()
  File "/home/homeassistant/.virtualenvs/homeassistant-20230501/lib/python3.11/site-packages/homeassistant/components/sensor/__init__.py", line 793, in _async_read_entity_options
    registry.async_update_entity_options(
  File "/home/homeassistant/.virtualenvs/homeassistant-20230501/lib/python3.11/site-packages/homeassistant/helpers/entity_registry.py", line 953, in async_update_entity_options
    old = self.entities[entity_id]
          ~~~~~~~~~~~~~^^^^^^^^^^^
  File "/usr/lib/python3.11/collections/__init__.py", line 1124, in __getitem__
    raise KeyError(key)
KeyError: None