Do you experience any error? Like does the device go offline?
Best bet: Remove the integration for that particular esphome node and add it again - see if the message is gone. If it behaves the same do it again but restart HA inbetween removing & adding it again.
No worries, the whole thing takes about 20 seconds.
In the past I had success just removing it and adding it again. But not a 100% sure if things changed and a a restart of ha is necessery today - just try without (quick way) to see if it is a quick win
Deleting and adding a esphome node will not delete any history/automations etc. It will just continue the way it worked when added again