Disable LWT (last will and testament) messaging. Not sure how you do that in Tasmota. In ESPhome you just use blank LWT topics.
The other option is to create templates sensors that store the last known state. There’s an example here: Lovelace UI official Gauge Card: Invalid numeric figure