You creating a problem that wasn’t present before. Ether use a smart plug that you can configure to be always on 
Which can be any ESPHome compatible device but probably not (m)any matter ones 
Or use something without relay (could even be a matter certified device in that regard
)