Cast configurator Philips android TV

I am able to add all my cast devices (2 google home speakers and my Philips 55PUS7303) using the configurator. Then they all show up in my home assistant, but when I try to cast a video from my phone (youtube, plex, etc.) to my Philips TV then my TV no longer shows up in the available devices list. I have to remote the cast devices, restart my raspberry with Hassio and power off my TV to be able to cast from my phone.
I have tested this with other phones and exactly the same issue.
Any idea’s on how to get my TV added to Hassio and still be able to see my TV on my phone to cast?