I have a hdmi switch as well but surprisingly you are saying it can affect the router without it being connected to the TV ?
Surprisingly I have put the channel width to 48 from auto and 5G works. I have the channel as 48. Fingers crossed hope it doesnt give me any problems in the future as I was thinking of returning it back.