Hdmi_cec constantly changing input to wrong one

I seem to be having an issue with the hdmi_cec client. I have my homeassistant(rpi3-1), osmc(rpi3-2), a projector, and a pioneer a receiver all connected together. I can turn the projector and the audio receiver on with homeassistant, it goes to my osmc channel and stays for a minute or so. Then switch automatically to the channel homeassistant is on. Has anyone had any issues with this, or know of a fix to stop sending the switch channel command. Thanks in advance. I can’t think of anything to do. Other disable the ability to use cec commands