What I get from that screenshot (ZHA) and this docu is, that there is a possible setting where you disconnect the button from the relay function, but I dont know if this can be seen in home assistant as a seperate entity (probably not).
My thoughts are that it is always good to have a physical control option, but for the fan you can detatch the relay and get a minimum running time.