This was one of the reasons I built a physical remote for Home Assistant (PARAM KEY). For guests, babysitters, handing them an app or teaching dashboard navigation for a one-time use was a bit cumbersome.
This definitely piqued the interest of quite a few friends in a recent gathering.