tried it also, because i also wanted this feature, for me it works
but i am using this platform
you are using the mqtt_manual platform , thats different
but still something wrong indeed
if you look in my screenshot
the popup you see is coming from the badge/sensort, although code_arm_required: false
i need to enter a code before i can press a button, you see the arh_home and arm_away buttons grayed out
on the right side, there you see the lovelace panel, there i can press the buttons, without entering a code
not yet tried actually pressing it, since there is someone at home, and i dont want to go alarm so actual test is for tomorrow