Pair Tradfri remote with bulb (AND Conbee 2 stick)

I have paired 4 bulbs and 1 remote to my Conbee 2 through ZHA. Works smoothly for now.

However. For backup purposes (if HA is down), I would still like to be able to independently use the remote to toggle the lights.

I tried to pair the remote by pressing the pair button for 10 seconds. The bulb blinks, but afterwards the bulb is not responding to remote presses.

Both the bulb and remote are still working in HA as before.

Is there a way to bind the remote to the bulbs regardless of HA / ZHA?

I have a similar problem, but Iā€™d like to pair the remote to HA so I can select settings. The remote is not detected by the blue SkyConnect stick. I hope someone has the remote working (connected to the bulb like you asked would also work)