Disable pin requirement for Google Assistant 'secure devices'

I want to be able to disable the requirment to provide a pin to open my garage door.
A garage door is a ‘secure device’ so a pin must be configured for it to be opened.
There seems to be no way to disable this requirement. HA Cloud looks to have the option to disable 2FA
I’m using a manual connection to Google Home and it looks like it is hardcoded to force 2FA.