Alexa does not report template binary sensor (though standard sensors are)

Asking Alexa for the state of a template binary sensor does not return the state of the sensor. Returning a “that’s not supported yet”. Even when set to a device class that should be supported.

A standard binary door sensor does is however reported.

Does anyone have any thoughts as to why I’m getting that response or how that can be changed?