So I just randomly found out that there is an MQTT Number entity available. Previously I have set up number helpers and automations to send MQTT messages on change, apparently for nothing.
Where can I find out about all the entity types that the MQTT integration/platform(?) has to offer?