It’s going to depend on the add on you want. In most cases you need to go see if the application the HA folks packaged as an add on (which is really just a docker container running on HAOS) has a docker container somewhere and then install and configure that. For instance, there is an add on for the MQTT broker. I’m running HA in a Docker container on my NAS, so I had to go to DockerHub and find it. You’re getting mostly the same thing, but it’s not click and install like with HAOS. Welcome to the wonderful world of managing your own Docker containers.
So no, there is no single guide to do this. There are probably lots of different guides depending on the exact thing you want to run in a container.
Here’s a more detailed discussion of add ons in HAOS versus Docker containers.