If not and I have to add them all to ESPHome individually,
To clarify; if ESPHome is installed on nodes, then HA will “integrate” them. If set up correctly, HA will recognize them immediately and will set up entities corresponding to the buttons/ switches / lights and other functions that have been set up on your node. At least just one click to accept each recognized node into HA
is there a way in home assistant to issue commands to a group or devices at the same time?
Yes. Automations can do some clever stuff, sending same command to entities/ devices for as many ESPHome entities as you want. I am not aware of any limits.